A Dynamic Credit Risk Assessment Model Based on Deep Reinforcement Learning

Authors

  • Ke Xiong University of Southern California
  • Lin Li Carnegie Mellon University
  • Zeyu Wang University of Toronto
  • Guanghe Cao University of Southern California

DOI:

https://doi.org/10.5281/zenodo.13905241

ARK:

https://n2t.net/ark:/40704/AJNS.v1n1a05

References:

40

Keywords:

Credit Risk Assessment, Deep Reinforcement Learning, Dynamic Adaptation, Financial Decision-Making

Abstract

This study presents a new credit risk assessment model based on deep learning (DRL), addressing the limitations of static models in adapting to financial changes. The model leverages the Deep Q-Network architecture developed with the importance of replication, DQN distribution, and ring noise to capture the correlations and non-linearities in the credit data and transition to financial reform. An analysis of the extensive data of 1,250,000 credit applications shows the best performance model, achieving an AUC-ROC of 0.92 and a 15% improvement in the ratio for state-of-the-art machine learning methods. The DRL model exhibits remarkable adaptability in simulated dynamic scenarios, maintaining an average AUC-ROC of 0.89 across various economic shocks and market shifts. An ablation study reveals the significant contributions of each model component, with prioritized experience replay emerging as the most impactful for adaptability. The proposed approach offers promising implications for enhancing credit risk management practices, potentially enabling more inclusive lending while mitigating default risks. However, challenges remain in model interpretability and potential bias perpetuation, necessitating further research into transparent and fair AI-driven credit assessment systems. This study contributes to the growing body of research applying advanced machine-learning techniques to critical financial decision-making processes.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Author Biographies

Ke Xiong, University of Southern California

Ke Xiong Computer Science,University of Southern California, CA, USA

Lin Li, Carnegie Mellon University

Electrical and Computer Engineering, Carnegie Mellon University, PA, USA.

Zeyu Wang, University of Toronto

Computer Science, University of Toronto, Toronto, Canada.

Guanghe Cao, University of Southern California

Computer Science, University of Southern California, CA, USA.

References

Mashrur, A., Luo, W., Zaidi, N. A., & Robles-Kelly, A. (2020). Machine learning for financial risk management: a survey. Ieee Access, 8, 203203-203223.

Rao, S., Saraf, M. N., Bansal, A., & Upreti, A. (2024, July). Personalized Credit Score Prediction and Improvement Model Using Machine Learning. In 2024 Asia Pacific Conference on Innovation in Technology (APCIT) (pp. 1-4). IEEE.

Chen, Z., Wang, S., Yan, D., & Li, Y. (2023, December). Research and Implementation of Bank Credit Card Fraud Detection System Based on Reinforcement Learning and LSTM. In 2023 3rd International Conference on Mobile Networks and Wireless Communications (ICMNWC) (pp. 1-8). IEEE.

El Bouchti, A., Chakroun, A., Abbar, H., & Okar, C. (2017, August). Fraud detection in banking using deep reinforcement learning. In 2017 Seventh International Conference on Innovative Computing Technology (INTECH) (pp. 58-63). IEEE.

Paul, S., Gupta, A., Kar, A. K., & Singh, V. (2023, September). An Automatic Deep Reinforcement Learning Based Credit Scoring Model using Deep-Q Network for Classification of Customer Credit Requests. In 2023 IEEE International Symposium on Technology and Society (ISTAS) (pp. 1-8). IEEE.

Wang, S., Zhu, Y., Lou, Q., & Wei, M. (2024). Utilizing Artificial Intelligence for Financial Risk Monitoring in Asset Management. Academic Journal of Sociology and Management, 2(5), 11-19.

Li, H., Zhou, S., Yuan, B., & Zhang, M. (2024). OPTIMIZING INTELLIGENT EDGE COMPUTING RESOURCE SCHEDULING BASED ON FEDERATED LEARNING. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 235-260.

Pu, Y., Zhu, Y., Xu, H., Wang, Z., & Wei, M. (2024). LSTM-Based Financial Statement Fraud Prediction Model for Listed Companies. Academic Journal of Sociology and Management, 2(5), 20-31.

Liu, Y., Tan, H., Cao, G., & Xu, Y. (2024). Enhancing User Engagement through Adaptive UI/UX Design: A Study on Personalized Mobile App Interfaces.

Huang, D., Yang, M., Wen, X., Xia, S., & Yuan, B. (2024). AI-Driven Drug Discovery: Accelerating the Development of Novel Therapeutics in Biopharmaceuticals. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 206-224.

Xu, H., Li, S., Niu, K., & Ping, G. (2024). Utilizing Deep Learning to Detect Fraud in Financial Transactions and Tax Reporting. Journal of Economic Theory and Business Management, 1(4), 61-71.

Wang, S., Zheng, H., Wen, X., & Fu, S. (2024). DISTRIBUTED HIGH-PERFORMANCE COMPUTING METHODS FOR ACCELERATING DEEP LEARNING TRAINING. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 108-126.

Wang, Shikai, Kangming Xu, and Zhipeng Ling. "Deep Learning-Based Chip Power Prediction and Optimization: An Intelligent EDA Approach." International Journal of Innovative Research in Computer Science & Technology 12.4 (2024): 77-87.

Xu, K., Zhou, H., Zheng, H., Zhu, M., & Xin, Q. (2024). Intelligent Classification and Personalized Recommendation of E-commerce Products Based on Machine Learning. arXiv preprint arXiv:2403.19345.

Xu, K., Zheng, H., Zhan, X., Zhou, S., & Niu, K. (2024). Evaluation and Optimization of Intelligent Recommendation System Performance with Cloud Resource Automation Compatibility.

Zheng, H., Xu, K., Zhou, H., Wang, Y., & Su, G. (2024). Medication Recommendation System Based on Natural Language Processing for Patient Emotion Analysis. Academic Journal of Science and Technology, 10(1), 62-68.

Zheng, H.; Wu, J.; Song, R.; Guo, L.; Xu, Z. Predicting Financial Enterprise Stocks and Economic Data Trends Using Machine Learning Time Series Analysis. Applied and Computational Engineering 2024, 87, 26–32,

Liang, P., Song, B., Zhan, X., Chen, Z., & Yuan, J. (2024). Automating the training and deployment of models in MLOps by integrating systems with machine learning. Applied and Computational Engineering, 67, 1-7.

Wu, B., Gong, Y., Zheng, H., Zhang, Y., Huang, J., & Xu, J. (2024). Enterprise cloud resource optimization and management based on cloud operations. Applied and Computational Engineering, 67, 8-14.

Liu, B., & Zhang, Y. (2023). Implementation of seamless assistance with Google Assistant leveraging cloud computing. Journal of Cloud Computing, 12(4), 1-15.

Zhang, M., Yuan, B., Li, H., & Xu, K. (2024). LLM-Cloud Complete: Leveraging Cloud Computing for Efficient Large Language Model-based Code Completion. Journal of Artificial Intelligence General science (JAIGS) ISSN: 3006-4023, 5(1), 295-326.

Li, P., Hua, Y., Cao, Q., & Zhang, M. (2020, December). Improving the Restore Performance via Physical-Locality Middleware for Backup Systems. In Proceedings of the 21st International Middleware Conference (pp. 341-355).

Zhou, S., Yuan, B., Xu, K., Zhang, M., & Zheng, W. (2024). THE IMPACT OF PRICING SCHEMES ON CLOUD COMPUTING AND DISTRIBUTED SYSTEMS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 193-205.

Shang, F., Zhao, F., Zhang, M., Sun, J., & Shi, J. (2024). Personalized Recommendation Systems Powered By Large Language Models: Integrating Semantic Understanding and User Preferences. International Journal of Innovative Research in Engineering and Management, 11(4), 39-49.

Sun, J., Wen, X., Ping, G., & Zhang, M. (2024). Application of News Analysis Based on Large Language Models in Supply Chain Risk Prediction. Journal of Computer Technology and Applied Mathematics, 1(3), 55-65.

Zhao, F., Zhang, M., Zhou, S., & Lou, Q. (2024). Detection of Network Security Traffic Anomalies Based on Machine Learning KNN Method. Journal of Artificial Intelligence General science (JAIGS) ISSN: 3006-4023, 1(1), 209-218.

Feng, Y., Qi, Y., Li, H., Wang, X., & Tian, J. (2024, July 11). Leveraging federated learning and edge computing for recommendation systems within cloud computing networks. In Proceedings of the Third International Symposium on Computer Applications and Information Systems (ISCAIS 2024) (Vol. 13210, pp. 279-287). SPIE.

Zhao, F.; Li, H.; Niu, K.; Shi, J.; Song, R. Application of Deep Learning-Based Intrusion Detection System (IDS) in Network Anomaly Traffic Detection. Preprints 2024, 2024070595.

Gong, Y., Liu, H., Li, L., Tian, J., & Li, H. (2024, February 28). Deep learning-based medical image registration algorithm: Enhancing accuracy with dense connections and channel attention mechanisms. Journal of Theory and Practice of Engineering Science, 4(02), 1-7.

Wang, S., Zheng, H., Wen, X., Xu, K., & Tan, H. (2024). Enhancing chip design verification through AI-powered bug detection in RTL code. Applied and Computational Engineering, 92, 27-33.

Yu, K., Bao, Q., Xu, H., Cao, G., & Xia, S. (2024). An Extreme Learning Machine Stock Price Prediction Algorithm Based on the Optimisation of the Crown Porcupine Optimisation Algorithm with an Adaptive Bandwidth Kernel Function Density Estimation Algorithm.

Li A, Zhuang S, Yang T, Lu W, Xu J. Optimization of logistics cargo tracking and transportation efficiency based on data science deep learning models. Applied and Computational Engineering. 2024 Jul 8;69:71-7.

Xu, J., Yang, T., Zhuang, S., Li, H. and Lu, W., 2024. AI-based financial transaction monitoring and fraud prevention with behaviour prediction. Applied and Computational Engineering, 77, pp.218-224.

Ling, Z., Xin, Q., Lin, Y., Su, G. and Shui, Z., 2024. Optimization of autonomous driving image detection based on RFAConv and triplet attention. Applied and Computational Engineering, 77, pp.210-217.

Zhang, X., 2024. Machine learning insights into digital payment behaviors and fraud prediction. Applied and Computational Engineering, 67, pp.61-67.

Zhang, X. (2024). Analyzing Financial Market Trends in Cryptocurrency and Stock Prices Using CNN-LSTM Models.

Xu, X., Xu, Z., Ling, Z., Jin, Z., & Du, S. (2024). Emerging Synergies Between Large Language Models and Machine Learning in Ecommerce Recommendations. arXiv preprint arXiv:2403.02760.

Liu, Y., Tan, H., Cao, G., & Xu, Y. (2024). Enhancing User Engagement through Adaptive UI/UX Design: A Study on Personalized Mobile App Interfaces.

Zhu, Y., Yu, K., Wei, M., Pu, Y., & Wang, Z. (2024). AI-Enhanced Administrative Prosecutorial Supervision in Financial Big Data: New Concepts and Functions for the Digital Era. Social Science Journal for Advanced Research, 4(5), 40-54.

Wang, S., Zhu, Y., Lou, Q., & Wei, M. (2024). Utilizing Artificial Intelligence for Financial Risk Monitoring in Asset Management. Academic Journal of Sociology and Management, 2(5), 11-19.

Downloads

Published

2024-10-10

How to Cite

Xiong, K., Li, L., Wang, Z., & Cao, G. (2024). A Dynamic Credit Risk Assessment Model Based on Deep Reinforcement Learning. Academic Journal of Natural Science , 1(1), 20–31. https://doi.org/10.5281/zenodo.13905241

Issue

Section

Articles

ARK