An Investigation of Machine Learning Techniques for Loan Default Payments Prediction
Main Article Content
Abstract
In banking business, loan default payments of individual customers are counted as risks that result in the loss of the business. Thus, some assessment mechanisms are needed to assess the risks of individual customers who apply for personal loan products. This paper presents an investigation of machine learning techniques to predict loan default payments based on individual customers information backgrounds. The paper emphasis on the ensemble techniques that mostly used in banking business. Besides the ensemble prediction models, the principal component analysis is also used for further investigation. The experimental results showed that all prediction models provided acceptable prediction of non-defaulting payment class, but provided unacceptable prediction of default payment class. That is because the imbalance nature of the data and the features used are not specific enough for the prediction models to classify the minor class from the major class. This paper acts as an initial study of the credit default payment analysis.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
I/we certify that I/we have participated sufficiently in the intellectual content, conception and design of this work or the analysis and interpretation of the data (when applicable), as well as the writing of the manuscript, to take public responsibility for it and have agreed to have my/our name listed as a contributor. I/we believe the manuscript represents valid work. Neither this manuscript nor one with substantially similar content under my/our authorship has been published or is being considered for publication elsewhere, except as described in the covering letter. I/we certify that all the data collected during the study is presented in this manuscript and no data from the study has been or will be published separately. I/we attest that, if requested by the editors, I/we will provide the data/information or will cooperate fully in obtaining and providing the data/information on which the manuscript is based, for examination by the editors or their assignees. Financial interests, direct or indirect, that exist or may be perceived to exist for individual contributors in connection with the content of this paper have been disclosed in the cover letter. Sources of outside support of the project are named in the cover letter.
I/We hereby transfer(s), assign(s), or otherwise convey(s) all copyright ownership, including any and all rights incidental thereto, exclusively to the Journal, in the event that such work is published by the Journal. The Journal shall own the work, including 1) copyright; 2) the right to grant permission to republish the article in whole or in part, with or without fee; 3) the right to produce preprints or reprints and translate into languages other than English for sale or free distribution; and 4) the right to republish the work in a collection of articles in any other mechanical or electronic format.
We give the rights to the corresponding author to make necessary changes as per the request of the journal, do the rest of the correspondence on our behalf and he/she will act as the guarantor for the manuscript on our behalf.
All persons who have made substantial contributions to the work reported in the manuscript, but who are not contributors, are named in the Acknowledgment and have given me/us their written permission to be named. If I/we do not include an Acknowledgment that means I/we have not received substantial contributions from non-contributors and no contributor has been omitted.
References
A. K. I. Hassan and a. Abraham, “Modeling Consumer Loan Default Prediction Using Ensemble Neural Networks,” In Proc. of Int. Conf. on Computing, Electrical and Electronic Engineering (ICCEEE), Khartoum, Sudan, 2013, pp. 719-724.
T. Alam, K. Shaukat, I. A. Hameed, S. Luo, M. U. Sarwar, S. Shabbir, J. Li, and M. Khushi, “An Investigation of Credit Card Default Prediction in the Imbalanced Datasets,” IEEE Access, Vol 8. October 2020, pp. 201173-201198.
M. Dumont, R. Maree, L. Wehenkel, and P. Geurts, “Fast multi-class image annotation with random subwindows and multiple output randomized trees,”, in Conf. Computer Vision Theory and Applications, Lisboa, Portugal, February 2009.
L. Breiman, “Random Forests, “Machine Language, Vol. 45, No. 1, October 2001, pp 5–32.
P. Geurts, D. Ernst., and L. Wehenkel, “Extremely randomized trees”, Machine Learning, Vol. 63, No. 1, 2006, pp. 3-42.
Y. Freund, and R. Schapire, “A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting,” Journal of Computer and System Sciences, Vol. 55, No. 1, August 1997, pp. 119-139.
J. H. Friedman. "Greedy function approximation: A gradient boosting machine," Ann. Statist, Vol. 29 No. 5, October 2001, pp. 1189 - 1232.
O. Sornil and J. Kajornrit, “Improving performance of neural network models for intrusion detection using singular value decomposition”, Recent Advances in Intelligent Systems and Signal Processing, WSES Press, 2003, pp. 338-342.
A. Soni and K. C. P. Shankar, “Bank Loan Default Prediction Using Ensemble Machine Learning Algorithm” In Proc. of 2nd Int. Conf. on Interdisciplinary Cyber Physical Systems (ICPS), Chennai, India, 2022, pp. 170-175.
S. Fan, “Design and implementation of a personal loan default prediction platform based on LightGBM model,” In Proc. on 3rd Int. Conf. International Conference on Power, Electronics and Computer Applications, Shenyang (ICPECA), China, 2023, pp. 1232-1236.
S. K. Shaheen and E. ElFakharany, “Predictive analytics for loan default in banking sector using machine learning techniques,” In Prod. Of 28th Int. Conf. on International Conference on Computer Theory and Applications (ICCTA), Alexandria, Egypt, 2018, pp. 66-71.
L. Lai, “Loan Default Prediction with Machine Learning Techniques,” In Prod. of Int. Conf. International Conference on Computer Communication and Network Security (CCNS), Xi'an, China, 2020, pp. 5-9.
S. Barua, D. Gavandi, P. Sangle, L. Shinde, and J. Ramteke, “Swindle: Predicting the Probability of Loan Defaults using CatBoost Algorithm,” In Proc. of 5th Int. Conf. on Computing Methodologies and Communication (ICCMC), Erode, India, 2021, pp. 1710-1715.
A. Al-qerem, G. Al-Naymat, and M. Alhasan, “Loan Default Prediction Model Improvement through Comprehensive Preprocessing and Features Selection,” In Proc. of Int. Arab Conference on Information Technology (ACIT), Al Ain, United Arab Emirates, 2019, pp. 235-240.
B. Patel, H. Patil, J. Hembram, and S. Jaswal, “Loan Default Forecasting using Data Mining,” In Proc. of Int. Conf. for Emerging Technology (INCET), Belgaum, India, 2020, pp. 1-4.