Machine Learning Integration in Feature Selection Using Sequential Forward Floating Selection (SFFS) for Improved Credit Scoring
Main Article Content
Abstract
Credit risk evaluation serves as the backbone of any financial decision, especially in government funding programs like DOST SET-UP. However, conventional credit assessment methods often face problems such as redundant features, low prediction accuracy, and increased computational complexity, which may result in suboptimal funding decisions. This study presents an integrated machine learning framework that incorporates Sequential Forward Floating Selection (SFFS) to optimize feature selection in credit assessment. This study considered financial and operational parameters from historical data on 33 DOST SET-UP projects undertaken from 2008 to 2016. A total of twelve parameters were initially considered in the feature selection process, which was later reduced to four highly significant features using the SFFS algorithm in Python: the Debt to Asset Ratio (DAR), the Net Profit Margin (NPM), the Liquidity Ratio (LR), and the Return on Investment (ROI). These features were later incorporated into the development of the rule-based fuzzy logic system using the MATLAB platform to produce the final recommendation for the risk assessment of the proposals. The experimental results show that feature selection greatly improved the model's prediction accuracy, and the system achieved an overall accuracy of 94%. The results verified that integrating machine learning-based feature selection and fuzzy logic can develop an efficient and effective credit scoring model for the government's lending programs and improve financial sustainability for micro, small, and medium enterprises.
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Department of Science and Technology. Small Enterprise Technology Upgrading Program (SETUP)—Program Description and Guidelines; 2023. https://region1.dost.gov.ph/setup/.
Beaver, W. Financial Ratios as Predictors of Failure. J. Account. Res. 1966, 4, 71–111. https://doi.org/10.2307/2490171
Doumpos, M.; Zopounidis, C.; Dounias, G.; Karagiannis, N. Feature Selection for the Credit Risk Prediction Problem; 2019. https://www.researchgate.net/publication/387707974_Features_Selection_for_Credit_Risk_Prediction_Problem
Fallahpour, S.; Lakvan, E. N.; Zadeh, M. H. Using an Ensemble Classifier Based on Sequential Floating Forward Selection for the Financial Distress Prediction Problem. J. Retail. Consum. Serv. 2017, 34, 159–167. https://doi.org/10.1016/j.jretconser.2016.10.010
Yang, J.; Liu, Z.; Wang, Y. Feature Selection in Credit Rating Assessments Using Principal Component Analysis and Factor Analysis. arXiv 2020, arXiv:2011.09137. https://arxiv.org/abs/2011.09137
Ding, Y.; Yan, L. A Financial Distress Prediction Model Integrating Multi-Source Data with MRMR and SVM-RFE for Selection. arXiv 2024, arXiv:2404.12610. https://arxiv.org/abs/2404.12610
Wu, X.; Li, H.; Zhang, P. An Ensemble Feature Selection Method and Improved Stacking Algorithm for Financial Distress Prediction. Kybernetes 2024. https://doi.org/10.1108/K-08-2023-1428
Zhang, L.; Chen, M.; Huang, F. A Two-Stage Feature Selection Method for Artificial Neural Network-Based Financial Distress Prediction. Eng. Econ. 2024, 35, 45–61. https://inzeko.ktu.lt/index.php/EE/article/view/30924
Santoso, B.; Wibowo, A. Comparison of Linear Discriminant Analysis and Support Vector Machine for Financial Distress Prediction. IOP Conf. Ser.: J. Phys. 2018, 979, 012089. https://doi.org/10.1088/1742-6596/979/1/012089
Palongpalong, P. S.; Taroc, R. D.; Bilocora, D. D. Blended Learning with Online Assessment in Higher Education: Its Global Environmental Dimensions of Sustainability; 2018.
Tan, M.; Pu, J.; Zheng, B. Optimization of Breast Mass Classification Using Sequential Forward Floating Selection (SFFS) and a Support Vector Machine (SVM) Model. Int. J. Comput. Assist. Radiol. Surg. 2014, 9, 1005–1020. https://doi.org/10.1007/s11548-014-0992-1
Brown, I.; Mues, C. An Experimental Comparison of Classification Algorithms for Imbalanced Credit Scoring Data Sets. Expert Syst. Appl. 2012, 39, 3446–3453. https://doi.org/10.1016/j.eswa.2011.09.014
Hand, D. J.; Henley, W. E. Statistical Classification Methods in Consumer Credit Scoring: A Review. J. R. Stat. Soc. 1997, 160, 523–541. https://doi.org/10.1111/1467-9876.00088
Lessmann, S.; Baesens, B.; Seow, H.-V.; Thomas, L. C. Benchmarking State-of-the-Art Classification Algorithms for Credit Scoring: An Update of Research. Eur. J. Oper. Res. 2015, 247, 124–136. https://doi.org/10.1016/j.ejor.2015.05.030
Oreski, S.; Oreski, G. A Novel Credit Scoring Model Based on Genetic Fuzzy Rule-Based Systems. Expert Syst. Appl. 2015, 42, 5623–5634. https://doi.org/10.1016/j.eswa.2015.04.003
Crook, J.; Edelman, D.; Thomas, L. Recent Developments in Consumer Credit Risk Assessment. Eur. J. Oper. Res. 2007, 183, 1447–1465. https://doi.org/10.1016/j.ejor.2006.07.004