Comparing Cost-Sensitive LightGBM and TabPFN for Imbalanced Coronary Heart Disease Risk Prediction
Abstract
Coronary heart disease (CHD) constitutes a catastrophic non-communicable disease burden that operates as a non-natural disaster for health systems and directly threatening Sustainable Development Goal 3 (Target 3.4) on premature mortality; yet ten-year CHD risk prediction remains difficult because clinical cohorts are strongly class-imbalanced and most prior evaluations report point estimates without statistical or decision-analytic support. This study compares a fully tuned, cost-sensitive LightGBM pipeline with a zero-tuning tabular foundation model (TabPFN) on the imbalanced Framingham cohort of 4,240 records with a 15.19% event rate, under a common leakage-free protocol with validation-based threshold optimisation and an eight-scenario ablation, and evaluates the primary comparison with the DeLong test, bootstrap confidence intervals, a five-seed robustness check, calibration, and decision-curve analysis. TabPFN achieved higher discrimination, with an area under the receiver operating characteristic curve of 0.713 compared with 0.677 for the tuned ensemble (DeLong p = 0.0037), and better calibration, with a Brier score of 0.120 compared with 0.199. It also attained the best imbalance-aware detection, an F1-score of 0.380 and a Matthews correlation coefficient of 0.245, and remained superior under all five seeds, averaging 0.737 compared with 0.706. Threshold optimisation raised minority-class recall from 0.031 to at least 0.47 without resampling, and ten-predictor curation helped rather than harmed the foundation model. Shapley-based attribution yielded a transparent 0–100 score dominated by age, smoking, and blood pressure. A zero-tuning foundation model thus provides statistically significant, better-calibrated predictions than a tuned cost-sensitive ensemble, offering a scalable screening aid toward SDG 3 (Target 3.4) in resource-limited settings.
Keywords
Full Text:
PDFReferences
[1] World Health Organization. Cardiovascular Diseases (CVDs): Fact Sheet.https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds). Accessed: 2026-01-29. 2023.
[2] Republik Indonesia. Undang-Undang Republik Indonesia Nomor 24 Tahun 2007 tentang Penanggulangan Bencana. Lembaran Negara RI Tahun 2007 Nomor 66. 2007.
[3] United Nations General Assembly. Transforming Our World: The 2030 Agenda for Sustainable Development.https://sdgs.un.org/2030agenda. Resolution A/RES/70/1. 2015.
[4] Lisa M. Sullivan, Joseph M. Massaro, and Ralph B. D'Agostino. "Presentation of Multivariate Data for Clinical Use: The Framingham Study Risk Score Functions."Statistics in Medicine, vol. 23, no. 10, pp. 1601–1609, 2004. doi: 10.1002/sim.1744.
[5] Tianqi Chen and Carlos Guestrin. "XGBoost: A Scalable Tree Boosting System."Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794, 2016. doi: 10.1145/2939672.2939785.
[6] Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. "LightGBM: A Highly Efficient Gradient Boosting Decision Tree."Advances in Neural Information Processing Systems 30 (NeurIPS), pp. 3146–3154, 2017.
[7] Jerome H. Friedman. "Greedy Function Approximation: A Gradient Boosting Machine."Annals of Statistics, vol. 29, no. 5, pp. 1189–1232, 2001.
[8] Haibo He and Edwardo A. Garcia. "Learning from Imbalanced Data."IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263–1284, 2009. doi: 10.1109/TKDE.2008.239.
[9] Charles Elkan. "The Foundations of Cost-Sensitive Learning."Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI), pp. 971–976, 2001.
[10] Joffrey L. Leevy, Justin M. Johnson, John Hancock, and Taghi M. Khoshgoftaar. "Threshold optimization and random undersampling for imbalanced credit card data."Journal of Big Data, vol. 10, no. 1, p. 58, 2023. doi: 10.1186/s40537-023-00738-z.
[11] Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. "SMOTE: Synthetic Minority Over-sampling Technique."Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002.
[12] Siti Amiroch, Fitri Nur Laili, Awawin Mustana Rohmah, and Dicka Yale Kardono. "Coronary Heart Disease Risk Prediction under Class Imbalance Using XGBoost with SHAP-Based Interpretation."CAUCHY: Jurnal Matematika Murni dan Aplikasi, vol. 11, no. 1, pp. 937–955, 2026. doi: 10.18860/cauchy.v11i1.37938.
[13] Noah Hollmann, Samuel Müller, Lennart Purucker, Arjun Krishnakumar, Max Körfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. "Accurate Predictions on Small Data with a Tabular Foundation Model."Nature, vol. 637, pp. 319–326, 2025. doi: 10.1038/s41586-024-08328-6.
[14] Glenn W. Brier. "Verification of Forecasts Expressed in Terms of Probability."Monthly Weather Review, vol. 78, no. 1, pp. 1–3, 1950.
[15] Andrew J. Vickers and Elena B. Elkin. "Decision Curve Analysis: A Novel Method for Evaluating Prediction Models."Medical Decision Making, vol. 26, no. 6, pp. 565–574, 2006. doi: 10.1177/0272989X06295361.
[16] Elizabeth R. DeLong, David M. DeLong, and Daniel L. Clarke-Pearson. "Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: Comparison of Methods."Biometrics, vol. 44, no. 3, pp. 837–845, 1988.
[17] Bradley Efron. "Bootstrap Methods: Another Look at the Jackknife."The Annals of Statistics, vol. 7, no. 1, pp. 1–26, 1979.
[18] Samuel Müller, Noah Hollmann, Sebastian Pineda Arango, Josif Grabocka, and Frank Hutter. "Transformers can do Bayesian inference."Proceedings of the Tenth International Conference on Learning Representations (ICLR), 2022.
[19] Noah Hollmann, Samuel Müller, Katharina Eggensperger, and Frank Hutter. "TabPFN: A transformer that solves small tabular classification problems in a second."Proceedings of the Eleventh International Conference on Learning Representations (ICLR), 2023.
[20] Bing He et al. "Development of Machine Learning-Based Differential Diagnosis Model and Risk Prediction Model of Organ Damage for Severe Mycoplasma pneumoniae Pneumonia in Children."Scientific Reports, vol. 15, p. 9431, 2025. doi: 10.1038/s41598-025-92089-3.
[21] Brian W. Zhews. "Comparison of the Predicted and Observed Secondary Structure of T4 Phage Lysozyme."Biochimica et Biophysica Acta (BBA) — Protein Structure, vol. 405, no. 2, pp. 442–451, 1975.
[22] Frank Wilcoxon. "Individual Comparisons by Ranking Methods."Biometrics Bulletin, vol. 1, no. 6, pp. 80–83, 1945.
[23] Scott M. Lundberg and Su-In Lee. "A Unified Approach to Interpreting Model Predictions."Advances in Neural Information Processing Systems 30 (NeurIPS), pp. 4765–4774, 2017.
[24] Lloyd S. Shapley. "A Value for n-Person Games."Contributions to the Theory of Games, Volume II, edited by Harold W. Kuhn and Albert W. Tucker, Princeton University Press, 1953, pp. 307–317.
[25] Ardi Kurniawan, Nur Azizah, and Sheila Sevira Asteriska Naura. "Comparing Multivariate Adaptive Regression Splines and Machine Learning Methods for Classifying Pneumonia in Indonesian Toddlers."CAUCHY: Jurnal Matematika Murni dan Aplikasi, vol. 10, no. 1, pp. 467–479, 2025.
DOI: https://doi.org/10.18860/cauchy.v11i2.45897
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Arfian Jauhar Himawan, A'yunin Sofro

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Editorial Office
Mathematics Department,
Maulana Malik Ibrahim State Islamic University of Malang
Gajayana Street 50 Malang, East Java, Indonesia 65144
e-mail: cauchy@uin-malang.ac.id

CAUCHY: Jurnal Matematika Murni dan Aplikasi is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.








