Combination of Extreme Learning Machine and Binary Bat Algorithm for Customer Churn Prediction

Arifin Arifin, Syaiful Anam, Marsudi Marsudi

Abstract


Abstract

One of the important assets in a company is customers. Customers determine the company's stability because they are source of income and determine the company's competitiveness. It shows the importance of predicting which customers have the potential to switch to another company. These predictions can be done using Machine Learning (ML). One of ML methods is the Extreme Learning Machine (ELM). The advantages of ELM compared to other methods are fast computing time, ease of use, and can reach a global optimum. However, ELM has weaknesses when solving problems with high-dimensional datasets, so feature selection is required. The Binary Bat Algorithm (BBA) is a swarm intelligence method that can be used to optimize ELM performance. The advantages of BBA compared to other are few parameters and much better in effectiveness or accuracy. This research was carried out with preprocessing data, training data and testing data. The research results showed that ELM-BBA is better than ELM and ELM-Binary Particle Swarm Optimization (BPSO) in evaluation metric values. However, ELM-BBA tended to be slower than ELM-BPSO. The best results on evaluation metrics achieved by ELM-BBA were 0.97, 0.97, 0.96, and 0.97 in accuracy, precision, recall, and F1 score, respectively.


Keywords


binary bat algorithm; customer churn prediction; extreme learning machine

Full Text:

PDF

References


[1] I. Ranggadara, G. Wang, and E. R. Kaburuan, “Applying Customer Loyalty Classification with RFM and Naïve Bayes for Better Decision Making,” Proc. - 2019 Int. Semin. Appl. Technol. Inf. Commun. Ind. 4.0 Retrosp. Prospect. Challenges, iSemantic 2019, pp. 564–568, 2019, doi: 10.1109/ISEMANTIC.2019.8884262.

[2] X. Xiahou and Y. Harada, “B2C E-Commerce Customer Churn Prediction Based on,” pp. 458–475, 2022.

[3] A. K. Ahmad, A. Jafar, and K. Aljoumaa, “Customer churn prediction in telecom using machine learning in big data platform,” J. Big Data, vol. 6, no. 1, 2019, doi: 10.1186/s40537-019-0191-6.

[4] N. Hazimah, S. Harahap, A. Amirullah, M. B. Saputro, and I. A. Tamaroh, “Classification of potential customers using C4.5 and k-means algorithms to determine customer service priorities to maintain loyalty,” J. Soft Comput. Explor., vol. 3, no. 2, pp. 123–130, 2022, doi: 10.52465/joscex.v3i2.89.

[5] M. Imani, “Customer Churn Prediction in Telecommunication Industry: A Literature Review,” 2024, doi: 10.20944/preprints202403.0585.v1.

[6] Wael Fujo Samah, Subramanian Suresh, and Ahmad Khder Moaiad, “Customer Churn Prediction in Telecommunication Industry Using Deep Learning,” Inf. Sci. Lett., vol. 11, no. 1, pp. 1–15, 2022.

[7] H. Sulistiani, K. Muludi, and A. Syarif, “Implementation of Dynamic Mutual Information and Support Vector Machine for Customer Loyalty Classification,” J. Phys. Conf. Ser., vol. 1338, no. 1, 2019, doi: 10.1088/1742-6596/1338/1/012050.

[8] V. Agarwal, S. Taware, S. A. Yadav, D. Gangodkar, A. L. N. Rao, and V. K. Srivastav, “Customer - Churn Prediction Using Machine Learning,” Proc. Int. Conf. Technol. Adv. Comput. Sci. ICTACS 2022, pp. 893–899, 2022, doi: 10.1109/ICTACS56270.2022.9988187.

[9] R. Kaur, R. K. Roul, and S. Batra, “Multilayer extreme learning machine: a systematic review,” Multimed. Tools Appl., vol. 82, no. 26, pp. 40269–40307, 2023, doi: 10.1007/s11042-023-14634-4.

[10] F. Ö. Koçoğlu and T. Özcan, “A grid search optimized extreme learning machine approach for customer churn prediction,” J. Eng. Res., vol. 11, no. 3, pp. 103–112, 2022, doi: 10.36909/jer.16771.

[11] K. G. Li and B. P. Marikannan, “Hybrid particle swarm optimization-extreme learning machine algorithm for customer churn prediction,” J. Comput. Theor. Nanosci., vol. 16, no. 8, pp. 3432–3436, 2019, doi: 10.1166/jctn.2019.8304.

[12] S. Jeyasingh and M. Veluchamy, “Modified bat algorithm for feature selection with the Wisconsin Diagnosis Breast Cancer (WDBC) dataset,” Asian Pacific J. Cancer Prev., vol. 18, no. 5, pp. 1257–1264, 2017, doi: 10.22034/APJCP.2017.18.5.1257.

[13] Y. Li, Y. Zhao, Y. Shang, and J. Liu, “An improved firefly algorithm with dynamic self-adaptive adjustment,” PLoS One, vol. 16, no. 10 October 2021, pp. 1–24, 2021, doi: 10.1371/journal.pone.0255951.

[14] F. Liu, X. Yan, and Y. Lu, “Feature Selection for Image Steganalysis Using Binary Bat Algorithm,” IEEE Access, vol. 8, pp. 4244–4249, 2020, doi: 10.1109/ACCESS.2019.2963084.

[15] K. Sumanth and M. V. Priya, “Finding Solution for Practical Economic Load Dispatch Problem Using Dragonfly Algorithm in Comparison with Novel Bat Algorithm,” Proc. Int. Conf. Artif. Intell. Knowl. Discov. Concurr. Eng. ICECONF 2023, pp. 1–4, 2023, doi: 10.1109/ICECONF57129.2023.10083769.

[16] C. A. Griffiths, C. Giannetti, K. T. Andrzejewski, and A. Morgan, “Comparison of a Bat and Genetic Algorithm Generated Sequence against Lead through Programming When Assembling a PCB Using a Six-Axis Robot with Multiple Motions and Speeds,” IEEE Trans. Ind. Informatics, vol. 18, no. 2, pp. 1102–1110, 2022, doi: 10.1109/TII.2021.3082877.

[17] V. Yassaswini and S. Baskaran, “An Optimization of Feature Selection for Classification using Modified Bat Algorithm,” Int. J. Inf. Technol. Comput. Sci., vol. 13, no. 4, pp. 38–46, 2021, doi: 10.5815/ijitcs.2021.04.04.

[18] R. Yaghoubzadeh, S. Kamel, H. Barzegar, and B. San’ati, “The Use of the Binary Bat Algorithm in Improving the Accuracy of Breast Cancer Diagnosis,” Multidiscip. Cancer Investig., vol. 5, no. 1, pp. 1–8, 2021, doi: 10.30699/mci.5.1.372-2.

[19] M. Karanovic, M. Popovac, S. Sladojevic, M. Arsenovic, and D. Stefanovic, “Telecommunication Services Churn Prediction - Deep Learning Approach,” 2018 26th Telecommun. Forum, TELFOR 2018 - Proc., no. January 2019, 2018, doi: 10.1109/TELFOR.2018.8612067.

[20] U. Sa’adah, M. Y. Rochayani, D. W. Lestari, and D. A. Lusia, Kupas Tuntas Algoritma Data Mining dan Implementasinya Menggunakan R. Malang: Universitas Brawijaya Press, 2021.

[21] D. T. Utari, “Integration of Svm and Smote-Nc for Classification of Heart Failure Patients,” BAREKENG J. Ilmu Mat. dan Terap., vol. 17, no. 4, pp. 2263–2272, 2023, doi: 10.30598/barekengvol17iss4pp2263-2272.

[22] Y. Wang et al., “A novel bat algorithm with multiple strategies coupling for numerical optimization,” Mathematics, vol. 7, no. 2, pp. 1–17, 2019, doi: 10.3390/math7020135.

[23] T. Agarwal and V. Kumar, “A Systematic Review on Bat Algorithm: Theoretical Foundation, Variants, and Applications,” Arch. Comput. Methods Eng., vol. 29, no. 5, pp. 2707–2736, 2022, doi: 10.1007/s11831-021-09673-9.

[24] R. Y. M. Nakamura, L. A. M. Pereira, K. A. Costa, D. Rodrigues, and J. P. Papa, “BBA : A Binary Bat Algorithm for Feature Selection,” 2012 25th SIBGRAPI Conf. Graph. Patterns Images, pp. 291–297, 2012, doi: 10.1109/SIBGRAPI.2012.47.

[25] B. Deng, X. Zhang, W. Gong, and D. Shang, “An overview of extreme learning machine,” Proc. - 2019 4th Int. Conf. Control. Robot. Cybern. CRC 2019, pp. 189–195, 2019, doi: 10.1109/CRC.2019.00046.

[26] J. Wang, S. Lu, S. H. Wang, and Y. D. Zhang, “A review on extreme learning machine,” Multimed. Tools Appl., vol. 81, no. 29, pp. 41611–41660, 2022, doi: 10.1007/s11042-021-11007-7.

[27] M. Nasser and U. K. Yusof, “Deep Learning Based Methods for Breast Cancer Diagnosis: A Systematic Review and Future Direction,” Diagnostics, vol. 13, no. 1, 2023, doi: 10.3390/diagnostics13010161.




DOI: https://doi.org/10.18860/cauchy.v10i1.31815

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Arifin Arifin, Syaiful Anam, Marsudi Marsudi

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Editorial Office
Mathematics Department,
Universitas Islam Negeri Maulana Malik Ibrahim Malang
Gajayana Street 50 Malang, East Java, Indonesia 65144
Faximile (+62) 341 558933
e-mail: cauchy@uin-malang.ac.id

Creative Commons License
CAUCHY: Jurnal Matematika Murni dan Aplikasi is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.