Usability Testing and User Interface Improvement of Mobile Banking Application: Livin’ by Mandiri

Mohamad Gilang Alfaridzi; Buce Trias Hanggara; Hanifah Muslimah Az-zahra

doi:10.18860/mat.v15i1.22919

Usability Testing and User Interface Improvement of Mobile Banking Application: Livin’ by Mandiri

Mohamad Gilang Alfaridzi, Buce Trias Hanggara, Hanifah Muslimah Az-zahra

Abstract

Livin' by Mandiri is a mobile banking application that is integrated with Bank Mandiri banking services and its digital ecosystem. However, some users reported negative responses regarding usability aspects. This study aimed to determine the usability problems faced by users, measure the level of usability, and recommend the user interface design for usability improvement. The evaluation was carried out using the Usability Testing method which collected quantitative and qualitative data. Quantitative data was collected by measuring usability metrics data gathered while participants worked on task scenarios and filled out questionnaire. Meanwhile, qualitative data is collected through interviews with participants to gain insight from users on usability issues. The evaluation of the existed application show that the value of the learnability aspect was 68%, the efficiency was 0.013189 goals/sec, the error was 33.28% and the satisfaction aspect score was 73.5 (good). Participants said that the difficulties they faced most were features or menus that were difficult to find or unknown. Next, recommendations were construct to solve the problem by implementing usability guidelines. The user interface design recommendations were manifested in a high-fidelity prototype. The prototype was also evaluated with the usability testing method. The prototype evaluation showed an improvement of usability. The learnability aspect increased to 93%, the efficiency aspect increased to 0.026295 goals/sec, the error decreased to 2.34%, and the satisfaction aspect score was 84.4 (excellent).

Full Text:

PDF

References

[1] R. Binekasri, “Ini Dia Top 10 Bank Dengan Aset Terbesar di RI,” CNBC Indonesia, Mar. 10, 2023. Accessed: Apr. 30, 2023. [Online]. Available: https://www.cnbcindonesia.com/market/20230310092808-17-420529/ini-dia-top-10-bank-dengan-aset-terbesar-di-ri

[2] A. Indraini, “Livin’ by Mandiri Disiapkan Jadi Bank Digital, Begini Rencananya,” detik Finance, Jakarta, Sep. 28, 2022. Accessed: Apr. 30, 2023. [Online]. Available: https://finance.detik.com/moneter/d-6316962/livin-by-mandiri-disiapkan-jadi-bank-digital-begini-rencananya

[3] J. Nielsen, “Usability 101: Introduction to Usability,” Usability, 2012. https://www.nngroup.com/articles/usability-101-introduction-to-usability/ (accessed Dec. 16, 2020).

[4] M. Soegaard, “Usability: A part of the User Experience | IxDF,” 2021. https://www.interaction-design.org/literature/article/usability-a-part-of-the-user-experience (accessed Apr. 30, 2023).

[5] K. Moran, “Usability Testing 101,” Dec. 01, 2019. https://www.nngroup.com/articles/usability-testing-101/ (accessed Apr. 28, 2023).

[6] R. Thakur, “What keeps mobile banking customers loyal?,” International Journal of Bank Marketing, vol. 32, no. 7, pp. 628–646, Sep. 2014, doi: 10.1108/IJBM-07-2013-0062/FULL/XML.

[7] S. Brigita and Zulkarnain, “Sentiment Analysis and Mobile Service Quality of Mobile Banking Application,” in The 7th International Engineering Students Conference (IESC), Universitas Indonesia, Jul. 2022, pp. 70–74. Accessed: Jul. 16, 2023. [Online]. Available: https://www.researchgate.net/publication/372078280_Sentiment_Analysis_and_Mobile_Service_Quality_of_Mobile_Banking_Application

[8] Google, “Homepage - Material Design.” https://m2.material.io/ (accessed Jul. 16, 2023).

[9] A. Senthamarai, “Material Design- Benefits of using material Design,” Medium, 2015. https://medium.com/handyapps-in/material-design-benefits-of-using-material-design-3b33309dfe71 (accessed Jul. 16, 2023).

[10] A. Pinandito, H. M. Az-Zahra, L. Fanani, and A. V. Putri, “Analysis of web content delivery effectiveness and efficiency in responsive web design using material design guidelines and User Centered Design,” in Proceedings - 2017 International Conference on Sustainable Information Engineering and Technology, SIET 2017, 2018. doi: 10.1109/SIET.2017.8304178.

[11] “Usability Testing,” Usability.gov. https://www.usability.gov/how-to-and-tools/methods/usability-testing.html (accessed Apr. 30, 2023).

[12] J. Nielsen, “How Many Test Users in a Usability Study?,” Nielsen Norman Group, 2012. https://www.nngroup.com/articles/how-many-test-users/ (accessed May 17, 2019).

[13] J. Nielsen, “Why You Only Need to Test with 5 Users,” Nielsen Norman Group, Mar. 18, 2000. https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

[14] Sugiyono, Metode Penelitian Bisnis: Pendekatan Kuantitatif, Kualitatif, Kombinasi, dan R&D. Bandung, Indonesia: Alfabeta, CV., 2013.

[15] Moran K. and Pernice K., “Remote Moderated Usability Tests: Why to Do Them,” Nielsen Norman Group, 2020, Accessed: Jul. 03, 2022. [Online]. Available: https://www.nngroup.com/articles/moderated-remote-usability-test/

[16] J. Nielsen and R. Budiu, “Success Rate: The Simplest Usability Metric,” Jul. 20, 2021. https://www.nngroup.com/articles/success-rate-the-simplest-usability-metric/ (accessed Apr. 30, 2023).

[17] A. Seergev, “User Interface Design, UX Evaluation, and Usability Evaluation.,” 2010. http://ui-designer.net/ui-designer/usability.htm (accessed Apr. 30, 2023).

[18] J. Mifsud, “Usability Metrics - A Guide To Quantify The Usability Of Any System,” Usability Geek. Jun. 2018.

[19] J. Sauro and E. Kindlund, “Making Sense of Usability Metrics: Usability and Six Sigma,” Apr. 2005.

[20] J. Brooke, SUS: A quick and dirty usability scale, vol. 189. 1995.

[21] Z. Sharfina and H. B. Santoso, “An Indonesian adaptation of the System Usability Scale (SUS),” in 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS), 2016, pp. 145–148. doi: 10.1109/ICACSIS.2016.7872776.

[22] J. Sauro, “10 Essential Usability Metrics,” MeasuringU, Nov. 30, 2011. https://measuringu.com/essential-metrics/ (accessed Apr. 30, 2023).

[23] J. Brooke, “SUS: A Retrospective,” J. Usability Studies, vol. 8, no. 2, pp. 29–40, 2013.

[24] A. Bangor, P. Kortum, and J. Miller, “Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale,” J. Usability Studies, vol. 4, no. 3, pp. 114–123, 2009, [Online]. Available: http://dl.acm.org/citation.cfm?id=2835587.2835589

[25] J. Sauro, “5 Ways to Interpret a SUS Score,” 2018. https://measuringu.com/interpret-sus-score/ (accessed Jul. 15, 2023).

[26] R. Budiu, “Quantitative vs. Qualitative Usability Testing,” Nielsen Norman Group, 2017. https://www.nngroup.com/articles/quant-vs-qual/ (accessed May 17, 2019).

[27] Google, “Design - Material Design.” https://material.io/design (accessed Jul. 03, 2022).

[28] J. Sauro, “What Is A Good Task-Completion Rate?,” 2011. https://measuringu.com/task-completion/ (accessed Jul. 15, 2023).

[29] “Human error (slips and mistakes) | The Glossary of Human Computer Interaction.” https://www.interaction-design.org/literature/book/the-glossary-of-human-computer-interaction/human-error-slips-and-mistakes (accessed Jul. 16, 2023).

DOI: https://doi.org/10.18860/mat.v15i1.22919

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The journal is indexed by :

_______________________________________________________________________________________________________________

Editorial Office:
Informatics Engineering Department
Faculty of Science and Technology
Universitas Islam Negeri Maulana Malik Ibrahim Malang
Jalan Gajayana 50 Malang, Jawa Timur, Indonesia 65144
Email: matics@uin-malang.ac.id
_______________________________________________________________________________________________________________

Username
Password
Remember me