Measuring What Matters: Goal‑Free Evaluation Of Holistic Assessment In Arabic Language Education

Saproni Muhammad Samin, Azhar Jaafar, Harif Supriady, Rojja Pebrian, Alfitri Zulkifli, Yenni Yunita

Abstract


Outcome‑Based Education (OBE) requires assessment that captures not only knowledge but also professional dispositions and observable performance. Program-level evidence in Arabic Language Education (ALE) remains limited, especially studies that link holistic assessment design to institutional quality indicators and graduate outcomes. This study aims to appraise the effectiveness of a holistic assessment system (cognitive–affective–psychomotor) in the ALE Study Program at Universitas Islam Riau using Goal‑Free Evaluation (GFE), and to examine its association with academic attainment and graduate outcomes. Methods: A mixed‑methods, descriptive‑dominant design; data sources included three academic years (Y‑2 [2022] to Y [2025]) of institutional records, quality assurance documents (Graduate Learning Outcomes (GLOs) → Course Learning Outcomes (CLOs)→sub‑CLOs; rubrics), micro‑teaching artefacts, student satisfaction surveys, and tracer study. Results are presented in compact tables to maintain clear links between indicators and findings. Findings: (i) cognitive—mean Grade Point Average (GPA) remained high and on‑time graduation reached 52% in Y; (ii) affective—“excellent” ratings ≥75% across most service dimensions; (iii) psychomotor—a standardized micro‑teaching ecosystem (≥4 practices/semester; ≥10 core skills; minimum passing grade B‑). Graduate outcomes included 92.86% tracer coverage, 97.5% employed/entrepreneurship/further study, and a mean job‑seeking time of 4.8 months. Conclusion: A 40–30–30 assessment design explicitly linked to GLOs→CLOs and supported by programmatic Quality Assurance (QA) effectively sustains performance across three domains and employability. Recommendations include rubric standardization and digitization, strengthened assessor moderation, expanded practice partnerships, and longitudinal tracking to estimate relative contributions across domains.


Keywords


Outcome‑Based Education; Holistic Assessment; Constructive Alignment; Micro‑Teaching; Employability

References


Agrawal, E., Tungikar, V., & Joshi, Y. (2021). Method for assessment and attainment of course and program outcomes for Tier-I institutes in India. Journal of Engineering Education Transformations, 35–41.

Al-Mubaid, H., & Bettayeb, S. (2017). Intervention-based method for improving learning and critical thinking. 2017 Computing Conference, 1232–1237.

Anderson, B. R., Shah, J. H., & Kreminski, M. (2024). Homogenization effects of large language models on human creative ideation. Proceedings of the 16th Conference on Creativity & Cognition, 413–425. https://doi.org/10.1145/3635636.3656204

Belyakova, E. G., & Zakharova, I. G. (2020). Professional self-determination and professional identity of students-teachers in the conditions of individualisation of education. Obrazovanie i Nauka, 22(1). https://doi.org/10.17853/1994-5639-2020-1-84-112

Biggs, J. (2003). ALIGNING TEACHING AND ASSESSING TO COURSE OBJECTIVES.

Biggs, J. B., & Collis, K. F. (2014). Evaluating the quality of learning: The SOLO taxonomy (Structure of the Observed Learning Outcome). Academic press.

Bloom, B. S. (1956). Taxonomy of. Educational Objectives, 250.

Chen, L., Zaharia, M., & Zou, J. (2024). How Is ChatGPT’s Behavior Changing Over Time? Harvard Data Science Review, 6(2). https://doi.org/10.1162/99608f92.5317da47

Conradty, C., & Bogner, F. X. (2022). Education for sustainable development: How seminar design and time structure of teacher professional development affect students’ motivation and creativity. Education Sciences, 12(5), 296. https://doi.org/10.3390/educsci12050296

David, J. O. (2025). Balancing Growth, Inclusivity, and Technology: Rethinking Student-Centered Learning in South African Higher Education. International Journal of Learning, Teaching and Educational Research, 24(4), 127–153. https://doi.org/10.26803/ijlter.24.4.7

Frank, J. R., & Danoff, D. (2007). The CanMEDS initiative: Implementing an outcomes-based framework of physician competencies. Medical Teacher, 29(7), 642–647. https://doi.org/10.1080/01421590701746983

Ghani, K. A., Yusof, N. M. R. N., Baharuddin, H., Yamat, H., Ahmad, Z., & Abdullah, I. (2011). Development of a learning module on Arabic Language Skills Outside of the Classroom. Procedia-Social and Behavioral Sciences, 18, 154–162.

Hadie, S. N. H., Kasim, F., Mohd Ismail, Z. I., Asari, M. A., Mohd Yusof, N. A., Simok, A. A., Shamsuddin, S. A., & Mohd Amin, M. S. I. (2022). Multiple Mini Viva as an Online Assessment Tool for Postgraduate Anatomy Programme: The USM’s Experience Amidst COVID-19 Pandemic. Education in Medicine Journal, 14(4), 99–112. https://doi.org/10.21315/eimj2022.14.4.9

Handrianto, C., Solfema, S., & Jusoh, A. J. (2025). Cultural Adaptation and Academic Success: Exploring the Experiences of Indonesian Students in Malaysian Universities. Journal of Ethnic and Cultural Studies, 12(3), 251–280. https://doi.org/10.29333/ejecs/2496

Harden, R. M. (2007). Outcome-based education: the future is today. Medical Teacher, 29(7), 625–629. https://doi.org/10.1080/01421590701729930

Johnson, K. (2017). An introduction to foreign language learning and teaching. Routledge.

Joseph, J., Jose, J., Jose, A. S., Ettaniyil, G. G., Cyriac, J., Sebastian, S. K., & Joseph, A. P. (2024). Quantitative insights into outcome-based education: a bibliometric exploration. Int. J. Eval. Res. Educ, 13(6), 4030–4045. https://doi.org/10.11591/ijere.v13i6.29272

Kolb, D. A., Boyatzis, R. E., & Mainemelis, C. (2014). Experiential learning theory: Previous research and new directions. In Perspectives on Thinking, Learning, and Cognitive Styles. https://doi.org/10.4324/9781410605986-9

Lugay, C. I. P., Agustin, B. E., Codico, M. A. E., Tapis, C.-A. P., & Tolentino, E. (2020). A design of an automated assessment process for the outcomes-based education in the industrial engineering department of the faculty of engineering at the University Of Santo Tomas. Journal of Physics: Conference Series, 1529(3), 032046. https://doi.org/10.1088/1742-6596/1529/3/032046

Mitra, G., & Wadegaonkar, A. (2024). Multidimensional Holistic Assessment Framework (HAF): A Case Study of Exploring the Discourses from Elementary School Teachers. International Electronic Journal of Elementary Education, 17(1), 51–69. https://doi.org/10.26822/iejee.2024.363

Muhammad Samin, S., Akzam, I., Pebrian, R., & Fikriansyah, M. H. (2025). Tantangan dan Strategi Penerapan Lingkungan Bahasa Arab di Pesantren. Al-Hikmah: Jurnal Agama Dan Ilmu Pengetahuan, 22(1), 42–55. https://doi.org/10.25299/ajaip.2025.vol22(1).21006

Petrušić, I. (2023). Student-Centred Learning in the Context of External Quality Assurance. Medicina Fluminensis, 59(4). https://doi.org/10.21860/medflum2023_309615

Qiao, Y., & Fu, H. (2022). Study on OBE teaching concept in the context of deep learning for the construction of university mathematics microcourses. Computational Intelligence and Neuroscience, 2022(1), 6860842. https://doi.org/10.1155/2022/1234567

Spady, W. G. (1994). Outcome-Based Education: Critical Issues and Answers. ERIC. https://files.eric.ed.gov/fulltext/ED380910.pdf

Telukdarie, A., & Munsamy, M. (2019). Digitization of higher education institutions. 2019 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 716–721.

Theodoridou, S. (2021). The importance of student-centered learning in the development of critical thinking (full text in Greek). Academia, 23–24, 226–245.

Thompson, A. S., & Asanov, E. (2024). “Nonnative? Next!” Native-speakerism in world language job advertisements. Studies in Second Language Learning and Teaching, 14(1), 49–74. https://doi.org/10.14746/ssllt.42371

Yadav, P., Tomar, A., Soni, R., Dubey, G., Bhargava, C. P., & Kumari, J. (2024). Metrics With Performance Indicators Used For Calculating the Mapping Strength of Course Outcome With Program Outcome. Journal of Engineering Education Transformations, 85–95. https://doi.org/10.16920/jeet/2024/v38i2/24192

Yusri, S. A., & Muhammad Samin, S. (2024). The Effectiveness Of Group Learning In Improving Students’Arabic Speaking proficiency. Perspektif Pendidikan Dan Keguruan, 15(1), 67–72. https://doi.org/10.25299/perspektif.2024.vol15(1).15852

Zhang, Z., & Wang, W. (2024). Enhancing dance education through convolutional neural networks and blended learning. PeerJ Computer Science, 10. https://doi.org/10.7717/peerj-cs.2342

Zlatkin-Troitschanskaia, O., Shavelson, R. J., Schmidt, S., & Beck, K. (2019). On the complementarity of holistic and analytic approaches to performance assessment scoring. British Journal of Educational Psychology, 89(3), 468–484. https://doi.org/10.1111/bjep.12286




DOI: https://doi.org/10.18860/ijazarabi.v9i1.36779

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 saproni muhammad samin, Azhar Jaafar, Harif Supriady, Rojja Pebrian, Alfitri Zulkifli, Yenni Yunita

License URL: https://creativecommons.org/licenses/by-sa/4.0/