Measuring What Matters: Goal‑Free Evaluation Of Holistic Assessment In Arabic Language Education

Saproni Muhammad Samin, Azhar Jaafar, Harif Supriady, Rojja Pebrian, Alfitri Zulkifli, Yenni Yunita

Abstract


Outcome-Based Education (OBE) requires assessment that captures not only knowledge but also professional dispositions and observable performance. Program-level evidence in Arabic Language Education (ALE) remains limited, especially studies that link holistic assessment design to institutional quality indicators and graduate outcomes. The study aims to appraise the effectiveness of a holistic assessment system (cognitive–affective–psychomotor) in the ALE Study Program at Universitas Islam Riau using Goal Free Evaluation (GFE) and to examine its association with academic attainment and graduate outcomes. This study is a mixed-methods, descriptive dominant design employing GFE to evaluate effectiveness through actual outcomes rather than predetermined targets. Data sources included three academic years (Y2 [2022] to Y [2025]) of institutional records, quality assurance documents (GLOs•CLOs•sub-CLOs; rubrics), micro-teaching artefacts, student satisfaction surveys, and a tracer study. Association with academic attainment was examined through temporal trends in GPA and on-time graduation; association with graduate outcomes through employment rates and time-to-job. Findings: GFE evaluation revealed system effectiveness across all domains: (i) cognitive—mean GPA remained consistently high (3.69–3.78) and on time graduation reached 52% in Y; (ii) affective—“very good” ratings ≥75% across service dimensions; (iii) psychomotor—standardized micro teaching ecosystem (≥4 practices/semester; ≥10 core skills; B threshold). Association with academic attainment: The 40–30–30 design, explicitly linked to GLOs→CLOs, showed a strong association: stable, high GPAs across three years and improved on-time graduation indicate that the system effectively supports quality and efficiency. Association with graduate outcomes: Strong positive association demonstrated—97.5% placement, 4.8-month time-to-job, with education sector dominance (~77%) corresponding to psychomotor emphasis on teaching skills. The integrated competence (cognitive mastery, affective dispositions, psychomotor skills) developed through the holistic assessment system directly contributed to favorable employment outcomes. Conclusion: A 40–30–30 assessment design explicitly linked to GLOs→CLOs effectively sustains performance across three domains and employability. GFE evaluation demonstrated apparent effectiveness and strong associations with both academic attainment and graduate outcomes. Recommendations include rubric standardization, assessor moderation, analytics dashboards, and longitudinal tracking.

Keywords


Outcome Based Education; Holistic Assessment; Constructive Alignment; Micro Teaching; Employability

Full Text:

PDF

References


Agrawal, E., Tungikar, V., & Joshi, Y. (2021). Method For Assessment And Attainment Of Course And Program Outcomes for Tier-I institutes in India. Journal of Engineering Education Transformations, 35–41. https://sciresol.s3.us-east-2.amazonaws.com/srs-j/jeet/pdf/volume34/issue3/JEET556.pdf

Al-Mubaid, H., & Bettayeb, S. (2017). Intervention-Based Method For Improving Learning And Critical Thinking. 2017 Computing Conference, 1232–1237.

Anderson, B. R., Shah, J. H., & Kreminski, M. (2024). Homogenization Effects Of Large Language Models On Human Creative Ideation. Proceedings of the 16th Conference on Creativity & Cognition, 413–425. https://doi.org/10.1145/3635636.3656204

Belyakova, E. G., & Zakharova, I. G. (2020). Professional Self-Determination And Professional Identity Of Students-Teachers In The Conditions Of Individualisation Of Education. Obrazovanie i Nauka, 22(1). https://doi.org/10.17853/1994-5639-2020-1-84-112

Biggs, J. (2003). Aligning Teaching And Assessing To Course Objectives. Teaching and Learning in Higher Education: New Trends and Innovations, 1–9.

Biggs, J. B., & Collis, K. F. (2014). Evaluating The Quality Of Learning: The Solo Taxonomy (Structure of the Observed Learning Outcome). Academic press.

Chen, L., Zaharia, M., & Zou, J. (2024). How Is ChatGPT’s Behavior Changing Over Time? Harvard Data Science Review, 6(2). https://doi.org/10.1162/99608f92.5317da47

Conradty, C., & Bogner, F. X. (2022). Education for Sustainable Development: How Seminar Design And Time Structure Of Teacher Professional Development Affect Students’ Motivation And Creativity. Education Sciences, 12(5), 296. https://doi.org/10.3390/educsci12050296

David, J. O. (2025). Balancing Growth, Inclusivity, and Technology: Rethinking Student-Centered Learning in South African Higher Education. International Journal of Learning, Teaching and Educational Research, 24(4), 127–153. https://doi.org/10.26803/ijlter.24.4.7

Frank, J. R., & Danoff, D. (2007). The CanMEDS Initiative: Implementing an Outcomes-Based Framework Of Physician Competencies. Medical Teacher, 29(7), 642–647. https://doi.org/10.1080/01421590701746983

Ghani, K. A., Yusof, N. M. R. N., Baharuddin, H., Yamat, H., Ahmad, Z., & Abdullah, I. (2011). Development of A Learning Module on Arabic Language Skills Outside of the Classroom. Procedia-Social and Behavioral Sciences, 18, 154–162. https://doi.org/https://doi.org/10.1016/j.sbspro.2011.05.023

Hadie, S. N. H., Kasim, F., Mohd Ismail, Z. I., Asari, M. A., Mohd Yusof, N. A., Simok, A. A., Shamsuddin, S. A., & Mohd Amin, M. S. I. (2022). Multiple Mini Viva as an Online Assessment Tool for Postgraduate Anatomy Programme: The USM’s Experience Amidst COVID-19 Pandemic. Education in Medicine Journal, 14(4), 99–112. https://doi.org/10.21315/eimj2022.14.4.9

Handrianto, C., Solfema, S., & Jusoh, A. J. (2025). Cultural Adaptation and Academic Success: Exploring the Experiences of Indonesian Students in Malaysian Universities. Journal of Ethnic and Cultural Studies, 12(3), 251–280. https://doi.org/10.29333/ejecs/2496

Harden, R. M. (2007). Outcome-Based Education: The Future Is Today. Medical Teacher, 29(7), 625–629. https://doi.org/10.1080/01421590701729930

Johnson, K. (2017). An introduction to foreign language learning and teaching. Routledge.

Joseph, J., Jose, J., Jose, A. S., Ettaniyil, G. G., Cyriac, J., Sebastian, S. K., & Joseph, A. P. (2024). Quantitative Insights Into Outcome-Based Education: A Bibliometric Exploration. Int. J. Eval. Res. Educ, 13(6), 4030–4045. https://doi.org/10.11591/ijere.v13i6.29272

Kolb, D. A., Boyatzis, R. E., & Mainemelis, C. (2014). Experiential Learning Theory: Previous Research And New Directions. In Perspectives on Thinking, Learning, and Cognitive Styles. https://doi.org/10.4324/9781410605986-9

Lugay, C. I. P., Agustin, B. E., Codico, M. A. E., Tapis, C.-A. P., & Tolentino, E. (2020). A Design Of An Automated Assessment Process For The Outcomes-Based Education In The Industrial Engineering Department Of The Faculty Of Engineering At The University Of Santo Tomas. Journal of Physics: Conference Series, 1529(3), 032046. https://doi.org/10.1088/1742-6596/1529/3/032046

Mitra, G., & Wadegaonkar, A. (2024). Multidimensional Holistic Assessment Framework (HAF): A Case Study of Exploring the Discourses from Elementary School Teachers. International Electronic Journal of Elementary Education, 17(1), 51–69. https://doi.org/10.26822/iejee.2024.363

Muhammad Samin, S., Akzam, I., Pebrian, R., & Fikriansyah, M. H. (2025). Tantangan dan Strategi Penerapan Lingkungan Bahasa Arab di Pesantren [Challenges and Strategies for Implementing Arabic Language Environment in Pesantren]. Al-Hikmah: Jurnal Agama Dan Ilmu Pengetahuan, 22(1), 42–55. https://doi.org/10.25299/ajaip.2025.vol22(1).21006

Munzenmaier, C., & Rubin, W. N. (2013). Perspectives Bloom’s Taxonomy: What’s Old Is New Again. In C. Holcombe (Ed.), Educational Objectives. The elearning Guild. https://publicservicesalliance.org/wp-content/uploads/2013/04/guildresearch_blooms2013.pdf

Petrušić, I. (2023). Student-Centred Learning in the Context of External Quality Assurance. Medicina Fluminensis, 59(4). https://doi.org/10.21860/medflum2023_309615

Qiao, Y., & Fu, H. (2022). Study on OBE Teaching Concept In The Context Of Deep Learning For The Construction Of University Mathematics Microcourses. Computational Intelligence and Neuroscience, 2022(1), 6860842. https://doi.org/10.1155/2022/1234567

Samin, S. M. (2019). Heutagogy In Arabic Class: How It Is Applied in The Islamic Education Study Program of Universitas Islam Riau. Journal of Arabic Linguistics and Education, 5(1), 20–29. https://doi.org/10.28918/alsinatuna.v5i1.2092

Samin, S. M., Akzam, I., & Supriady, H. (2022). Strategies of Arabic Students’ Self-Regulated Learning Improvement in Language Proficiency in The Disruption Era. Jurnal Pendidikan Bahasa Arab Dan Kebahasaaraban, 9(2), 165–177. https://doi.org/10.15408/a.v9i2.22828

Samin, S. M., & Hikmah, H. (2021). Self-Regulated Learning Of Arabic Education Students Via Moodle Discussion Forum. Journal of Arabic Linguistics and Education, 7(1), 17–29. https://tinyurl.com/yyms4ts9.

Samin, S. M., & Osman, R. A. (2024). Integrating Artificial Intelligence into the Arabic Language Teaching Plan at Higher Education. SHS Web of Conferences, 202, 06010. https://doi.org/10.1051/shsconf/202420206010

Samin, S. M., Pebrian, R., & Zulkifli, A. (2020). Heutagogy Approaches for Arabic Learning in Higher Education in Industrial Revolution 4.0. ICoSEEH 2019, 454–457. https://doi.org/10.5220/0009382304540457

Samin, S. M., Zakaria, G. A. N., & Pebrian, R. (2025). Outcome-Based Arabic Language Education: Leveraging Learning Analytics for Graduate Success. Arabiyat : Jurnal Pendidikan Bahasa Arab Dan Kebahasaaraban, 12(2), 243–259. https://doi.org/10.15408/a.v12i2.46603

Samin, S. M., Zulkifli, A., & Supriady, H. (2023). Concepts of Informal Arabic Language Environment for Higher Education. Al-Hikmah: Jurnal Agama Dan Ilmu Pengetahuan, 20(1), 28–38. https://doi.org/https://doi.org/10.25299/al-hikmah:jaip.2023.vol20(1).12026

Scriven, M. (1972). Objectivity and Subjectivity In Educational Research. Teachers College Record, 73(5), 94–142. https://doi.org/10.1177/01614681720730050

Spady, W. G. (1994). Outcome-Based Education: Critical Issues and Answers. ERIC. https://files.eric.ed.gov/fulltext/ED380910.pdf

Telukdarie, A., & Munsamy, M. (2019). Digitization of Higher Education Institutions. 2019 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 716–721.

Theodoridou, S. (2021). The Importance Of Student-Centered Learning In The Development Of Critical Thinking (full text in Greek). Academia, 23–24, 226–245.

Thompson, A. S., & Asanov, E. (2024). “Nonnative? Next!” Native-speakerism in world language job advertisements. Studies in Second Language Learning and Teaching, 14(1), 49–74. https://doi.org/10.14746/ssllt.42371

Yadav, P., Tomar, A., Soni, R., Dubey, G., Bhargava, C. P., & Kumari, J. (2024). Metrics With Performance Indicators Used For Calculating the Mapping Strength of Course Outcome With Program Outcome. Journal of Engineering Education Transformations, 85–95. https://doi.org/10.16920/jeet/2024/v38i2/24192

Youker, B. W. (2013). Goal-free evaluation: A Potential Model For The Evaluation Of Social Work Programs. Social Work Research, 37(4), 432–438. https://doi.org/10.1093/swr/svt032

Yusri, S. A., & Muhammad Samin, S. (2024). The Effectiveness Of Group Learning In Improving Students’Arabic Speaking proficiency. Perspektif Pendidikan Dan Keguruan, 15(1), 67–72. https://doi.org/10.25299/perspektif.2024.vol15(1).15852

Zhang, Z., & Wang, W. (2024). Enhancing Dance Education Through Convolutional Neural Networks And Blended Learning. PeerJ Computer Science, 10. https://doi.org/10.7717/peerj-cs.2342

Zlatkin-Troitschanskaia, O., Shavelson, R. J., Schmidt, S., & Beck, K. (2019). On The Complementarity Of Holistic And Analytic Approaches To Performance assessment scoring. British Journal of Educational Psychology, 89(3), 468–484. https://doi.org/10.1111/bjep.12286




DOI: https://doi.org/10.18860/ijazarabi.v9i1.36779

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 saproni muhammad samin, Azhar Jaafar, Harif Supriady, Rojja Pebrian, Alfitri Zulkifli, Yenni Yunita

License URL: https://creativecommons.org/licenses/by-sa/4.0/