Wikalah iBT: How Is An Internet-Based Arabic Language Proficiency Test Instrument Developed?

Syihabuddin Syihabuddin, Maman Abdurrahman, Frida Akmalia, Aam Abdussalam

Abstract


This study discusses the development of 140 items of Arabic language proficiency test which covers listening, reading, and grammar mastery. These items were empirically analyzed, tried out, and revised. Results of this development would then be made a basis to design an application that can evaluate internet-based Arabic language proficiency (Internet-based Taqwim Kafa`ah Maharah Lughah Arabiyah) abbreviated as Wikalah iBT. To achieve this goal, a developmental research method was employed, namely the development of instruments starting from the needs analysis for tests, the making of instruments, validity and reliability testing, the design of iBT program, and the trial of the Wikalah iBT application. Results of the study show that (a) several test items still had morphological, morphosyntactic, and technical errors, (b) 81 test items were valid, (c) average reliability level was 0.67, (d) this test was in the medium and easy categories (63.57), and (e) the iBT application design was used successfully and ran smoothly. Based on the conclusions, it is recommended to add the test item package, improve the quality of the questions, and evaluate the iBT application. We believe that these findings provide initial support for  making an overview to those preparing for the  iBT test or other similar tests of  language proficiency. Study outcomes also inform the extent to which the use of technology can evaluate language proficiency


Keywords


Arabic Proficiency Test; Evaluation; iBT

Full Text:

PDF

References


Ali, M. (1982). Penelitian Kependidikan Prosedur dan Strategi. (Bandung: Angkasa Bandung).

An-Naqoh, M.K. (1985). Ta’limul Lughah al-Arabiyah Linnathiqina Bilughatiin Ukhra. Al-Mamlakah al-Arabiyah as-Saúdiyah: Jamiáh Ummul Qura.

Azmi, A. M., Al-Jouie, M. F., & Hussain, M. (2019). AAEE–Automated evaluation of students’ essays in Arabic language. Information Processing & Management, 56(5), 1736-1752. https://doi.org/10.1016/j.ipm.2019.05.008

Bahari, A. (2020). Computer-assisted language proficiency assessment tools and strategies. Open Learning: The Journal of Open, Distance and e-Learning, 1–27. https://doi.org/10.1080/02680513.2020.1726738

Barnes, M. (2016). The washback of the TOEFL iBT in Vietnam. Australian Journal of Teacher Education, 41(7), 158-174. https://doi.org/10.14221/ajte.2016v41n7.10

Culbertson, G., Andersen, E., & Christiansen, M. H. (2020). Using Utterance Recall to Assess Second Language Proficiency. Language Learning, 70(S2), 104-132. https://doi.org/10.1111/lang.12399

De Graaf, A. (2021). Challenges in Developing Standardized Tests for Arabic Reading Comprehension for Secondary Education in the Netherlands. Challenges in Language Testing Around the World: Insights for language test users, 181.

Dimova, S., & Kling, J. (2018). Assessing English‐medium instruction lecturer language proficiency across disciplines. TESOL Quarterly, 52(3), 634-656. https://doi.org/10.1002/tesq.454

Fleckenstein, J., Keller, S., Krüger, M., Tannenbaum, R. J., & Köller, O. (2020). Linking TOEFL iBT® writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study. Assessing Writing, 43, 1-15. https://doi.org/10.1016/j.asw.2019.100420

Frost, K., Clothier, J., Huisman, A., & Wigglesworth, G. (2020). Responding to a TOEFL iBT integrated speaking task: Mapping task demands and test takers’ use of stimulus content. Language Testing, 37(1), 133-155. https://doi.org/10.1177/0265532219860750

Ginther, A., & Yan, X. (2018). Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, policy, and profiles. Language Testing, 35(2), 271-295. https://doi.org/10.1177/0265532217704010

Gu, L., Davis, L., Tao, J., & Zechner, K. (2021). Using spoken language technology for generating feedback to prepare for the TOEFL iBT® test: a user perception study. Assessment in Education: Principles, Policy & Practice, 28(1), 58-76. https://doi.org/10.1080/0969594X.2020.1735995

Harsch, C., Ushioda, E., & Ladroue, C. (2017). Investigating the predictive validity of TOEFL iBT® test scores and their use in informing policy in a United Kingdom university setting. ETS Research Report Series, 2017(1), 1-80. https://doi.org/10.1002/ets2.12167

Hasib, A. (2004). Maharatut Ta’limil Qira`ah wal Kitabah Lil athfal. Amman: Dar Waìl Liththibaáh Wannasyr.

Karjo, C. H., & Ronaldo, D. (2019). The validity of TOEFL as entry and exit college requirements: Students’ perception. In Eleventh Conference on Applied Linguistics (CONAPLIN 2018) (pp. 326-330). Atlantis Press. https://doi.org/10.2991/conaplin-18.2019.277

Kim, E. Y. J. (2017). The TOEFL iBT writing: Korean students’ perceptions of the TOEFL iBT writing test. Assessing Writing, 33, 1-11. https://doi.org/10.1016/j.asw.2017.02.001

Kotby MN, Khairy A, Barakah M, Rifaie N, Elshobary A (1995) Language testing of Arabic speaking children: proceedings of XXIII world congress of the international Association of Logopedics and Phoniatrics. Ain Shams University, Cairo.

Loomis, S. (2015). Using speaking test data to define the advanced proficiency level for L2 Arabic speakers. Foreign Language Annals, 48(4), 604-617. https://doi.org/10.1111/flan.12167

Madkur, A.A. (2000). Tadris Fununul Lughah al-Árabiyyah. Cairo: Dar El Fikr al-Arabi.

Mousavi, S.A., Saleh Arizavi, & Namdar, Namdari. (2014). The effect of test preparation on the test performance: The case of the IELTS and TOEFL iBT reading tests. International Journal of English and Education, 3(2), 10-22.

Neumann, H., Padden, N., & McDonough, K. (2019). Beyond English language proficiency scores: Understanding the academic performance of international undergraduate students during the first year of study. Higher Education Research & Development, 38(2), 324-338. https://doi.org/10.1080/07294360.2018.1522621

Papageorgiou, S., & Manna, V. F. (2021). Maintaining access to a large-scale test of academic language proficiency during the pandemic: The launch of TOEFL iBT Home Edition. Language Assessment Quarterly, 18(1), 36-41. https://doi.org/10.1080/15434303.2020.1864376

Peng Y, Yan W, Cheng L. (2021). Hanyu Shuiping Kaoshi (HSK): A multi-level, multi-purpose proficiency test. Language Testing, 38(2), 326-337. https://doi.org/10.1177/0265532220957298.

Rifaie N (1994) The construction of an Arabic test to evaluate child language: MD thesis submitted to phoniatric unit. Ain Shams University, Cairo.

Roud, L. F. P., & Hidri, S. (2021). Toward a sociocultural approach to computerized dynamic assessment of the TOEFL iBT listening comprehension test. Education and Information Technologies, 1-26. https://doi.org/10.1007/s10639-021-10498-z

Sudjana, N. (1997). Tuntunan Penyusunan Karya Ilmiah, Makalah, Skripsi, Tesis, Desertasi. (Bandung : Sinar Baru Algensindo).

Sudjana, N. and Ibrahim. (1989). Penelitian dan Penelitian Pendidikan, (Bandung : Sinar Baru).

Sukmadinata, N. S. (2002). Metode Penelitian Pendidikan. (Bandung: Rosda Karya).

Surakhmad, W. (1998). Pengantar Penelitian Ilmiah Dasar Metode Tehnik, (Bandung: Transito).

Thu’aimah, R.A. (1985). Dalilu ‘Amalin fi I’dadil Mawad at-Ta’limiyyah Libaramiji Ta’limil Lughah. Makkah: Jami’ah Ummul Qura.

Thuáimah, R.A. (1989). Ta’limul Lughah Al-Arabiyyah Lighairin Nathiqina Biha wa Manahijihi, wa Asalibihi. Egypt: Mansyurat al-Islamiyyah Littarbiyah wal Úlum Watstsaqafah.

Ubaidat, D. (1984). Al-Bahts al-‘Ilmi. Amman: Darul Fikr.

Wang, Y., & Treffers-Daller, J. (2017). Explaining listening comprehension among L2 learners of English: The contribution of general language proficiency, vocabulary knowledge and metacognitive awareness. System, 65, 139-150. https://doi.org/10.1016/j.system.2016.12.013

Veronika, N., & Darnia, Y. (2015). Rancang bangun aplikasi tes TOEFL menggunakan algoritma quick sort berbasis computer (Designing TOEFL test application using computer-based algorithms quick sort). Jurnal Pseudocude, 2(2) 89-97.

Zubaidi, A. (2020). Development Of Mahârah Al-Istimâ’Test Instrument For Electronic Based Arabic Student Using The Kahoot! Application. Arabiyat: Jurnal Pendidikan Bahasa Arab dan Kebahasaaraban, 7(1), 61-77. https://doi.org/10.15408/a.v7i1.13002




DOI: https://doi.org/10.18860/ijazarabi.v4i3.12198

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Syihabuddin Syihabuddin, Maman Abdurrahman, Frida Akmalia, Aam Abdussalam

License URL: https://creativecommons.org/licenses/by-sa/4.0/