.jpg)
Evaluation of Islamic Religious Education Learning on SKI Material: Development of HOTS Instrument in Senior High School
Abstract
Learning of Islamic Religious Education (PAI) on the subject of Islamic Cultural History (SKI) is still dominated by conventional methods and evaluation that has not been oriented toward Higher Order Thinking Skills (HOTS), resulting in students’ critical thinking skills not developing optimally. This study aims to develop and validate a Higher Order Thinking Skills (HOTS)-based assessment instrument for the Islamic Cultural History (SKI) subject at the eleventh-grade level of senior high school. The research employed a Research and Development (R&D) approach using a modified 4D model consisting of define, design, and develop stages. The instrument comprised 30 multiple-choice items measuring cognitive levels C4, C5, and C6 based on the revised Bloom’s taxonomy. Content validity was analyzed using Aiken’s V, while reliability, item difficulty, and discrimination were examined using the Rasch model through QUEST program software. The results showed a very high content validity index (Aiken’s V = 0.88) and excellent reliability (0.91). Rasch analysis indicated that most items fit the model (INFIT MNSQ 0.77–1.33), with a balanced distribution of item difficulty and very good discrimination indices. Three items were identified as misfit and subsequently revised to maintain the composition of 30 HOTS-based items. This study contributes to the development of a psychometrically tested HOTS assessment instrument for Islamic Religious Education, integrating Rasch modeling to ensure objectivity and measurement precision. The instrument provides a more robust and theoretically grounded evaluation tool compared to previous studies that relied on classical test analysis or did not fully integrate HOTS constructs.
Keywords
Full Text:
DOWNLOAD [PDF]References
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/doi.org/10.1177/0013164485451012
Alvionita, D., Subchan, W., & Iqbal, M. (2020). The development of ecosystem education game based on Baluran National Park for senior high The development of ecosystem education game based on Baluran National Park for senior high school. Journal of Physics: Conference Series, 1465(1). https://doi.org/10.1088/1742-6596/1465/1/012039
Arif, M., & Aziz, M. K. N. A. (2023). Islamic Religious Education Learning Model in the 21. Indonesian Journal of Islamic Education Studies (IJIES), 6(2), 237–262. https://doi.org/10.33367/ijies.v6i2.4417
Assalihee, M., Bakoh, N., Boonsuk, Y., & Songmuang, J. (2024). Transforming Islamic Education through Lesson Study (LS): A Classroom-Based Approach to Professional Development in Southern Thailand. Education Sciences, 14(9). https://doi.org/10.3390/educsci14091029
Badriyah, L., Yorman, & Wardi, M. (2025). Policy analysis of Islamic educational institutions in facing the challenges of society 5.0: Innovation, learning, and technology-based infrastructure. Multidisciplinary Reviews, 9(1), 1–10. https://doi.org/10.31893/multirev.2026012
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer. https://doi.org/10.1007/978-94-007-6857-4
Dewi, Y., In’ami, M., Audia’, A., & Masrukhin. (2023). Assessment Based on Higher Order Thinking Skill on SKI Learning. AL-ISHLAH: Jurnal Pendidikan, 15(1), 443–458. https://doi.org/10.35445/alishlah.v15i1.2586
Hagquist, C., & Andrich, D. (2017). Recent advances in analysis of differential item functioning in health research using the Rasch model. Health and Quality of Life Outcomes, 1–8. https://doi.org/10.1186/s12955-017-0755-0
Hamdi, S., Wahdah, N., Ahmadi, & Musthofa, K. (2022). The Problem Of Implementation Of Islamic Education Curriculum In The Aspect Of Moderation Learning And Hots Evaluation. EDURELIGIA: Jurnal Pendidikan Agama Islam, 06(01), 21–36. https://doi.org/10.33650/edureligia.v6i1.3620
Hussien, S., Wahab, M. K. A., & Hashim, R. (2021). Improving Students’ Inquiry Skills in Islamic Education Through Hikmah Pedagogy and Community of Inquiry. Malaysian Journal of Learning and Instruction, 18(2), 189–214. https://doi.org/10.32890/mjli2021.18.2.7
Jima’ain, M. T. A., Mohamed, A. M., Hehsan, A., Saidalvi, A., Nasi, B. M., Faisal, M. S., & Awae, F. (2024). Embedding higher order thinking skills in Islamic history (Sirah) education in Malaysia. International Journal of Evaluation and Research in Education , 13(2), 952–959. https://doi.org/10.11591/ijere.v13i2.26431
Karwadi, K., Zakaria, A. R., & Syafii, A. (2024). A review of the effects of active learning on high order thinking skills: a meta-analysis within islamic education. Journal of Education and Learning, 18(1), 97–106. https://doi.org/10.11591/edulearn.v18i1.20895
Kimberlin, C. l., & Winterstein, almut G. (2008). Validity and reliability of measurement instruments used in research. American Society of Health-Systems Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364
Kosasih, A., Supriyadi, T., Firmansyah, M. I., & Rahminawati, N. (2022). Higher-Order Thinking Skills in Primary School: Teachers’ Perceptions of Islamic Education. Journal of Ethnic and Cultural Studies, 9(1), 56–76. https://doi.org/10.29333/ejecs/994
Makmur, F., Retnawati, H., & Arliani, E. (2025). Development and evaluation of cognitive test instruments of sequence and series topic grade XI: The Rasch Model. AIP Conference Proceedings, 3285(1). https://doi.org/10.1063/5.0262927
Mazidah, R., Romadlon, D. A., & Astutik, A. P. (2023). The Application of the Snowball Throwing Learning Model Based on HOTS Questions in Improving Islamic Religious Education Learning Outcomes at Junior High School. Scaffolding: Jurnal Pendidikan Islam Dan Multikulturalisme, 5(1), 234–250. https://doi.org/10.37680/scaffolding.v5i1.2086
Nasucha, M. R., Khozin, K., & Thoifah, I. (2023). Synergizing Islamic Religious Education and Scientific Learning in the 21st Century: A Systematic Review of Literature. Jurnal Pendidikan Agama Islam (Journal of Islamic Education Studies), 11(1), 109–130. https://doi.org/10.15642/jpai.2023.11.1.109-130
Pratama, D. N., Pratiwi, O. N., & Sutoyo, E. (2021). Classification of Questions Based on Difficulty Levels using Support Vector Machine and Naïve Bayes Algorithms for Imbalanced Class. Institute of Electrical and Electronics Engineers Inc, 40–45. https://doi.org/10.1109/IC2IE53219.2021.9649149
Reksiana, Nata, A., Rosyada, D., Rahiem, M., Dinia, H., Rafikjon, U., & Abdulbosit, R. (2024). Digital Extension of Digital Literacy Competence for Islamic Religious Education Teachers in the Era of Digital Learning. Jurnal Pendidikan Agama Islam, 21(2), 402–420. https://doi.org/10.14421/jpai.v21i2.9719
Reynolds, C. R., Livingston, R. B., & Willson, V. (2009). Measurement and Assessment in Education (2nd ed.). Pearson Education.
Sa’idah, N., & Isnaini, I. K. (2020). Development of Higher Order Thinking Skill (HOTS) Test Instruments for Fiqh Subjects in Grade XI at MA Masalikil Huda Tahunan Jepara. Al-Tadzkiyyah: Jurnal Pendidikan Islam, 11(2), 209–220. https://doi.org/10.24042/atjpi.v11i2.6889
Shimada, D., & Katahira, K. (2023). Sequential dependencies of responses in a questionnaire survey and their effects on the reliability and validity of measurement. Behavior Research Methods, 55Pratama,(6), 3241–3259. https://doi.org/10.3758/s13428-022-01943-z
Suntiah, R. (2021). Students’ Critical Thinking Skills in the Reflective Class of Islamic Cultural History. Jurnal Pendidikan Islam, 7(2), 195–204. https://doi.org/10.15575/jpi.v7i2.15060
Sutiyono, A. (2022). Developing the Instrument of Fikih Assessment in Madrasah Aliyah. Nadwa: Jurnal Pendidikan Islam, 16(1), 104–122. https://doi.org/10.21580/nw.2022.16.1.15384
Tabroni, I., Susana, S., Mulyadi, A., & Zaelani, N. (2022). Utilization of the Discovery Learning Model to Overcome Islamic Cultural History Learning Problems in Madrasa. Indonesian Journal of Islamic Education Studies (IJIES), 5(1), 81–94. https://doi.org/10.33367/ijies.v5i1.2409
Tesio, L., Caronni, A., Kumbhare, D., & Scarano, S. (2024). Interpreting results from Rasch analysis 1 . The “ most likely ” measures coming from the model. Disability and Rehabilitation, 46(3), 591–603. https://doi.org/10.1080/09638288.2023.2169771
Zijlmans, E. A. O., Tijmstra, J., & Sijtsma, K. (2017). Item-Score Reliability in Empirical-Data Sets and Its Relationship With Other Item Indices. Educational and Psychological Measurement, 1–23. https://doi.org/10.1177/0013164417728358
DOI: https://doi.org/10.31764/ijeca.v9i2.38225
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Bayu Lesmana, Risnita, Dedi Sastradika, Sri Ramdayeni Sakunti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
IJECA (International Journal of Education and Curriculum Application) already indexed:
___________________________________________________________________
| |
____________________________________________________________________
IJECA Publisher Office: