Analysis of Students' Satisfaction Level on iLearn Quality during COVID-19 Pandemic with WebQual 4.0 and PLS-SEM

Izzati Rahmi HG; Frilianda Wulandari; Dodi Devianto

doi:10.31764/jtam.v6i2.7440

Analysis of Students' Satisfaction Level on iLearn Quality during COVID-19 Pandemic with WebQual 4.0 and PLS-SEM

Izzati Rahmi HG, Frilianda Wulandari, Dodi Devianto

Abstract

Andalas University implements a Learning Management System (LMS) named iLearn as an online learning facility to carry out the learning process during the COVID-19 pandemic. This research analyzes the influence of iLearn quality on students' satisfaction levels. iLearn quality is measured by WebQual 4.0 instrument, which consists of three variables, i.e. Usability, Information Quality, and Service Interaction Quality. To analyze the relationship between the WebQual 4.0 variables and students' satisfaction, we used Partial Least Squares - Structural Equation Modeling (PLS-SEM) method. The research sample is 100 students of the Mathematics Department of Andalas University who were enrolled in iLearn. Based on data analysis, the structural equation model for the students' satisfaction level is obtained. From the model, the variables that significantly affect the Student Satisfaction Level are Usability and Service Interaction Quality, with a P-value of 0.001. In contrast, the Information Quality has a low significance in influencing students' satisfaction levels in iLearn quality with a P-value of 0.420. Improvements on iLearn quality can be made by reviewing these measured indicators.

Keywords

iLearn; PLS-SEM; Satisfaction Level; WebQual 4.0;

Full Text:

DOWNLOAD [PDF]

References

Akat, M., & Karataş, K. (2020). Psychological Effects of COVID-19 Pandemic on Society and Its Reflections on Education. Turkish Studies, 15(4), 1–13. https://doi.org/10.7827/TurkishStudies.44336

Alkhateeb, M. A., & Abdalla, R. A. (2021). Factors Influencing Student Satisfaction Towards Using Learning Management System Moodle. International Journal of Information and Communication Technology Education, 17(1), 138–153. https://doi.org/10.4018/IJICTE.2021010109

Alturise, F. (2020). Evaluation of Blackboard Learning Management System for Full Online Courses in Western Branch Colleges of Qassim University. International Journal of Emerging Technologies in Learning (IJET), 15(15), 33–51. https://doi.org/10.3991/ijet.v15i15.14199

Andry, J., Christianto, K., & Wilujeng, F. (2019). Using Webqual 4.0 and Importance Performance Analysis to Evaluate E-Commerce Website. Journal of Information Systems Engineering and Business Intelligence, 5(1), 23–31. https://doi.org/10.20473/jisebi.5.1.23-31

Arthur, Y. D. (2019a). Students Mathematics Interest in Senior High Schools: Empirical Evidence from Ashanti Region of Ghana. Asian Research Journal of Mathematics, 15(3), 1–14. https://doi.org/https://doi.org/10.9734/arjom/2019/v15i330147

Arthur, Y. D. (2019b). The Effect of Background on Students' Interest in Mathematics: The Mediation of Students' Motivation and Perception in Ghana. Asian Journal of Probability and Statistics, 5(3), 1–13. https://doi.org/https://doi.org/10.9734/ajpas/2019/v5i330135

Back, D. A., Behringer, F., Haberstroh, N., Ehlers, J. P., Sostmann, K., & Peters, H. (2016). Learning management system and e-learning tools: an experience of medical students' usage and expectations. International Journal of Medical Education, 7(1), 267–273. https://doi.org/10.5116/ijme.57a5.f0f5

Barnes, S. J., & Vidgen, R. (2003). Measuring Web site quality improvements: a case study of the forum on strategic management knowledge exchange. Industrial Management & Data Systems, 103(5), 297–309. https://doi.org/10.1108/02635570310477352

Blanco-Encomienda, F. J., & Rosillo-Díaz, E. (2021). Quantitative evaluation of the production and trends in research applying the structural equation modelling method. Scientometrics, 126(2), 1599–1617. https://doi.org/10.1007/s11192-020-03794-x

Buitrago R., R. E., Barbosa Camargo, M. I., & Cala Vitery, F. (2021). Emerging Economies' Institutional Quality and International Competitiveness: A PLS-SEM Approach. In Mathematics (Vol. 9, Issue 9). https://doi.org/10.3390/math9090928

Chakraborty, I., & Maity, P. (2020). COVID-19 outbreak: Migration, effects on society, global environment and prevention. Science of the Total Environment, 728. https://doi.org/10.1016/j.scitotenv.2020.138882

Chin, W., Cheah, J.-H., Liu, Y., Ting, H., Lim, X.-J., & Cham, T. H. (2020). Demystifying the role of causal-predictive modeling using partial least squares structural equation modeling in information systems research. Industrial Management & Data Systems, 120(12), 2161–2209. https://doi.org/10.1108/IMDS-10-2019-0529

Donie, R. S., Prihantoro, E., & Lestari, F. D. (2019). The Effect of Usability, Quality of Information, And Interaction Services Quality on User Satisfaction of DEPOK City Government Website Services Using WEBQUAL 4.0 Method. International Journal of Computer Science and Software Engineering (IJCSSE), 8(10), 234–241.

Effendy, F., Purwanti, E., & Akbar, R. F. (2021). Evaluation of E-learning: A case study of PsyCHE. AIP Conference Proceedings, 2329(1), 50018. https://doi.org/10.1063/5.0042126

F. Hair Jr, J., Sarstedt, M., Hopkins, L., & G. Kuppelwieser, V. (2014). Partial least squares structural equation modeling (PLS-SEM) : An emerging tool in business research. European Business Review, 26(2), 106–121. https://doi.org/10.1108/EBR-10-2013-0128

Fearnley, M. R., & Amora, J. T. (2020). Learning Management System Adoption in Higher Education Using the Extended Technology Acceptance Model. Journal of Education: Technology in Education, 8(2), 89–106.

Fernandes, N. (2020). Economic Effects of Coronavirus Outbreak (COVID-19) on the World Economy. https://doi.org/http://dx.doi.org/10.2139/ssrn.3557504

Findik-Coşkunçay, D., Alkiş, N., & Özkan-Yildirim, S. (2018). A Structural Model for Students' Adoption of Learning Management Systems. Journal of Educational Technology & Society, 21(2), 13–27. http://www.jstor.org/stable/26388376

Firdaus, M. B., Puspitasari, N., Budiman, E., Widians, J. A., & Bayti, N. (2019). Analysis of the Effect of Quality Mulawarman University Language Center websites on User Satisfaction Using the Webqual 4.0 Method. 2019 2nd International Conference on Applied Information Technology and Innovation (ICAITI), 126–132. https://doi.org/10.1109/ICAITI48442.2019.8982143

Hair, J. F., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). SAGE Publications. https://books.google.co.id/books?id=JDWmCwAAQBAJ

Hancock, G. R., & Mueller, R. O. (2013). Structural Equation Modeling: A Second Course (2nd ed.). Information Age Publishing, Incorporated. https://books.google.co.id/books?id=k2tjmgEACAAJ

Hwang, H., Sarstedt, M., Cheah, J. H., & Ringle, C. M. (2020). A concept analysis of methodological research on composite-based structural equation modeling: bridging PLSPM and GSCA. Behaviormetrika, 47(1), 219–241. https://doi.org/10.1007/s41237-019-00085-5

Khan, G. F., Sarstedt, M., Shiau, W.-L., Hair, J. F., Ringle, C. M., & Fritze, M. P. (2019). Methodological research on partial least squares structural equation modeling (PLS-SEM). Internet Research, 29(3), 407–429. https://doi.org/10.1108/IntR-12-2017-0509

Koh, J. H. L., & Kan, R. Y. P. (2020). Perceptions of learning management system quality, satisfaction, and usage: Differences among students of the arts. Australasian Journal of Educational Technology, 36(3), 26–40. https://doi.org/10.14742/ajet.5187

König, J., Jäger-Biela, D. J., & Glutsch, N. (2020). Adapting to online teaching during COVID-19 school closure: teacher education and teacher competence effects among early career teachers in Germany. European Journal of Teacher Education, 43(4), 608–622. https://doi.org/10.1080/02619768.2020.1809650

Lee, E.-Y., & Jeon, Y. J. (2020). The Difference of User Satisfaction and Net Benefit of a Mobile Learning Management System According to Self-Directed Learning: An Investigation of Cyber University Students in Hospitality. In Sustainability (Vol. 12, Issue 7, p. 2672). https://doi.org/10.3390/su12072672

Mardianto, M. F. F., Purwoko, C. F. F., Ira, Y., Pathorrasyid, Kuzairi, & Faisol. (2021). Influence Factors about the Compliance of Madurese Community related to COVID-19 Health Protocols based on Structural Equation Modeling-Partial Least Square (SEM-PLS). Turkish Journal of Computer and Mathematics Education, 12(13), 3998–4006.

Mohd Kasim, N. N., & Khalid, F. (2016). Choosing the Right Learning Management System (LMS) for the Higher Education Institution Context: A Systematic Review. International Journal of Emerging Technologies in Learning (IJET), 11(6), 55–61. https://doi.org/10.3991/ijet.v11i06.5644

Nugraha, R. A., Andriyanto, D., Riana, D., & Khasanah, S. N. (2020). Analysis of Factors Affecting Quality of corona.jatengprov.go.id Website Towards User Satisfaction using Webqual 4.0 Method. Journal of Physics: Conference Series, 1641. https://doi.org/10.1088/1742-6596/1641/1/012066

Ozili, P. K., & Arun, T. (2020). Spillover of COVID-19: Impact on the Global Economy. https://doi.org/http://dx.doi.org/10.2139/ssrn.3562570

Palos-Sanchez, P., Saura, J. R., & Ayestaran, R. (2021). An Exploratory Approach to the Adoption Process of Bitcoin by Business Executives. In Mathematics (Vol. 9, Issue 4, p. 355). https://doi.org/10.3390/math9040355

Rahmat, T., Nuryani, E., Siswanto, D., & Undang, G. (2021). ServQual and WebQual 4.0 for usability check academic information system of private university. Journal of Physics: Conference Series, 1869(1). https://doi.org/10.1088/1742-6596/1869/1/012097

Rismayani, & Soetikno, Y. J. W. (2020). Using WebQual 4.0 For Measuring Quality of E-learning Services During COVID-19 Pandemic. 2020 8th International Conference on Cyber and IT Service Management (CITSM), 1–7. https://doi.org/10.1109/CITSM50537.2020.9268887

Sarstedt, M., Ringle, C. M., & Hair, J. F. (2017). Partial Least Squares Structural Equation Modeling. In C. Homburg, M. Klarmann, & A. Vomberg (Eds.), Handbook of Market Research (pp. 1–40). Springer International Publishing. https://doi.org/10.1007/978-3-319-05542-8_15-1

Shiau, W.-L., Sarstedt, M., & Hair, J. F. (2019). Internet research using partial least squares structural equation modeling (PLS-SEM). Internet Research, 29(3), 398–406. https://doi.org/https://doi.org/10.1108/IntR-10-2018-0447

Sutisna, M., Prayogo, A. D., & Sarah, I. S. (2019). Evaluating Website Repeat Usage Using Webqual 4.0: a Guide for E-Commerce Business. IOP Conference Series: Materials Science and Engineering, 662(2). https://doi.org/10.1088/1757-899x/662/2/022105

Tee, K. N., Leong, K. E., & Abdul Rahim, S. S. (2021). A Self-Regulation Model of Mathematics Achievement for Eleventh-Grade Students. International Journal of Science and Mathematics Education, 19(3), 619–637. https://doi.org/10.1007/s10763-020-10076-8

Titiani, F., Erni, Riana, D., Budihartanti, C., Rahmatullah, S., & Tutupoly, T. A. (2020). Analysis of User Satisfaction on Corona.Jakarta.go.id Website: Use Webqual Method 4.0. Journal of Physics: Conference Series, 1641. https://doi.org/10.1088/1742-6596/1641/1/012015

Wang, B., Zheng, Q., Sun, A., Bao, J., & Wu, D. (2021). Spatio-Temporal Patterns of CO2 Emissions and Influencing Factors in China Using ESDA and PLS-SEM. In Mathematics (Vol. 9, Issue 21, p. 2711). https://doi.org/10.3390/math9212711

Wichadee, S. (2015). Factors Related to Faculty Members' Attitude and Adoption of a Learning Management System. The Turkish Online Journal of Educational Technology, 14(4), 53–61.

Zambrano-Monserrate, M. A., Ruano, M. A., & Sanchez-Alcalde, L. (2020). Indirect effects of COVID-19 on the environment. Science of the Total Environment, 728. https://doi.org/10.1016/j.scitotenv.2020.138813

DOI: https://doi.org/10.31764/jtam.v6i2.7440