Bricks to Clicks: Students’ Engagement in E-Learning during the COVID-19 Pandemic
Main Article Content
Abstract
The COVID-19 pandemic has forced higher education institutions to execute mitigation efforts such as an e-learning mode of instruction to reduce the impact on pedagogical activities. These challenges have raised concerns on students’ engagement in e-learning as students are at risk of falling behind in education. However, there is little empirical research focusing on students’ engagement in e-learning experiences. The purpose of this study is to investigate students’ engagement in e-learning as well as specifically assess their engagement based on gender, age, ethnicity, level of education and field of study in a Malaysian public higher education institution. This study used a non-experimental quantitative research design. Data were collected from a sample of 281 students using the Blended Learning Engagement Questionnaire©. WINSTEPS Rasch model measurement software was used to determine the reliability and validity of the research instrument. Subsequently, Differential item functioning (DIF) was conducted to assess students’ engagement in e-learning as well as specifically assessing student’s demographic factors such as gender, age, ethnicity, level of education and field of study. Findings indicate students have high levels of behavioural engagement as compared with cognitive and emotional engagement in e-learning. Further analysis indicated there were differences in students’ engagement based on demographic factors such as gender, age, and field of study. This study provides insight into students’ engagement in e-learning that will help lecturers to reflect on their own teaching practices. Implications and recommendations for future research are presented.
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Adams, D., & Dewitt, D. (2021). Innovative practices of technology-enhanced learning. Universiti Pendidikan Sultan Idris.
Adams, D., Chuah, K. M., Sumintono, B., & Mohamed, A. (2021). Students’ readiness for e-learning during the COVID-19 pandemic in a South-East Asian university: A Rasch analysis. Asian Education and Development Studies. https://doi.org/10.1108/AEDS-05-2020-0100
Adams, D., Sumintono, B., Mohamed, A., & Mohamad Noor, N. S. (2018). E-learning readiness among students of diverse backgrounds in a leading Malaysian higher education institution. Malaysian Journal of Learning and Instruction, 15(2), 227–256.
Adams, D., Tan, M. H. J., & Sumintono, B. (2020). Students’ readiness for blended learning in a leading Malaysian private higher education institution. Interactive Technology and Smart Education. https://doi.org/10.1108/ITSE-03-2020-0032
Adams, D., Tan, M. H. J., Sumintono, B., & Oh, S. P. (2020). Blended learning engagement in higher education institutions: A differential item functioning analysis of students’ backgrounds. Malaysian Journal of Learning and Instruction, 17(1), 133–158. https://doi.org/10.32890/mjli2020.17.1.6
Al?Qahtani, A. A., & Higgins, S. E. (2013). Effects of traditional, blended and e?learning on students’ achievement in higher education. Journal of Computer Assisted Learning, 29(3), 220–234. https://doi.org/10.1111/j.1365-2729.2012.00490.x
Almaiah, M. A., Al-Khasawneh, A., & Althunibat, A. (2020). Exploring the critical challenges and factors influencing the E-learning system usage during COVID-19 pandemic. Education and Information Technologies, 25, 5261–5280. https://doi.org/10.1007/s10639-020-10219-y
Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory, Measuring in the educational, social and health sciences. Springer.
Bazelais, P., & Doleck, T. (2018). Investigating the impact of blended learning on academic performance in a first semester college physics course. Journal of Computers in Education, 5(1), 67–94. https://doi.org/10.1007/s40692-018-0099-8
Beth, A. D., Jordan, M. E., Schallert, D. L., Reed, J. H., & Kim, M. (2015). Responsibility and generativity in online learning communities. Interactive Learning Environments, 23(4), 471– 484. https://doi.org/10.1080/10494820.2013.788035
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer. Boone, W. J., & Staver, J. R. (2020). Advances in Rasch analyses in the human sciences. Springer.
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019). Effects of the flipped classroom instructional strategy on students’ learning outcomes: A meta-analysis. Educational Technology Research and Development, 67, 793–824. https://doi.org/10.1007/s11423-018-9633-7
Chuah, K. M., & Mohamad, F. (2020). Emergency remote teaching scenarios, struggles and soundboxes: A case study on Malaysian teachers. Interaction Design and Architecture(s) Journal, 46(1), 13–28.
Coman, C., ?îru, L. G., Mese?an-Schmitz, L., Stanciu, C., & Bularca, M. C. (2020). Online teaching and learning in higher education during the coronavirus pandemic: Students’ perspective. Sustainability, 12(24), 1–22. https://doi.org/10.3390/su122410367
Engelhard, G., & Wind, S. (2018). Invariant measurement with raters and rating scales. Routledge.
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Fisher, R., Perényi, Á., & Birdthistle, N. (2021). The positive relationship between flipped and blended learning and student engagement, performance and satisfaction. Active Learning in Higher Education, 22(2), 97–113. https://doi.org/10.1177/1469787418801702
Fisher, W. P. Jr. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1), 1095.
Furlong, M. J., Whipple, A. D., St. Jean, G., Simental, J., Soliz, A., & Punthuna, S. (2003). Multiple contexts of school engagement: Moving toward a unifying framework for educational research and practice. The California School Psychologist, 8(1), 99–113. https://doi.org/10.1007/BF03340899
Graham, C. R. (2013). Emerging practice and research in blended learning. In M. G. Moore (Ed.), Handbook of distance education (pp. 333–350). Routledge.
Han, F., Pardo, A., & Ellis, R. A. (2020). Students’ self?report and observed learning orientations in blended university course design: How are they related to each other and to academic performance? Journal of Computer Assisted Learning, 36(6), 969–980. https://doi.org/10.1111/jcal.12453
Heilporn, G., Lakhal, S., & Bélisle, M. (2021). An examination of teachers’ strategies to foster student engagement in blended learning in higher education. International Journal of Educational Technology in Higher Education, 18(1), 1–25. https://doi.org/10.1186/s41239-021-00260-3
Hu, M., & Li, H. (2017). Student engagement in online learning: A review. In 2017 International Symposium on Educational Technology (ISET) (pp. 39–43). IEEE.
Jie, S. S., & Fernandez, D. F. M. F. (2021). Factors influencing student’s behavioural intention towards the use of e-learning during Covid-19 in Malaysia. Research in Management of Technology and Business, 2(2), 952–964.
Lane, S., Hoang, J. G., Leighton, J. P., & Rissanen, A. (2021). Engagement and satisfaction: Mixed-method analysis of blended learning in the sciences. Canadian Journal of Science, Mathematics and Technology Education, 21(1), 100–122. https://doi.org/10.1007/s42330 -021-00139-5
Li, K. C., & Lam, H. K. (2015). Student engagement in a technology-mediated distance learning course. International Journal of Services and Standards, 10(4), 172–191. https://doi.org/10.1504/IJSS.2015.072445
Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3, 103–122.
Linacre, J. M. (2013). A user’s guide to Winsteps Ministeps Rasch-model computer programs. http://www.winsteps.com/index.htm
Lizcano, D., Lara, J. A., White, B., & Aljawarneh, S. (2020). Blockchain-based approach to create a model of trust in open and ubiquitous higher education. Journal of Computing in Higher Education, 32, 109–134. https://doi.org/10.1007/s12528-019-09209-y
Ma, J., Han, X., Yang, J., & Cheng, J. (2015). Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor. Internet and Higher Education, 24, 26–34. https://doi.org/10.1016/j.iheduc.2014.09.005
Maatuk, A. M., Elberkawi, E. K., Aljawarneh, S., Rashaideh, H., & Alharbi, H. (2021). The COVID-19 pandemic and E-learning: Challenges and opportunities from the perspective of students and instructors. Journal of Computing in Higher Education. https://doi.org/10.1007/2Fs12528-021-09274-2
Martin, F., & Bolliger, D. U. (2018). Engagement matters: Student perceptions on the importance of engagement strategies in the online learning environment. Online Learning Journal, 22(1), 205–222. https://doi.org/10.24059/olj.v22i1.1092
Matheos, K., & Cleveland-Innes, M. (2018). Blended learning: Enabling higher education reform. Revista Eletrônica de Educação, 12(1), 238–244.
Miller, R. (2018). Transforming the future: Anticipation in the 21st century. Taylor & Francis.
Mpungose, C. B. (2020). Emergent transition from face-to-face to online learning in a South African University in the context of the Coronavirus pandemic. Humanities and Social Sciences Communications, 7(1), 1–9.
Nguyen, Q., Rienties, B., & Richardson, J. T. E. (2020). Learning analytics to uncover inequality in behavioural engagement and academic attainment in a distance learning setting. Assessment and Evaluation in Higher Education, 45(4), 594–606. https://doi.org/10.1080/02602938.2019.1679088
Osman, Z., Mohamad, W., Mohamad, R. K., Mohamad, L., & Sulaiman, T. F. T. (2018). Enhancing students’ academic performance in Malaysian online distance learning institutions. Asia Pacific Journal of Educators and Education, 33, 19–28. https://doi.org/10.21315/apjee2018.33.2
O?adowicz, A. (2020). Modified blended learning in engineering higher education during the COVID-19 lockdown—Building automation courses case study. Education Sciences, 10(10), 292.
Rapanta, C., Botturi, L., Goodyear, P., Guardia, L. and Koole, M. (2020), Online university teaching during and after the Covid-19 crisis: Refocusing teacher presence and learning activity. Postdigital Science and Education, 2(3), 923–945.
Rasheed, R. A., Kamsin, A., & Abdullah, N. A. (2020). Challenges in the online component of blended learning: A systematic review. Computers & Education, 144, 103701. https://doi.org/10.1016/j.compedu.2019.103701
Rasouli, A., Rahbania, Z., & Attaran, M. (2016). Students’ readiness for e-learning application in higher education. Malaysian Online Journal of Educational Technology, 4(3), 51–64.
Roman, M., & Plopeanu, A. P. (2021). The effectiveness of the emergency eLearning during COVID-19 pandemic: The case of higher education in economics in Romania. International Review of Economics Education, 37, 100218. https://doi.org/10.1016/j.iree.2021.100218
Schunk, D. H., & Mullen, C. A. (2012). Self-efficacy as an engaged learner. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 219–235). Springer. https://doi.org/10.1007/978-1-4614-2018-7
Sukumaran, S., Shahid, N. S. M., Abdullah, N., & Thiagarajah, S. (2021). E-learning of STEM in Malaysian higher education institutions: Status and challenges. Asian Journal of University Education, 17(4), 259–271.
Tao, Z., Zhang, B., & Lai, I. K. W. (2018) Perceived online learning environment and students’ learning performance in higher education: Mediating role of student engagement (Vol. 843, pp. 56–64). Springer Verlag.
Tang, Y. M., Chen, P. C., Law, K. M., Wu, C. H., Lau, Y. Y., Guan, J., He, D., & Ho, G. T. (2021). Comparative analysis of Student’s live online learning readiness during the coronavirus (COVID-19) pandemic in the higher education sector. Computers & Education, 168, 104211. https://doi.org/10.1016/j.compedu.2021.104211
Van Zile-Tamsen, C. (2017). Using Rasch analysis to inform rating scale development. Research in Higher Education, 58(8), 922–933.
Vavasseur, A., Muscari, F., Meyrignac, O., Nodot, M., Dedouit, F., Revel-Mouroz, P., Dercle, L., Rozenblum, L., Wang, L., Maulat, C., Rousseau, H., Otal, P., Dercle, L., & Mokrane, F. Z. (2020). Blended learning of radiology improves medical students’ performance, satisfaction, and engagement. Insights into Imaging, 11, 1–12. https://doi.org/10.1186/s13244-020-00865-8
Wang, H. Y., Sigerson, L., & Cheng, C. (2019). Digital nativity and information technology addiction: Age cohort versus individual difference approaches. Computers in Human Behavior, 90, 1–9.
Widhiarso, W., & Sumintono, B. (2016). Examining response aberrance as a cause of outliers in statistical analysis. Personality and Individual Differences, 98, 11–15.
Win, N. L., & Wynn, S. D. (2015). Introducing blended learning practices in our classrooms. Journal of Institutional Research Southeast Asia, 13(2), 17–27.
Yang, N. (2020). eLearning for quality teaching in higher education: Teachers’ perception, practice, and interventions. Springer Nature.
Yu, Z. (2021). The effects of gender, educational level, and personality on online learning outcomes during the COVID-19 pandemic. International Journal of Educational Technology in Higher Education, 18(1), 14. https://doi.org/10.1186/s41239-021-00252-3