Sustainable Online Education for Higher Education Institutions: A Systematic Literature Review
Main Article Content
Abstract
This systematic review article analysed and evaluated the current literature on sustainable educational technology in higher-education institutions (HEI). University stakeholders aspire to have any educational technologies employed be sustainable beyond short-term solutions. Identifying these sustainable factors requires reviews of recent studies, particularly with the insightful experience of the recent pandemic. Unfortunately, systematic reviews on sustainability were few and focused more on specific modalities. Hence, this present study reviewed past studies (published between 2015 and 2021) to identify the types of educational technology or modality being studied on the aspects of sustainability, the topic of interests that contribute to the challenges in online learning, and the themes and subthemes that are critical to the sustainable use of online education. Guided by the preferred reporting items for systematic reviews and metaanalyses (PRISMA) to review five journal databases (Scopus, ProQuest, Web of Science (WoS), Emerald and Google Scholar), 44 articles were analysed systematically. Four themes emerged from the analysis: technology related, teaching and learning, ethical aspects, and instructional support, as well as 12 subthemes. A conceptual framework was proposed, and other recommendations were discussed at the end of the paper for future research.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Aaron, G., Cabot, A. Z., Forlino, D., & Adoboe, S. S. (2022). It took a village: A demonstrated need of institutional support for successful online teaching. Dimension, 130, 145.
Abubakari, M. S., Nurkhamid, N., & Priyanto, P. (2022). Factors influencing online learning engagement: International students’ perspective and the role of institutional support. Turkish Online Journal of Distance Education, 23(3), 118–136. https://doi.org/10.17718/tojde.1137253
Aburbeian, A. M., Owda, A. Y., & Owda, M. (2022). A technology acceptance model survey of the metaverse prospects. AI, 3(2), 285–302. https://doi.org/10.3390/ai3020018
Ahmad, S., Mohd Noor, A. S., Alwan, A. A., Gulzar, Y., Khan, W. Z., & Reegu, F. A. (2023). eLearning acceptance and adoption challenges in higher education. Sustainability, 15(7), 6190. https://doi.org/10.3390/su15076190
AI-Youbi, A. O., Al-Hayani, A., Bardesi, H. J., Basheri, M., Lytras, M. D., & Aljohani, N. R. (2020). The King Abdulaziz University (KAU) pandemic framework: A methodological approach to leverage social media for the sustainable management of higher education in crisis. Sustainability, 12(11), 4367. https://doi.org/10.3390/su12114367
Akhter, H., Abdul Rahman, A. A., Jafrin, N., Mohammad Saif, A. N., Esha, B. H., & Mostafa, R. (2022). Investigating the barriers that intensify undergraduates’ unwillingness to online learning during COVID-19: A study on public universities in a developing country. Cogent Education, 9(1), 2028342. https://doi.org/10.1080 /2331186X.2022.2028342
Akram, H., Yingxiu, Y., Al-Adwan, A. S., & Alkhalifah, A. (2021). Technology integration in higher education during COVID-19: An assessment of online teaching competencies through technological pedagogical content knowledge model. Frontiers in Psychology, 12, 736522. https://doi.org/10.3389/fpsyg.2021.736522
Al-Khatib, T. (2023). Netiquette rules in online learning through the lens of digital citizenship scale in the post-corona era. Journal of Information, Communication and Ethics in Society, 21(2), 181–201. https://doi.org/10.1108/JICES-08-2021-0089
Al-Rahmi, A. M., Al-Rahmi, W. M., Alturki, U., Aldraiweesh, A., Almutairy, S., & AlAdwan, A. S. (2022). Acceptance of mobile technologies and M-learning by university students: An empirical investigation in higher education. Education and Information Technologies, 27(6), 7805–7826. https://doi.org/10.1007/s10639-022-10934-8
Al-Rahmi, W. M., Yahaya, N., Aldraiweesh, A. A., Alamri, M. M., Aljarboa, N. A., Alturki, U., & Aljeraiwi, A. A. (2019). Integrating technology acceptance model with innovation diffusion theory: An empirical investigation on students’ intention to use e-learning systems. IEEE Access, 7, 26797–26809. https://doi.org/10.1109/ACCESS.2019.2899368
Al-Sharhan, S., Al-Hunaiyyan, A., Alhajri, R., & Al-Huwail, N. (2020). Utilization of learning management system (LMS) among instructors and students. In Z. Zakaria, & R. Ahmad (Eds.), Advances in electronics engineering Singapore (pp. 15–23). Springer. https://doi.org/10.1007/978-981-15-1289-6_2
Alam, M. M., Ahmad, N., Naveed, Q. N., Patel, A., Abohashrh, M., & Khaleel, M. A. (2021). E-learning services to achieve sustainable learning and academic performance: An empirical study. Sustainability, 13(5), 2653. https://doi.org/10.3390/su13052653
Aldemir Engin, R., Karakuş, D., & Niess, M. L. (2023). TPACK development model for pre-service mathematics teachers. Education and Information Technologies, 28(4), 4769–4794. https://doi.org/10.1007/s10639-022-11381-1
Aldowah, H., Al-Samarraie, H., & Ghazal, S. (2019). How course, contextual, and technological challenges are associated with instructors’ individual challenges to successfully implement e-learning: A developing country perspective. IEEE Access, 7, 48792–48806. https://doi.org/10.1109/ACCESS.2019.2910148
Alenezi, M. (2023). Digital learning and digital institution in higher education. Education Sciences, 13(1), 88. https://doi.org/10.3390/educsci13010088
Alghazi, S. S., Kamsin, A., Almaiah, M. A., Wong, S. Y., & Shuib, L. (2021). For sustainable application of mobile learning: An extended UTAUT model to examine the effect of technical factors on the usage of mobile devices as a learning tool. Sustainability, 13(4), 1856. https://doi.org/10.3390/su13041856
Alharthi, A. D., Spichkova, M., & Hamilton, M. (2019). Sustainability requirements for eLearning systems: A systematic literature review and analysis. Requirements Engineering, 24, 523–543. https://doi.org/10.1007/s00766-018-0299-9
Aljaraideh, Y., & Al Bataineh, K. (2019). Jordanian students’ barriers of utilizing online learning: A survey study. International Education Studies, 12(5), 99–108. https://doi.org/10.5539/ies.v12n5p99
Alnusairat, S., Al Maani, D., & Al-Jokhadar, A. (2021). Architecture students’ satisfaction with and perceptions of online design studios during COVID-19 lockdown: The case of Jordan universities. Archnet-IJAR: International Journal of Architectural Research, 15(1), 219–236. https://doi.org/10.1108/ARCH-09-2020-0195
Alomari, M. M., El-Kanj, H., Alshdaifat, N. I., & Topal, A. (2020). A framework for the impact of human factors on the effectiveness of learning management systems. IEEE Access, 8, 23542–23558. https://doi.org/10.1109/ACCESS.2020.2970278
Alonso-García, S., Aznar-Díaz, I., Caceres-Reche, M.-P., Trujillo-Torres, J.-M., & Romero-Rodríguez, J.-M. (2019). Systematic review of good teaching practices with ICT in Spanish Higher Education. Trends and Challenges for Sustainability. Sustainability, 11(24), 7150. https://doi.org/10.3390/su11247150
Amaghouss, J., & Zouine, M. (2022). A critical analysis of the governance of the Moroccan education system in the era of online education. In M. B. Garcia (Ed.), Socioeconomic inclusion during an era of online education (pp. 156–176). IGI Global. https://doi.org/10.4018/978-1-6684-4364-4.ch008
Aparicio, M., Bação, F., & Oliveira, T. (2016). An e-learning theoretical framework. Journal of Educational Technology Systems, 19, 292–307.
Attalla, S. M., Hanafy, N. A., Akter, M., & Ruhi, S. (2020). Screening of medical students’ intention to practice mobile-learning in Malaysia. Malaysian Journal of Medicine and Health Sciences, 16(10), 40–45.
Azli, W. U. A. W., Shah, P. M., & Mohamad, M. (2018). Perception on the usage of mobile assisted language learning (MALL) in English as a second language (ESL) learning among vocational college students. Creative Education, 9(01), 84. https://doi.org/10.4236/ce.2018.91008
Baker, K. J. (2020). Panic‐gogy: A conversation with Sean Michael Morris. The National Teaching and Learning Forum, 29(4), 1–3. https://doi.org/10.1002/ntlf.30239
Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Aranda, L.-A., & Otto, A. (2022). Teachers’ digital competencies in higher education: A systematic literature review. International Journal of Educational Technology in Higher Education, 19(1), 1–16. https://doi.org/10.1186/s41239-021-00312-8
Bearman, M., Smith, C. D., Carbone, A., Slade, S., Baik, C., Hughes-Warrington, M., & Neumann, D. L. (2012). Systematic review methodology in higher education. Higher Education Research and Development, 31(5), 625–640. https://doi.org/10.1080/07294360.2012.702735
Benomar, A., Zarour, E., Létourneau-Guillon, L., & Raymond, J. (2023). Measuring interrater reliability. Radiology, 309(3), e230492). https://doi.org/10.1148/radiol.230492
Bhanot, N., Rao, P. V., & Deshmukh, S. (2019). Sustainable scenario: A systematic review of definitions of sustainability and agenda for future research. South Asian Journal of Management, 26(4), 32–70.
Bolmsten, J., & Manuel, M. E. (2020). Sustainable participatory processes of education technology development. Educational Technology Research and Development, 68, 2705–2728. https://doi.org/10.1007/s11423-020-09803-3
Bozkurt, A., Akgün-Özbek, E., & Zawacki-Richter, O. (2017). Trends and patterns in massive open online courses: Review and content analysis of research on MOOCs (2008–2015). International Review of Research in Open and Distributed Learning, 18(5), 118–147. https://doi.org/10.19173/irrodl.v18i5.3080
Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589–597. https://doi.org/10.1080/2159676X.2019.1628806
Braun, V., & Clarke, V. (2021). Can I use TA? Should I use TA? Should I not use TA? Comparing reflexive thematic analysis and other pattern-based qualitative analytic approaches. Counselling and Psychotherapy Research, 21(1), 37-47. https://doi.org/10.1002/capr.12360
Byrne, D. (2022). A worked example of Braun and Clarke’s approach to reflexive thematic analysis. Quality and Quantity, 56(3), 1391–1412. https://doi.org/10.1007/s11135-021-01182-y
Casanova, V. S., & Paguia, W. M. (2022). Expectations, experiences, and satisfaction of the graduate students with distance online learning environment in OMSC graduate school during the Covid-19 pandemic. Journal of Practical Studies in Education, 3(1), 14–22. https://doi.org/10.46809/jpse.v3i1.39
Cechetti, N. P., Biduki, D., & De Marchi, A. C. B. (2017). Gamification strategies for mobile device applications: a systematic review. Paper presented at the 2017 12th Iberian Conference on Information Systems and Technologies (CISTI), Lisbon, Portugal, 1–7. https://doi.org/10.23919/CISTI.2017.7975943
Chapman, K. (2021). Characteristics of systematic reviews in the social sciences. The Journal of Academic Librarianship, 47(5), 102396. https://doi.org/10.1016/j.acalib.2021.102396
Chocarro, R., Cortiñas, M., & Marcos-Matás, G. (2023). Teachers’ attitudes towards chatbots in education: a technology acceptance model approach considering the effect of social language, bot proactiveness, and users’ characteristics. Educational Studies, 49(2), 295–313. https://doi.org/10.1080/03055698.2020.1850426
Chu, A., Biancarelli, D., Drainoni, M.-L., Liu, J. H., Schneider, J. I., Sullivan, R., & Sheng, A. Y. (2020). Usability of learning moment: Features of an e-learning tool that maximize adoption by students. Western Journal of Emergency Medicine, 21(1), 78. https://doi.org/10.5811/westjem.2019.6.42657
Cicha, K., Rizun, M., Rutecka, P., & Strzelecki, A. (2021). COVID-19 and higher education: First-year students’ expectations toward distance learning. Sustainability, 13(4), 1889. https://doi.org/10.3390/su13041889
Cohen, J. (1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), 213–220. https://doi.org/10.1037/h0026256
Comas-Forgas, R., Lancaster, T., Calvo-Sastre, A., & Sureda-Negre, J. (2021). Exam cheating and academic integrity breaches during the COVID-19 pandemic: An analysis of internet search activity in Spain. Heliyon, 7(10), e08233. https://doi.org/10.1016/j.heliyon.2021.e08233
Cornelius, S., Calder, C., & Mtika, P. (2019). Understanding learner engagement on a blended course including a MOOC. Research in Learning Technology, 27, 2097. https://doi.org/10.25304/rlt.v27.2097
Correa, T., Pavez, I., & Contreras, J. (2020). Digital inclusion through mobile phones? A comparison between mobile-only and computer users in internet access, skills and use. Information, Communication and Society, 23(7), 1074–1091. https://doi.org/10.1080/1369118X.2018.1555270
Corres, A., Rieckmann, M., Espasa, A., & Ruiz-Mallén, I. (2020). Educator competences in sustainability education: A systematic review of frameworks. Sustainability, 12(23), 9858. https://doi.org/10.3390/su12239858
Coskun-Setirek, A., & Tanrikulu, Z. (2021). M-universities: Critical sustainability factors. SAGE Open, 11(1), 2158244021999388. https://doi.org/10.1177/2158244021999388
Crawford, J., Butler-Henderson, K., Rudolph, J., Malkawi, B., Glowatz, M., Burton, R., Magni, P., & Lam, S. (2020). COVID-19: 20 countries’ higher education intraperiod digital pedagogy responses. Journal of Applied Learning and Teaching, 3(1), 1–20. https://doi.org/10.37074/jalt.2020.3.1.7
Daumiller, M., Stupnisky, R., & Janke, S. (2020). Motivation of higher education faculty: Theoretical approaches, empirical evidence, and future directions. International Journal of Educational Research, 99, 101502. https://doi.org/10.1016/j.ijer.2019.101502
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. https://doi.org/10.1287/mnsc.35.8.982
del Arco, I., Silva, P., & Flores, O. (2021). University teaching in times of confinement: The light and shadows of compulsory online learning. Sustainability, 13(1), 375. https://doi.org/10.3390/su13010375
Dexter, H., & Dornan, T. (2010). Technology‐enhanced learning: Appraising the evidence. Medical Education, 44(8), 746–748. https://doi.org/10.1111/j.1365-2923.2010.03758.x
Dolawattha, D., Pramadasa, H. S., & Jayaweera, P. M. (2019). The impact model: Teachers’ mobile learning adoption in higher education. International Journal of Education and Development using Information and Communication Technology, 15(4), 71–88.
Dubey, P., & Sahu, K. K. (2022). Investigating various factors that affect students’ adoption intention to technology-enhanced learning. Journal of Research in Innovative Teaching and Learning, 15(1), 110–131. https://doi.org/10.1108/JRIT-07-2021-0049
Duru, I., Sunar, A. S., White, S., Diri, B., & Dogan, G. (2019). A case study on English as a second language speakers for sustainable MOOC study. Sustainability, 11(10), 2808. https://doi.org/10.3390/su11102808
Edelhauser, E., & Lupu-Dima, L. (2020). Is Romania prepared for e-learning during the COVID-19 pandemic? Sustainability, 12(13), 5438. https://doi.org/10.3390/su12135438
Elumalai, K. V., Sankar, J. P., Kalaichelvi, R, John, J. A., Menon, N., Alqahtani, M. S. M., & Abumelha, M. A. (2020). Factors affecting the quality of e-learning during the COVID-19 pandemic from the perspective of higher education students. Journal of Information Technology Education: Research, 19, 731–753. https://doi.org/10.28945/4628
Economic and Social Commission for Asia and the Pacific (ESCAP). (2019). SDG 4: Quality education: ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. Retrieved from https://www.unescap.org/kp/2019/sdg-4-quality-education-ensure-inclusive-and-equitable-qualityeducation-and-promote
Eshet, Y., Steinberger, P., & Grinautsky, K. (2021). Relationship between statistics anxiety and academic dishonesty: A comparison between learning environments in social sciences. Sustainability, 13(3), 1564. https://doi.org/10.3390/su13031564
Esteve-Mon, F. M., Llopis-Nebot, M. Á., & Adell-Segura, J. (2020). Digital teaching competence of university teachers: A systematic review of the literature. IEEE Revista Iberoamericana de Tecnologías del Aprendizaje, 15(4), 399–406. https://doi.org/10.1109/RITA.2020.3033225
Faura-Martínez, U., Lafuente-Lechuga, M., & Cifuentes-Faura, J. (2022). Sustainability of the Spanish university system during the pandemic caused by COVID-19. Educational Review, 74(3), 645–663. https://doi.org/10.1080/00131911.2021.1978399
Fedeli, L. (2022). A multidimensional perspective on digital competence, curriculum and teacher training in Italy: A scoping review on prospective and novice teachers. In L. Tomczyk, & L. Fedeli (Eds.), Digital Literacy for Teachers (pp. 61–274). Springer. https://doi.org/10.1007/978-981-19-1738-7_14
Fink, A. (2019). Conducting research literature reviews: From the internet to paper. SAGE Publications.
Fox, B. (2019). The changing face of higher education through digital technologies: A case study. International Journal of Education and Development using ICT, 15(1), 5–13.
Fussell, S. G., & Truong, D. (2022). Using virtual reality for dynamic learning: An extended technology acceptance model. Virtual Reality, 26(1), 249–267. https://doi.org/10.1007/s10055-021-00554-x
Giardiello, D., Quatto, P., Ripamonti, E., Vigliani, S., & Giardiello, M. D. (2023). Package ‘raters’. Journal of Applied Statistics, 22, 151–160.
Gillis, A., & Krull, L. M. (2020). COVID-19 remote learning transition in spring 2020: Class structures, student perceptions, and inequality in college courses. Teaching Sociology, 48(4), 283–299. https://doi.org/10.1177/0092055X20954263
Giustini, D., & Boulos, M. N. K. (2013). Google Scholar is not enough to be used alone for systematic reviews. Online Journal of Public Health Informatics, 5(2), 1–9. https://doi.org/10.5210/ojphi.v5i2.4623
Göbel, K., Neuber, K., Lion, C., & Cukierman, U. (2023). Self-efficacy in online teaching during the immediate transition from conventional to online teaching in German and Argentinian Universities: The relevance of institutional support and individual characteristics. Education Sciences, 13(1), 76. https://doi.org/10.3390/educsci13010076
Granić, A. (2022). Educational technology adoption: A systematic review. Education and Information Technologies, 27(7), 9725–9744. https://doi.org/10.1007/s10639-022-10951-7
Granić, A., & Marangunić, N. (2019). Technology acceptance model in educational context: A systematic literature review. British Journal of Educational Technology, 50(5), 2572–2593. https://doi.org/10.1111/bjet.12864
Gusenbauer, M. (2019). Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases. Scientometrics, 118(1), 177–214. https://doi.org/10.1007/s11192-018-2958-5
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015). The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PLoS ONE, 10(9), e0138237. https://doi.org/10.1371/journal.pone.0138237
Håland, W. (1999). On needs: A central concept in the Brundtland Report. In W. M. Lafferty, & O. Langhelle (Eds.), Towards sustainable development (pp. 48–69). London: Palgrave Macmillan. https://doi.org/10.1057/9780230378797_3
Halevi, G., Moed, H., & Bar-Ilan, J. (2017). Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation: Review of the literature. Journal of informetrics, 11(3), 823–834. https://doi.org/10.1016/j.joi.2017.06.005
Heng, H. K., Rx, W., Goh, F., Peng, S., & Syazwani, I. (2022). The mediating role of institutional support on relationship between Technology Acceptance Model (TAM) and student satisfaction to use e-learning during COVID-19 pandemic:
The study of private university in Malaysia. International Journal of Special Education, 37(3), 742–752.
Iqbal, S., & Bhatti, Z. A. (2020). A qualitative exploration of teachers’ perspective on smartphones usage in higher education in developing countries. International Journal of Educational Technology in Higher Education, 17(1), 29. https://doi.org/10.1186/s41239-020-00203-4
Isaac, O., Aldholay, A., Abdullah, Z., & Ramayah, T. (2019). Online learning usage within Yemeni higher education: The role of compatibility and task-technology fit as mediating variables in the IS success model. Computers and Education, 136, 113–129. https://doi.org/10.1016/j.compedu.2019.02.012
Jan, S. K., Vlachopoulos, P., & Parsell, M. (2019). Social network analysis and learning communities in higher education online learning: A systematic literature review. Online Learning, 23(1), 249–265. https://doi.org/10.24059/olj.v23i1.1398
Jebbour, M. (2022). The unexpected transition to distance learning at Moroccan universities amid COVID-19: A qualitative study on faculty experience. Social Sciences and Humanities Open, 5(1), 100253. https://doi.org/10.1016/j.ssaho.2022.100253
Jimenez, A. M., & Zepeda, S. J. (2020). A comparison of Gwet’s AC1 and kappa when calculating inter-rater reliability coefficients in a teacher evaluation context. Journal of Education Human Resources, 38(2), 290–300. https://doi.org/10.3138/jehr-2019-0001
Johnson, N., Veletsianos, G., & Seaman, J. (2020). US faculty and administrators’ experiences and approaches in the early weeks of the COVID-19 pandemic. Online Learning, 24(2), 6–21. https://doi.org/10.24059/olj.v24i2.2285
Kapici, H. O., & Akcay, H. (2023). Improving student teachers’ TPACK self-efficacy through lesson planning practice in the virtual platform. Educational Studies, 49(1), 76–98. https://doi.org/10.1080/03055698.2020.1835610
Kaqinari, T., Makarova, E., Audran, J., Döring, A. K., Göbel, K., & Kern, D. (2022). A latent class analysis of university lecturers’ switch to online teaching during the first COVID-19 lockdown: The role of educational technology, self-efficacy, and institutional support. Education Sciences, 12(9), 607. https://doi.org/10.3390/educsci12090607
Khan, M. A., Nabi, M. K., Khojah, M., & Tahir, M. (2020). Students’ perception towards e-learning during COVID-19 pandemic in India: An empirical study. Sustainability, 13(1), 57. https://doi.org/10.3390/su13010057
Khan, N., Qureshi, M. I., Mustapha, I., Irum, S., & Arshad, R. (2020). A systematic literature review paper on online medical mobile applications in Malaysia. International Journal of Online and Biomedical Engineering, 16, 63. https://doi.org/10.3991/ijoe.v16i01.12263
Kim, E.-J., Kim, J. J., & Han, S.-H. (2021). Understanding student acceptance of online learning systems in higher education: Application of social psychology theories with consideration of user innovativeness. Sustainability, 13(2), 896. https://doi.org/10.3390/su13020896
Korkmaz, G., & Toraman, Ç. (2020). Are we ready for the post-COVID-19 educational practice? An investigation into what educators think as to online learning. International Journal of Technology in Education and Science, 4(4), 293–309. https://doi.org/10.46328/ijtes.v4i4.110
Krippendorff, K. (2018). Content analysis: An introduction to its methodology. SAGE Publications. https://doi.org/10.4135/9781071878781
Lambert, S. R. (2020). Do MOOCs contribute to student equity and social inclusion? A systematic review 2014–18. Computers and Education, 145, 103693. https://doi.org/10.1016/j.compedu.2019.103693
Lampo, A. (2023). How is technology accepted? Fundamental works in user technology acceptance from diffusion of innovations to UTAUT-2. Proceedings of the 8th International Conference on Industrial and Business Engineering, Macau, China, September, pp. 260–266. https://doi.org/10.1145/3568834.3568903
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
Lee, D., Jung, J., Shin, S., Otternbreit-Leftwich, A., & Glazewski, K. (2020). A sociological view on designing a sustainable online community for K-12 teachers: A systematic review. Sustainability, 12(22), 9742. https://doi.org/10.3390/su12229742
Leszczyński, P., Charuta, A., Łaziuk, B., Gałązkowski, R., Wejnarski, A., Roszak, M., & Kołodziejczak, B. (2018). Multimedia and interactivity in distance learning of resuscitation guidelines: A randomised controlled trial. Interactive Learning Environments, 26(2), 151–162. https://doi.org/10.1080/10494820.2017.1337035
Li, Y., Nishimura, N., Yagami, H., & Park, H.-S. (2021). An empirical study on online learners’ continuance intentions in China. Sustainability, 13(2), 889. https://doi.org/10.3390/su13020889
Liando, N. V. F., Tatipang, D. P., & Wuntu, C. N. (2023). TPACK framework towards 21st century’s pre-service English teachers: Opportunities and challenges in application. Edumaspul: Jurnal Pendidikan, 7(1), 1799–1815.
Light, R. J. (1971). Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychological Bulletin, 76(5), 365. https://doi.org/10.1037/h0031643
Linares-Espinós, E., Hernández, V., Domínguez-Escrig, J., Fernández-Pello, S., Hevia, V., Mayor, J., Padilla-Fernández, B., & Ribal, M. (2018). Methodology of a systematic review. Actas Urológicas Españolas (English Edition), 42(8), 499–506. https://doi.org/10.1016/j.acuroe.2018.07.002
Linjawi, A. I., & Agou, S. (2020). E-learning readiness among dental students and faculty members Pre-COVID-19 pandemic. Journal of Microscopy and Ultrastructure, 8(4), 168. https://doi.org/10.4103/JMAU.JMAU_40_20
Liu, Y., & Cao, Z. (2022). The impact of social support and stress on academic burnout among medical students in online learning: The mediating role of resilience. Frontiers in Public Health, 10, 938132. https://doi.org/10.3389/fpubh.2022.938132
Luthra, P., & Mackenzie, S. (2020). 4 ways COVID-19 could change how we educate future generations. Retrieved 25 February 2023 from https://www.weforum.org/agenda/2020/03/4-ways-covid-19-education-future-generations/
Maatuk, A. M., Elberkawi, E. K., Aljawarneh, S., Rashaideh, H., & Alharbi, H. (2022). The COVID-19 pandemic and E-learning: challenges and opportunities from the perspective of students and instructors. Journal of Computing in Higher Education, 34(1), 21–38. https://doi.org/10.1007/s12528-021-09274-2
Martin, F., Sun, T., & Westine, C. D. (2020). A systematic review of research on online teaching and learning from 2009 to 2018. Computers and Education, 159, 104009. https://doi.org/10.1016/j.compedu.2020.104009
Masalimova, A. R., Khvatova, M. A., Chikileva, L. S., Zvyagintseva, E. P., Stepanova, V. V., & Melnik, M. V. (2022). Distance learning in higher education during COVID-19. Frontiers in Education, 7, 120. https://doi.org/10.3389/feduc.2022.822958
Masiero, M., Mazzocco, K., Harnois, C., Cropley, M., & Pravettoni, G. (2020). From individual to social trauma: Sources of everyday trauma in Italy, the US and UK during the COVID-19 pandemic. Journal of Trauma and Dissociation, 21(5), 513–519. https://doi.org/10.1080/15299732.2020.1787296
Meng, Z., & Li, R. (2023). Understanding Chinese teachers’ informal online learning continuance in a mobile learning community: An intrinsic-extrinsic motivation perspective. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-023-09352-7
Meyer, K. A., Bruwelheide, J., & Poulin, R. (2007). Developing knowledge through practical experience: The principles of financial sustainability for online programs. The Online Journal of Distance Learning Administration, 10(2). Retrieved from http://www.westga.edu/%7Edistance/ojdla/summer102/meyer102.htm
Minozzi, S., Cinquini, M., Gianola, S., Gonzalez-Lorenzo, M., & Banzi, R. (2022). Kappa and AC1/2 statistics: Beyond the paradox. Journal of Clinical Epidemiology, 142, 328–329. https://doi.org/10.1016/j.jclinepi.2021.09.004
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264–269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135
Moraros, J., Islam, A., Yu, S., Banow, R., & Schindelka, B. (2015). Flipping for success: evaluating the effectiveness of a novel teaching approach in a graduate level setting. BMC Medical Education, 15(1), 1–10. https://doi.org/10.1186/s12909-015-0317-2
Muganda, C. K., Samzugi, A. S., & Mallinson, B. J. (2016). Analytical insights on the position, challenges, and potential for promoting OER in ODeL institutions in Africa. International Review of Research in Open and Distributed Learning, 17(4), 36–49. https://doi.org/10.19173/irrodl.v17i4.2465
Muhammad, A., Shaikh, A., Naveed, Q. N., & Qureshi, M. R. N. (2020). Factors affecting academic integrity in e-learning of Saudi Arabian universities. An investigation using Delphi and AHP. IEEE Access, 8, 16259–16268. https://doi.org/10.1109/ACCESS.2020.2967499
Muljana, P. S., & Luo, T. (2019). Factors contributing to student retention in online learning and recommended strategies for improvement: A systematic literature review. Journal of Information Technology Education: Research, 18, 19–57. https://doi.org/10.28945/4182
Muries, B., & Masele, J. (2017). Explaining electronic learning management systems (ELMS) continued usage intentions among facilitators in higher education institutions (HEIs) in Tanzania. International Journal of Education and Development using ICT, 13(1), 123–141.
Nangawe, A. G. (2015). Adoption of web-based assessment in higher learning institutions (HLIs). Journal of Applied Research in Higher Education, 7(1), 113–122. https://doi.org/10.1108/JARHE-03-2014-0036
Naveed, Q. N., Alam, M. M., & Tairan, N. (2020). Structural equation modeling for mobile learning acceptance by university students: An empirical study. Sustainability, 12(20), 8618. https://doi.org/10.3390/su12208618
Naveed, Q. N., Qureshi, M. R. N., Tairan, N., Mohammad, A., Shaikh, A., Alsayed, A. O., Shah, A., & Alotaibi, F. M. (2020). Evaluating critical success factors in implementing e-learning system using multi-criteria decision-making. PLoS ONE, 15(5), e0231465. https://doi.org/10.1371/journal.pone.0231465
Nuseir, M. T., Aljumah, A. I., & Refae, G. A. E. (2022). The influence of e-learning, m-learning, and d-learning on the student performance: Moderating role of institutional support. Paper presented at The 2022 International Arab Conference on Information Technology (ACIT), Abu Dhabi, United Arab Emirates, pp. 1–9. https://doi.org/10.1109/ACIT57182.2022.9994193
Oyetade, K., Zuva, T., & Harmse, A. (2020). A review of the determinant factors of technology adoption. In R. Silhavy (Ed.), Applied informatics and cybernetics in intelligent systems. CSOC 2020. Advances in Intelligent Systems and Computing (vol. 1226, pp. 274–286). Springer, Cham. https://doi.org/10.1007/978-3-030-51974-2_26
Oyman, M., Bal, D., & Ozer, S. (2022). Extending the technology acceptance model to explain how perceived augmented reality affects consumers’ perceptions. Computers in Human Behavior, 128, 107127. https://doi.org/10.1016/j.chb.2021.107127
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., & Brennan, S. E. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906
Paramasivam, S., Krishnan, I. A., Amin, A. S., Kaliappen, N., Sidhu, R. S., & Anbalagan, H. (2022). Challenges faced by disabled students in online learning during the COVID-19 pandemic. International Journal of Academic Research in Business and Social Sciences, 12(1), 2098–2113. https://doi.org/10.6007/IJARBSS/v12-i1/12282
Pedro, N. S., & Kumar, S. (2020). Institutional support for online teaching in quality assurance frameworks. Online Learning, 24(3), 50–66. https://doi.org/10.24059/olj.v24i3.2309
Permatasari, N., Ashari, F. R., & Ismail, N. (2021). Contribution of perceived social support (peer, family, and teacher) to academic resilience during COVID-19. Golden Ratio of Social Science and Education, 1(1), 1–12. https://doi.org/10.52970/grsse.v1i1.94
Petticrew, M., & Roberts, H. (2008). Systematic reviews in the social sciences: A practical guide. John Wiley & Sons.
Philipsen, B., Tondeur, J., Pareja Roblin, N., Vanslambrouck, S., & Zhu, C. (2019). Improving teacher professional development for online and blended learning: A systematic meta-aggregative review. Educational Technology Research and Development, 67, 1145–1174. https://doi.org/10.1007/s11423-019-09645-8
Pikhart, M., & Klímová, B. (2020). eLearning 4.0 as a sustainability strategy for generation Z language learners: Applied linguistics of second language acquisition in younger adults. Societies, 10(2), 38. https://doi.org/10.3390/soc10020038
Portillo, J., Garay, U., Tejada, E., & Bilbao, N. (2020). Self-perception of the digital competence of educators during the COVID-19 pandemic: A cross-analysis of different educational stages. Sustainability, 12(23), 10128. https://doi.org/10.3390/su122310128
Potter, W. J., & Levine‐Donnerstein, D. (1999). Rethinking validity and reliability in content analysis. Journal of Applied Communication Research, 27(3), 258–284. https://doi.org/10.1080/00909889909365539
Power, E., & Kannara, V. (2016). Best-practice model for technology enhanced learning in the creative arts. Research in Learning Technology, 24(1), 30231. https://doi.org/10.3402/rlt.v24.30231
Qureshi, M. I., Khan, N., Hassan Gillani, S. M. A., & Raza, H. (2020). A systematic review of past decade of mobile learning: What we learned and where to go. International Journal of Interactive Mobile Technologies, 14(6), 67–81. https://doi.org/10.3991/ijim.v14i06.13479
Ramachandran, V., & Kuppusamy, S. (2018). A framework for making most out of online communities of practice tools for reforms in distance learning. Asian Journal of Distance Education, 13(1), 146–156.
Revuelta-Domínguez, F.-I., Guerra-Antequera, J., González-Pérez, A., Pedrera-Rodríguez, M.-I., & González-Fernández, A. (2022). Digital teaching competence: A systematic review. Sustainability, 14(11), 6428. https://doi.org/10.3390/su14116428
Rizun, M., & Strzelecki, A. (2020). Students’ acceptance of the COVID-19 impact on shifting higher education to distance learning in Poland. International Journal of Environmental Research and Public Health, 17(18), 6468. https://doi.org/10.3390/ijerph17186468
Robertson, I. (2008). Sustainable e-learning, activity theory and professional development. Paper presented at ASCILITE 2008: The Australasian Society for Computers in Learning in Tertiary Education, Melbourne, Australia.
Rodrigues, A. L., Cerdeira, L., Machado-Taylor, M. d. L., & Alves, H. (2021). Technological skills in higher education: Different needs and different uses. Education Sciences, 11(7), 326. https://doi.org/10.3390/educsci11070326
Rodriguez-Garcia, A. M., Aznar, I., Caceres, P., & Gomez, G. (2019). Digital competence in higher education: Analysis of the impact of scientific production indexed in Scopus database. Revista Espacios, 40(21), 14.
Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.
Roy, R., & Al-Absy, M. S. M. (2022). Impact of critical factors on the effectiveness of online learning. Sustainability, 14(21), 14073. https://doi.org/10.3390/su142114073
Rus-Casas, C., La Rubia, M. D., Eliche-Quesada, D., Jiménez-Castillo, G., & AguilarPeña, J. D. (2021). Online tools for the creation of personal learning environments in engineering studies for sustainable learning. Sustainability, 13(3), 1179. https://doi.org/10.3390/su13031179
Rusli, R., Hashim, F., Akhir, N. M., & Nasrudin, N. (2023). Learning Management System (LMS) preference among Malaysian educators: A comparisan between Google Classroom and Microsoft Teams. Asian People Journal, 6(2), 212–228. https://doi.org/10.37231/apj.2023.6.2.527
Sahin, I. (2006). Detailed review of Rogers’ diffusion of innovations theory and educational technology-related studies based on Rogers’ theory. Turkish Online Journal of Educational Technology, 5(2), 14–23.
Saleh, S. S., Nat, M., & Aqel, M. (2022). Sustainable adoption of e-learning from the TAM perspective. Sustainability, 14(6), 3690. https://doi.org/10.3390/su14063690
Sangster, A., Stoner, G., & Flood, B. (2020). Insights into accounting education in a COVID-19 world. Accounting Education, 29(5), 431–562. https://doi.org/10.1080/09639284.2020.1808487
Schophuizen, M., Kreijns, K., Stoyanov, S., & Kalz, M. (2018). Eliciting the challenges and opportunities organizations face when delivering open online education: A group-concept mapping study. The Internet and Higher Education, 36, 1–12. https://doi.org/10.1016/j.iheduc.2017.08.002
Seppala, N., & Smith, C. (2020). Teaching awards in higher education: A qualitative study of motivation and outcomes. Studies in Higher Education, 45(7), 1398–1412. https://doi.org/10.1080/03075079.2019.1593349
Shaffril, H. A. M., Samah, A. A., & Samsuddin, S. F. (2021). Guidelines for developing a systematic literature review for studies related to climate change adaptation. Environmental Science and Pollution Research, 28, 22265–22277. https://doi.org/10.1007/s11356-021-13178-0
Shariff, S. Z., Bejaimal, S. A., Sontrop, J. M., Iansavichus, A. V., Haynes, R. B., Weir, M. A., & Garg, A. X. (2013). Retrieving clinical evidence: A comparison of PubMed and Google Scholar for quick clinical searches. Journal of Medical Internet Research, 15(8), e2624. https://doi.org/10.2196/jmir.2624
Shukla, R. K., & Nagar, D. (2020). Criticality for e-learning ecosystem: An empirical study. AIMS Journal of Management, 6(1), 23–35.
Shwartz-Asher, D., Raviv, A., & Herscu-Kluska, R. (2022). Teaching and assessing active learning in online academic courses. Social Sciences and Humanities Open, 6(1), 100341. https://doi.org/10.1016/j.ssaho.2022.100341
Simamora, R. M. (2020). The challenges of online learning during the COVID-19 pandemic: An essay analysis of performing arts education students. Studies in Learning and Teaching, 1(2), 86–103. https://doi.org/10.46627/silet.v1i2.38
Singh, V., & Thurman, A. (2019). How many ways can we define online learning? A systematic literature review of definitions of online learning (1988-2018). American Journal of Distance Education, 33(4), 289–306. https://doi.org/10.1080/08923647.2019.1663082
Sinha, E., & Bagarukayo, K. (2019). Online education in emerging knowledge economies: Exploring factors of motivation, de-motivation and potential facilitators; and studying the effects of demographic variables. International Journal of Education and Development using Information and Communication Technology, 15(2), 5–30.
Sobaih, A. E. E., Hasanein, A. M., & Abu Elnasr, A. E. (2020). Responses to COVID-19 in higher education: Social media usage for sustaining formal academic communication in developing countries. Sustainability, 12(16), 6520. https://doi.org/10.3390/su12166520
Sosa-Díaz, M. J., & Fernández-Sánchez, M. R. (2020). Massive open online courses (MOOC) within the framework of international developmental cooperation as a strategy to achieve sustainable development goals. Sustainability, 12(23), 10187. https://doi.org/10.3390/su122310187
Sosa, O., Salinas, J., & De Benito, B. (2017). Emerging technologies (ETs) in education: A systematic review of the literature published between 2006 and 2016. International Journal of Emerging Technologies in Learning, 12(5), 128–149. https://doi.org/10.3991/ijet.v12i05.6939
Spinks, M. L., Metzler, M., Kluge, S., Langdon, J., Gurvitch, R., Smitherman, M., Esmat, T., Bhattacharya, S., Carruth, L., Crowther, K., Denton, R., Edwards, O. V., Shrikhande, M., & Strong-Green, A. (2023). “This wasn’t pedagogy, it was panicgogy”: Perspectives of the challenges faced by students and instructors during the emergency transition to remote learning due to COVID-19. College Teaching, 71(4), 227–243. https://doi.org/10.1080/87567555.2021.2018395
Stepanyan, K., Littlejohn, A., & Margaryan, A. (2013). Sustainable e-learning: Toward a coherent body of knowledge. Educational Technology and Society, 16, 91–102.
Tam, G., & El-Azar, D. (2020). Ways the coronavirus pandemic could reshape education. Retrieved 30 March 2023 from https://www.weforum.org/agenda/2020/03/3-ways-coronavirus-is-reshaping-education-and-what-changes-might-be-here-tostay/
Tang, W., Hu, T., Hu, B., Jin, C., Wang, G., Xie, C., Chen, S., & Xu, J. (2020). Prevalence and correlates of PTSD and depressive symptoms one month after the outbreak of the COVID-19 epidemic in a sample of home-quarantined Chinese university students. Journal of Affective Disorders, 274, 1–7. https://doi.org/10.1016/j.jad.2020.05.009
Tao, J., & Gao, X. A. (2022). Teaching and learning languages online: Challenges and responses. System, 107, 102819. https://doi.org/10.1016/j.system.2022.102819
Tao, Y., & Ma, J. (2022). Effects of the TPACK levels of university teachers on the use of online teaching technical tools. International Journal of Emerging Technologies in Learning, 17(20), 188–199. https://doi.org/10.3991/ijet.v17i20.35135
Tate, T., & Warschauer, M. (2022). Equity in online learning. Educational Psychologist, 57(3), 192–206. https://doi.org/10.1080/00461520.2022.2062597
Teodorescu, D., Aivaz, K. A., & Amalfi, A. (2022). Factors affecting motivation in online courses during the COVID-19 pandemic: The experiences of students at a Romanian public university. European Journal of Higher Education, 12(3), 332–349. https://doi.org/10.1080/21568235.2021.1972024
Tondeur, J., Van Braak, J., Ertmer, P. A., & Ottenbreit-Leftwich, A. (2017). Understanding the relationship between teachers’ pedagogical beliefs and technology use in education: A systematic review of qualitative evidence. Educational Technology Research and Development, 65, 555–575. https://doi.org/10.1007/s11423-016-9481-2
Toquero, C. M. (2020). Challenges and opportunities for higher education amid the COVID-19 pandemic: The Philippine context. Pedagogical Research, 5(4), em0063. https://doi.org/10.29333/pr/7947
Torres Martín, C., Acal, C., El Homrani, M., & Mingorance Estrada, Á. C. (2021). Impact on the virtual learning environment due to COVID-19. Sustainability, 13(2), 582. https://doi.org/10.3390/su13020582
Tuapawa, K. (2016). Interpreting experiences of teachers using online technologies to interact with students in blended tertiary environments. International Journal of Information and Communication Technology Education, 12(4), 76–87. https://doi.org/10.4018/IJICTE.2016100107
UNESCO. (2020). 1.37 billion students now home as COVID-19 school closures expand, ministers scale up multimedia approaches to ensure learning continuity. Retrieved 28 February 2023 from https://en.unesco.org/news/137-billion-students-nowhome-covid-19-school-closures-expand-ministers-scale-multimedia
Valverde-Berrocoso, J., Garrido-Arroyo, M. d. C., Burgos-Videla, C., & MoralesCevallos, M. B. (2020). Trends in educational research about e-learning: A systematic literature review (2009–2018). Sustainability, 12(12), 5153. https://doi.org/10.3390/su12125153
Volpe, S., Zane, T., & Weiss, M. J. (2023). You’re not skyping your Uncle Buck on Saturday night: Proper behavior in online learning environments. Journal of College and Character, 24(3), 285–292. https://doi.org/10.1080/2194587X.2023.2224576
Wang, M. (2020). The emergency remote learning process of Japanese university EFL students in a global topics course. THT Journal: The Journal of Teachers Helping Teachers, 8(1), 64–84.
Xiao, P., Chen, Y., & Bao, W. (2023). Waiting, banning, and embracing: An empirical analysis of adapting policies for generative AI in higher education. ArXiv, https://arxiv.org/abs/2305.18617
Zancajo, A., Verger, A., & Bolea, P. (2022). Digitalization and beyond: The effects of Covid-19 on post-pandemic educational policy and delivery in Europe. Policy and Society, 41(1), 111–128. https://doi.org/10.1093/polsoc/puab016
Zhang, M., Shu, L., Luo, X., Yuan, M., & Zheng, X. (2022). Virtual reality technology in construction safety training: Extended technology acceptance model. Automation in Construction, 135, 104113. https://doi.org/10.1016/j.autcon.2021.104113
Zinn, K. L. (2003). Computer-assisted learning and teaching. In A. Ralston, E. D. Reilly, & D. Hemmendinger (Eds.), Encyclopedia of computer science (pp. 328–336). John Wiley and Sons.