ChatGPT in Teaching-Learning and Research: A Systematic Review
Main Article Content
Abstract
Based on the most recent available data, ChatGPT has amassed a substantial user base of approximately 180.5 million since its public release in November 2022. This widespread adoption has prompted concerns among educators regarding its seamless integration into teaching and learning processes. The capacity of ChatGPT to rapidly generate highly pertinent content has generated significant interest and discussions in the educational sphere especially at a higher level. Although a substantial body of research exists in this field, there is a notable gap in the literature regarding comprehensive review articles focusing on specific subtopics, such as the application of ChatGPT and its impact on higher-level teaching, learning and research. To date, no thorough examination has been conducted to synthesise and critically analyse the existing studies in this particular domain. To address this, we conducted a systematic review of research articles following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, utilising databases such as Scopus, IEEE Xplore and ScienceDirect. Among the 106 initially identified studies, only 25 articles met our inclusion criteria.The results presented shed light on how ChatGPT can prove effective in teaching, learning and research. The review also brought to light a lot of issues, such as plagiarism, manipulation, cheating and ChatGPT’s trustworthiness. Our findings also underscore the limitations in the use of ChatGPT and emphasise the ethical considerations involved. Furthermore, this review illuminates potential avenues for future studies and also presents a critical assessment, paving the way for improvements in the field.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Abukmeil, M., Ferrari, S., Genovese, A., Piuri, V., & Scotti, F. (2021). A survey of unsupervised generative models for exploratory data analysis and representation learning. ACM Computing Surveys (CSUR), 54(5), 1–40. https://doi.org/10.1145/3450963
Ahmad, A., Waseem, M., Liang, P., Fahmideh, M., Aktar, M. S., & Mikkonen, T. (2023). Towards human-bot collaborative software architecting with ChatGPT. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering (pp. 279–285). Association for Computing Machinery. https://doi.org/10.1145/3593434.3593468
AlAfnan, M. A., Dishari, S., Jovic, M., & Lomidze, K. (2023). ChatGPT as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology, 3(2), 60–68. https://doi.org/10.37965/jait.2023.0184
Ansari, A. N., Ahmad, S., & Bhutta, S. M. (2023). Mapping the global evidence around the use of ChatGPT in higher education: A systematic scoping review. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12223-4
Aydin, O., & Karaarslan, E. (2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare. In O. Aydin (Ed.), Emerging computer technologies 2 (pp. 22–31). İzmir Akademi Dernegi. https://doi.org/10.2139/ssrn.4308687
Baidoo-Anu, D. & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. SSRN. https://doi.org/10.2139/ssrn.4337484
Bleumink, A.G., & Shikhule, A. (2023). Keeping ai honest in education: Identifying GPTgenerated text. Edukado AI Research. https://cdn.aicheatcheck.com/Keeping_AI_Honest_in_Education__Identifying_GPT_generated_text.pdf
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.
Chang, C. Y., Hwang, G. J., & Gau, M. L. (2021). Promoting students’ learning achievement and self-efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53(1), 171–188. https://doi.org/10.1111/bjet.13158
Chaudhry, I. S., Sarwary, S. A. M., El Refae, G. A., & Chabchoub, H. (2023). Time to revisit existing student’s performance evaluation approach in higher education sector in a new era of ChatGPT: A case study. Cogent Education, 10(1), 2210461. https://doi.org/10.1080/2331186X.2023.2210461
Chen, Y., Chen, Y., & Heffernan, N. (2020). Personalized math tutoring with a conversational agent. Arxiv. arxiv: 2012.12121
Chiu, T. K. F. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments, 1–17. https://doi.org/10.1080/10494820.2023.2253861
Cooper, G. (2023). Examining Science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32, 444–452. https://doi.org/10.1007/s10956-023-10039-y
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148
Dale, R. (2021). GPT-3: What’s it good for? Natural Language Engineering, 27(1), 113–118. https://doi.org/10.1017/S1351324920000601
DeMello, S., Craig, S., Witherspoon, A., & Graesser, A. (2014). Affective and learning-related dynamics during interactions with an intelligent tutoring system. International Journal of Human-Computer Studies,72(6), 415–435.
Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023, September). The impact of ChatGPT on higher education. In Frontiers in Education (Vol. 8, 1206936). Frontiers Media SA. https://doi.org/10.3389/feduc.2023.1206936
Dowling, M., & Lucey, B. (2023). ChatGPT for (finance) research: The bananarama conjecture. Finance Research Letters, 53, 103662. https://doi.org/10.1016/j.frl.2023.103662
Else, H. (2023). Abstracts written by ChatGPT fool scientists. Nature, 613(7944), 423. https://doi.org/10.1038/d41586-023-00056-7
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(3), 460–474. https://doi.org/10.1080/14703297.2023.2195846S
Firat, M. (2023). How ChatGPT can transform autodidactic experiences and open education? OSF Preprints. https://doi.org/10.31219/osf.io/9ge8m
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. BioRxiv. https://doi.org/10.1101/2022.12.23.521610
Garcia Sanchez, O. V. (2023). Uso y percepcion de ChatGPT en la educacion superior. Revista De Investigación En Tecnologías De La Información, 11(23), 98–107. https://doi.org/10.36825/RITI.11.23.009
Garcia-Pena, V. R., Mora-Marcillo, A. B., & Ávila-Ramírez, J. A. (2020). La inteligencia artificial en la education. Dominio de las Ciencias, 6, 648–666.
Grassini, S. (2023). Shaping the future of education: Exploring the potential and consequences of AI and ChatGPT in educational settings. Education Sciences, 13(7), 692. https://doi.org/10.3390/educsci13070692
Habibi, A., Muhaimin, M., Danibao, B. K., Wibowo, Y. G., Wahyuni, S., & Octavia, A. (2023). ChatGPT in higher education learning: Acceptance and use. Computers and Education: Artificial Intelligence, 5, 100190. https://doi.org/10.1016/j.caeai.2023.100190
Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
Hu, L. (2022, 17 July). Generative AI and future. Towards AI. Retrieved on 23 January 2024 from https://pub.towardsai.net/generativeai-and-future-c3b1695876f2
Incio Flores, F. A., Capunay Sánchez, D. L., Estela Urbina, R. O., Valles Coral, M. A., Vergara Medrano, S. E., & Elera Gonzales, D. G. (2021). Inteligencia artificial en education: Una revision de la literaturaen revista scientific as internacionales. Apuntes Universitarios, 12(1), 353–372. https://doi.org/10.17162/au.v12i1.974
Jalil, S., Rafi, S., LaToza, T. D., Moran, K., & Lam, W. (2023). ChatGPT and software testing education: Promises & perils. 2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) [Paper presentation]. Dublin, Ireland, 4130–4137. https://doi.org/10.1109/ICSTW58534.2023.00078
Jara, I., Ochoa, J., & Usos, Y. (2021). Efectos de la inteligencia artificial en la education. Sector Social División Educacion. Document for Discussion No. IDB-DP-00776, Banco Interamericano de Desarrollo (Inter-American Development Bank). https://doi.org/10.18235/0002380
Jovanovic, M., & Campbell, M. (2022). Generative Artificial Intelligence: Trends and prospects. In M. Campbell (Ed.), Computer (pp. 107–112). The IEEE Computer Society.
Karakose, T., & Tulubaş, T. (2023). How can ChatGPT facilitate teaching and learning: Implications for contemporary education? Educational Process: International Journal, 12(4), 7–16. https://doi.org/10.22521/edupij.2023.124.1
Kim, S., Park, J., & Lee, H. (2019). Automated essay scoring using a deep learning model. Journal of Educational Technology Development and Exchange, 2(1), 1–17.
King, M. R. (2023). The future of AI in medicine: A perspective from a Chatbot. Annals of Biomedical Engineering, 51, 291–295. https://doi.org/10.1007/s10439-022-03121-w
King, M. R., & ChatGPT. (2023). A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16, 1–2. https://doi.org/10.1007/s12195-022-00754-8
Kirmani, A. R. (2022). Artificial intelligence enabled science poetry. ACS Energy Letters, 8, 574–576. https://doi.org/10.1021/acsenergylett.2c02758
Korngiebel, D. M., & Mooney, S. D. (2021). Considering the possibilities and pitfalls of Generative Pre-trained Transformer 3 (GPT-3) in healthcare delivery. NPJ Digital Medicine, 4(1), 93. https://doi.org/10.1038/s41746-021-00464-x
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Memarian, B., & Doleck, T. (2023). ChatGPT in education: Methods, potentials, and limitations. Computers in Human Behaviour. Artificial Humans, 1(2), 100022. https://doi.org/10.1016/j.chbah.2023.100022
Memarian, B., & Doleck, T. (2023). ChatGPT in education: Methods, potentials, and limitations. Computers in Human Behaviour. Artificial Humans, 1(2), 100022. https://doi.org/10.1016/j.chbah.2023.100022
Mengist, W., Soromessa, T., & Legese, G. (2020). Ecosystem services research in mountainous regions: A systematic literature review on current knowledge and research gaps. Science of the Total Environment, 702, 134581. https://doi.org/10.1016/j.scitotenv.2019.134581
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoSMedicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
Nemorin, S., Vlachidis, A., Ayerakwa, H. M., & Andriotis, P. (2023). AI hyped? A horizon scan of discourse on artificial intelligence in education (AIED) and development. Learning, Media and Technology, 48(1), 38–51. https://doi.org/10.1080/17439884.2022.2095568
Nie, B., Wang, T., Mannuru, N., Lund, B., Wang, Z., & Shimray, S. (2023, 15 March). ChatGPT and AI-written research papers: Ethical considerations for scholarly publishing. Information Matters. https://informationmatters.org
OpenAI. (2024). ChatGPT (Mar 14 version) [Large language model]. https://chat.openai.com/chat
Osorio, J. A. C. (2023). Explorandoel potential de ChatGPT en la escrituracientifica: Ventajas, desafíos y precauciones. Scientia Et Technica, 28(1), 3–5. https://doi.org/10.22517/23447214.25303
Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism and Mass Communication Educator, 78(1), 84–93. https://doi.org/10.1177/10776958221149577
Peng, P., Wang, T., Wang, C., & Lin, X. (2019). A meta-analysis on the relation between fluid intelligence and reading/mathematics: Effects of tasks, age, and social economics status. Psychological Bulletin, 145, 189–236. https://doi.org/10.1037/bul0000182
Petersen, J. (2021). Innovative assessment practices. FreshGrade. Retrieved on 2 August 2022 from https://www.google.com/url?sa=t&source=web&rct=-j&opi=89978449&url=https://learn.sd61.bc.ca/wp-content/uploads/sites/96/2017/09/FG-Innovative-Assessment-Whitepaper.pdf&ved=2ahUKEwjYq_HOq7KGAxVmdmwGHZ4VD30QFnoECBUQAQ&usg=AOvVaw3iXsKxr9XFUtg13M9Jc_Vc
Pradana, M., Elisa, H. P., & Syarifuddin, S. (2023). Discussing ChatGPT in education: A literature review and bibliometric analysis. Cogent Education, 10(2), 2243134. https://doi.org/10.1080/2331186X.2023.2243134
Rawas, S. (2024). ChatGPT: Empowering lifelong learning in the digital age of higher education. Education and Information Technologies, 29, 6895–6908. https://doi.org/10.1007/s10639-023-12114-8
Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121–154. https://doi.org/10.1016/j.iotcps.2023.04.003
Ribeiro, M. T., Wu, T. S., Guestrin, C., & Singh, S. (2020). Beyond accuracy: Behavioral testing of NLP models with CheckList. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 4902–4912). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.442
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learningand Teaching, 6(1), 342–363. https://doi.org/10.37074/jalt.2023.6.1.9
Rueda, M., Cerero, J., Batanero, J., & Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12, 153. https://doi.org/10.3390/computers12080153
Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare (Basel, Switzerland), 11(6), 887. https://doi.org/10.3390/healthcare11060887
Shidiq, M. (2023). The use of artificial intelligence-based Chat-GPT and its challenges for the world of education; From the viewpoint of the development of creative writing skills. Proceeding of International Conference on Education, Society and Humanity, 1(1), 353–357
Shoufan, A. (2023). Exploring students’ perceptions of ChatGPT: Thematic analysis and follow-up survey. IEEE Access, 11, 38805–38818. https://doi.org/10.1109/ACCESS.2023.3268224
Sok, S. (2023, 15 February). Opinion: Benefits and risks of ChatGPT in education. Cambodians. https://cambodianess.com/article/opinion-benefits-and-risks-of-chatgptin-education
Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. Proceedings of the Annual Meeting of the Association for Computational Linguistics, 57, 3645–3650. https://doi.org/10.18653/v1/P19-1355
Strzelecki, A. (2023). Students’ acceptance of ChatGPT in higher education: An extended unified theory of acceptance and use of technology. Innovative Higher Education, 49, 223–245. https://doi.org/10.1007/s10755-023-09686-1
Su, J., & Yang, W. (2023). Unlocking the power of ChatGPT: A framework for applying Generative AI in education. ECNU Review of Education, 6, 1–12. https://doi.org/10.1177/20965311231168423
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environment, 10, 15. https://doi.org/10.1186/s40561-023-00237-x
Wang, W., Chen, Y., & Heffernan, N. (2023). A generative model-based tutoring system for mathword problems. Arxiv. arXiv:2010.04.
Westfall, C. (2023). Educators battle plagiarism as 89% of students admit to using Open AI’s ChatGPT for homework. Forbes, 28 January. https://www.forbes.com/sites/chriswestfall/2023/01/28/educators-battle-plagiarism-as-89-of-studentsadmit-to-using-open-ais-chatgpt-for
Zhang, B. (2023). Preparing educators and students for ChatGPT and AI technology in higher education: Benefits, limitations, strategies, and implications of ChatGPT & AI technologies. https://doi.org/10.13140/RG.2.2.32105.98404
Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., Christiano, P., & Irving, G. (2019). Fine-tuning language models from human preferences. ArXiv. https://doi.org/10.48550/arXiv.1909.08593