Prospects for ChatGPT Application in Higher Education: A Scoping Review of International Research

Cover Page


Cite item

Full Text

Abstract

Introduction. The arrival of advanced Generative Pre-Trained Transformer (GPT) in late 2022 resulted in a wide spread of the technology, capable of generating texts of any genres, complexity, and styles. Written communication embraces all spheres of human educational and professional activities that caused a lightning speed at which the technology was introduced into education, science, journalism, mass communication, medicine, etc. The academic community is vigorously discussing the plausible consequences and potential of ChatGPT for various domains, especially education, medicine, and science at large. The review seeks to analyze international publications on ChatGPT’s impact and potential in higher education and to identify the key lines of research. Materials and Methods. Based on the PRISMA methodology the authors selected 190 articles and reviews indexed in the Scopus database with the inclusion criteria in focus (period, languages, field, themes). The publications were analyzed and distributed among seven thematic clusters.

Results. As a result of the analysis of the publications, the following clusters were formed: higher education (71 documents), education in various areas (37 documents), writing and language learning (24 documents), assessment in educational systems (22 documents), medical education (18 documents), ethical issues and academic integrity (15 documents), and perception of ChatGPT on part of students and educators (12 documents).

Discussion and Conclusion. The analysis of the ChatGPT potential and negative aspects in higher education allows for singling out the subject areas where the most essential transformations will take place: assessment of knowledge and skills, information credibility, scope of competence and skills formed in higher education, ethical issues of research, various aspects of professional training. The authors’ conclusions correlate with the reviews on ChatGPT published earlier. Addressing the new challenges requires the system of education to be transformed, new forms of learning and assessment to be introduced. The review results may be applied in further research on the topic. Given a skyrocketing rise in the number of publications on ChatGPT, researchers ought to keep track of new research in the emerging subject area.

About the authors

Lilia K. Raitskaya

MGIMO University

Author for correspondence.
Email: raitskaya.l.k@inno.mgimo.ru
ORCID iD: 0000-0003-2086-6090
Scopus Author ID: 57208394639
ResearcherId: F-2448-2017

Dr.Sci. (Ped.), Cand.Sci. (Econ.), Associated Professor, Professor of the Department of Pedagogy and Psychology

Russian Federation, Moscow

Maya R. Lambovska

University of National and World Economy

Email: mlambovska@abv.bg
ORCID iD: 0000-0003-3285-3051
Scopus Author ID: 55308087500
ResearcherId: I-7986-2016

Dr.Sci. (Management), Ph.D. (Management), Professor of the Department of Management

Bulgaria, Sofia

References

  1. Raitskaya L., Tikhonova E. Covid-19: An Impromptu or Trend-setting Factor in Research on Language and Education? Journal of Language and Education. 2021;7(4):9–15. https://doi.org/10.17323/jle.2021.13458
  2. Firat M. What ChatGPT Means for Universities: Perceptions of Scholars and Students. Journal of Applied Learning & Teaching. 2023;6(1):57–63. https://doi.org/10.37074/jalt.2023.6.1.22
  3. Misra D.P., Chandwar K. ChatGPT, Artificial Intelligence and Scientific Writing: What Authors, Peer Reviewers and Editors Should Know? Journal of the Royal College of Physicians of Edinburgh. 2023;53(2):90–93. http://doi.org/10.1177/14782715231181023
  4. King M.R., ChatGPT. A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education. Cellular and Molecular Bioengineering. 2023;16:1–2. https://doi.org/10.1007/s12195-022-00754-8
  5. Tang G. Academic Journals Cannot Simply Require Authors to Declare That They Used ChatGPT. Irish Journal of Medical Science. 2023;192:3195–3196. https://doi.org/10.1007/s11845-023-03374-x
  6. Hufton A.L. No Artificial Intelligence Authors, for Now. Patterns. 2023;4(4):100731. https://doi. org/10.1016/j.patter.2023.100731
  7. Stokel-Walker C. ChatGPT Listed as Author on Research Papers: Many Scientists Disapprove. Nature. 2023;613:620–621. https://doi.org/10.1038/d41586-023-00107-z
  8. Holden Thorp H. ChatGPT is Fun, but Not an Author. Science. 2023;379(6630):313. http://doi.org/10.1126/ science.adg7879
  9. Ipek Z.H., Gözüm A.İ.C., Papadakis S., Kallogiannakis M. Educational Applications of the ChatGPT AI System: A Systematic Review Research. Educational Process: International Journal. 2023;12(3):26–55. https:// doi.org/10.22521/edupij.2023.123.2
  10. Steele J.L. To GPT or Not GPT? Empowering Our Students to Learn with AI. Computers and Education: Artificial Intelligence. 2023;5:100160. https://doi.org/10.1016/j.caeai.2023.100160
  11. Tikhonova E., Raitskaya L. ChatGPT: Where Is a Silver Lining? Exploring the Realm of GPT and Large Language Models. Journal of Language and Education. 2023;9(3):5–11. https://doi.org/10.17323/jle.2023.18119
  12. Gilson A., Safranek C.W., Huang T., Socrates V., Chi L., Taylor R.A., et al. How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Medical Education. 2023;9:e45312. https://doi.org/10.2196/45312
  13. Giannos P., Delardas O. Performance of ChatGPT on UK Standardized Admission Tests: Insights from the BMAT, TMUA, LNAT, and TSA Examinations. JMIR Medical Education. 2023;9:e47737. https://doi. org/10.2196/47737
  14. Arksey H., O’Malley L. Scoping Studies: Towards a Methodological Framework. International Journal of Social Research Methodology. 2005;8(1):19–32. https://doi.org/10.1080/1364557032000119616
  15. Huber E., Harris L., Wright S., White A., Raduescu C., Zeivots S., et al. Towards a Framework for Designing and Evaluating Online Assessments in Business Education. Assessment & Evaluation in Higher Education. 2024;49(1):102–116. https://doi.org/10.1080/02602938.2023.2183487
  16. Kikalishvili S. Unlocking the Potential of GPT-3 in Education: Opportunities, Limitations, and Recommendations for Effective Integration. Interactive Learning Environments. 2023. https://doi.org/10.1080/104948 20.2023.2220401
  17. Lodge J.M., Thompson K., Corrin L. Mapping out a Research Agenda for Generative Artificial Intelligence in Tertiary Education. Australasian Journal of Educational Technology. 2023;39(1):1–8. https://doi. org/10.14742/ajet.8695
  18. Qasem F. ChatGPT in Scientific and Academic Research: Future Fears and Reassurances. Library Hi Tech News. 2023;40(3):30–32. https://doi.org/10.1108/LHTN-03-2023-0043
  19. Karakose T. The Utility of ChatGPT in Educational Research – Potential Opportunities and Pitfalls. Educational Process: International Journal. 2023;12(2):7–13. https://doi.org/10.22521/edupij.2023.122.1
  20. Ivakhnenko E.N., Nikolskiy V.S. ChatGPT in Higher Education and Science: A Threat or a Valuable Resource? Higher Education in Russia. 2023;32(4):9–22. (In Russ., abstract in Eng.) http://doi.org/10.31992/08693617-2023-32-4-9-22
  21. Birenbaum M. The Chatbots’ Challenge to Education: Disruption or Destruction? Education Sciences. 2023;13(7):711. https://doi.org/10.3390/educsci13070711
  22. Lund B.D., Wang T. Chatting about ChatGPT: How May AI and GPT Impact Academia and Libraries? Library Hi Tech News. 2023;40(3):26–29. https://doi.org/10.1108/LHTN-01-2023-0009
  23. Lo C.K. What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences. 2023;13(4):410. https://doi.org/10.3390/educsci13040410
  24. Kooli C. Сhatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions. Sustainability. 2023;15(7):5614. https://doi.org/10.3390/su15075614
  25. Fuchs K. Exploring the Opportunities and Challenges of NLP Models in Higher Education: Is ChatGPT a Blessing or a Curse? Frontiers in Education. 2023;8:1166682. https://doi.org/10.3389/feduc.2023.1166682
  26. Su J., Yang W. Unlocking the Power of ChatGPT: A Framework for Applying Generative AI in Education. ECNU Review of Education. 2023;6(3):355–366. https://doi.org/10.1177/20965311231168423
  27. Alasadi E.A., Baiz C.R. Generative AI in Education and Research: Opportunities, Concerns, and Solutions. Journal of Chemical Education. 2023;100(8):2965–2971. https://doi.org/10.1021/acs.jchemed.3c00323
  28. Crompton H., Burke D. Artificial Intelligence in Higher Education: The State of the Field. International Journal of Educational Technology in Higher Education. 2023;20:22. https://doi.org/10.1186/s41239-023-00392-8
  29. Chang D.H., Lin M.P.-C., Hajian S., Wang Q.Q. Educational Design Principles of Using AI Chatbot That Supports Self-Regulated Learning in Education: Goal Setting, Feedback, and Personalization. Sustainability. 2023;15(17):12921. https://doi.org/10.3390/su151712921
  30. Alshahrani A. The Impact of ChatGPT on Blended Learning: Current Trends and Future Research Directions. International Journal of Data and Network Science. 2023;7(4):2029–2040. https://doi.org/10.5267/j. ijdns.2023.6.010
  31. Pavlik J.V. Collaborating with ChatGPT: Considering the Implications of Generative Artificial Intelligence for Journalism and Media Education. Journalism & Mass Communication Educator. 2023;78(1):84–93. https:// doi.org/10.1177/10776958221149577
  32. Cooper G. Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology. 2023;32:444–452. https://doi.org/10.1007/s10956-023-10039-y
  33. Thurzo A., Strunga M., Urban R., Surovková J., Afrashtehfar K.I. Impact of Artificial Intelligence on Dental Education: A Review and Guide for Curriculum Update. Education Sciences. 2023;13(2):150. https://doi. org/10.3390/educsci13020150
  34. Clark T.M. Investigating the Use of an Artificial Intelligence Chatbot with General Chemistry Exam Questions. Journal of Chemical Education. 2023;100(5):1905–1916. https://doi.org/10.1021/acs.jchemed.3c00027
  35. Seney V., Desroches M.L., Schuler M.S. Using ChatGPT to Teach Enhanced Clinical Judgment in Nursing Education. Nurse Educator. 2023;48(3):124. https://doi.org/10.1097/NNE.0000000000001383
  36. Kohnke L., Moorhouse B.L., Zou D. ChatGPT for Language Teaching and Learning. RELC Journal. 2023;54(2):537–550. https://doi.org/10.1177/00336882231162868
  37. Barrot J.S. Using ChatGPT for Second Language Writing: Pitfalls and Potentials. Assessing Writing. 2023;57:100745. https://doi.org/10.1016/j.asw.2023.100745
  38. Liu G., Ma C. Measuring EFL Learners’ Use of ChatGPT in Informal Digital Learning of English Based on the Technology Acceptance Model. Innovation in Language Learning and Teaching. 2023. https://doi.org/10.1080/17501229.2023.2240316
  39. Mahyoob M., Algaraady J., Alblwi A. A Proposed Framework for Human-like Language Processing of ChatGPT in Academic Writing. International Journal of Emerging Technologies in Learning (iJET). 2023;18(14):282–293. https://doi.org/10.3991/ijet.v18i14.41725
  40. Abd-Alrazaq A., AlSaad R., Alhuwail D., Ahmed A., Healy P.M., Latifi S., et al. Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions. JMIR Medical Education. 2023;9:e48291. https://doi.org/10.2196/48291
  41. Rudolph J., Tan S., Tan S. ChatGPT: Bullshit Spewer or the End of Traditional Assessments in Higher Education? Journal of Applied Learning & Teaching. 2023;6(1):342–363. https://doi.org/10.37074/jalt.2023.6.1.9
  42. Farazouli A., Cerratto-Pargman T., Bolander-Laksov K., McGrath C. Hello GPT! Goodbye Home Examination? An Exploratory Study of AI Chatbots Impact on University Teachers’ Assessment Practices. Assessment & Evaluation in Higher Education. 2023. https://doi.org/10.1080/02602938.2023.2241676
  43. Mizumoto A., Eguchi M. Exploring the Potential of Using an AI Language Model for Automated Essay Scoring. Research Methods in Applied Linguistics. 2023;2(2):100050. https://doi.org/10.1016/j.rmal.2023.100050
  44. Gorichanaz T. Accused: How Students Respond to Allegations of Using ChatGPT on Assessments. Learning: Research & Practice. 2023;9(2):183–196. https://doi.org/10.1080/23735082.2023.2254787
  45. Ho W.L.J., Koussayer B., Sujka J. ChatGPT: Friend or Foe in Medical Writing? An Example of How ChatGPT Can Be Utilized in Writing Case Reports. Surgery in Practice and Science. 2023;14:100185. https://doi. org/10.1016/j.sipas.2023.100185
  46. Cotton D.R.E., Cotton P.A., Shipway J.R. Chatting and Cheating: Ensuring Academic Integrity in the Era of ChatGPT. Innovations in Education and Teaching International. 2023. https://doi.org/10.1080/14703297.202 3.2190148
  47. Fyfe P. How to Cheat on Your Final Paper: Assigning AI for Student Writing. AI and Society. 2023;38:1395–1405. https://doi.org/10.1007/s00146-022-01397-z
  48. Illia L., Colleoni E., Zyglidopoulos S. Ethical Implications of Text Generation in the Age of Artificial Intelligence. Business Ethics, Environment and Responsibility. 2023;32(1):201–210. https://doi.org/10.1111/ beer.12479
  49. Yeo M.A. Academic Integrity in the Age of Artificial Intelligence (AI) Authoring Apps. TESOL Journal. 2023;14(3):e716. https://doi.org/10.1002/tesj.716
  50. Sullivan M., Kelly A., McLaughlan P. ChatGPT in Higher Education: Considerations for Academic Integrity and Student Learning. Journal of Applied Learning & Teaching. 2023;6(1):31–40. https://doi.org/10.37074/ jalt.2023.6.1.17
  51. Ngo T.T.A. The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning. 2023;18(17):4–19. https://doi.org/10.3991/ijet.v18i17.39019

Supplementary files

Supplementary Files
Action
1. JATS XML
Download

Copyright (c) 2024 Раицкая Л.K., Ламбовска М.R.

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Founded in 1996
Registry Entry: PI № FS 77-70142 of June 16, 2017

Согласие на обработку персональных данных с помощью сервиса «Яндекс.Метрика»

1. Я (далее – «Пользователь» или «Субъект персональных данных»), осуществляя использование сайта https://journals.rcsi.science/ (далее – «Сайт»), подтверждая свою полную дееспособность даю согласие на обработку персональных данных с использованием средств автоматизации Оператору - федеральному государственному бюджетному учреждению «Российский центр научной информации» (РЦНИ), далее – «Оператор», расположенному по адресу: 119991, г. Москва, Ленинский просп., д.32А, со следующими условиями.

2. Категории обрабатываемых данных: файлы «cookies» (куки-файлы). Файлы «cookie» – это небольшой текстовый файл, который веб-сервер может хранить в браузере Пользователя. Данные файлы веб-сервер загружает на устройство Пользователя при посещении им Сайта. При каждом следующем посещении Пользователем Сайта «cookie» файлы отправляются на Сайт Оператора. Данные файлы позволяют Сайту распознавать устройство Пользователя. Содержимое такого файла может как относиться, так и не относиться к персональным данным, в зависимости от того, содержит ли такой файл персональные данные или содержит обезличенные технические данные.

3. Цель обработки персональных данных: анализ пользовательской активности с помощью сервиса «Яндекс.Метрика».

4. Категории субъектов персональных данных: все Пользователи Сайта, которые дали согласие на обработку файлов «cookie».

5. Способы обработки: сбор, запись, систематизация, накопление, хранение, уточнение (обновление, изменение), извлечение, использование, передача (доступ, предоставление), блокирование, удаление, уничтожение персональных данных.

6. Срок обработки и хранения: до получения от Субъекта персональных данных требования о прекращении обработки/отзыва согласия.

7. Способ отзыва: заявление об отзыве в письменном виде путём его направления на адрес электронной почты Оператора: info@rcsi.science или путем письменного обращения по юридическому адресу: 119991, г. Москва, Ленинский просп., д.32А

8. Субъект персональных данных вправе запретить своему оборудованию прием этих данных или ограничить прием этих данных. При отказе от получения таких данных или при ограничении приема данных некоторые функции Сайта могут работать некорректно. Субъект персональных данных обязуется сам настроить свое оборудование таким способом, чтобы оно обеспечивало адекватный его желаниям режим работы и уровень защиты данных файлов «cookie», Оператор не предоставляет технологических и правовых консультаций на темы подобного характера.

9. Порядок уничтожения персональных данных при достижении цели их обработки или при наступлении иных законных оснований определяется Оператором в соответствии с законодательством Российской Федерации.

10. Я согласен/согласна квалифицировать в качестве своей простой электронной подписи под настоящим Согласием и под Политикой обработки персональных данных выполнение мною следующего действия на сайте: https://journals.rcsi.science/ нажатие мною на интерфейсе с текстом: «Сайт использует сервис «Яндекс.Метрика» (который использует файлы «cookie») на элемент с текстом «Принять и продолжить».