Leveraging GPT-4 for Accuracy in Education: A Comparative Study on Retrieval-Augmented Generation in MOOCs

被引:0
|
作者
Miladi, Fatma [1 ]
Psyche, Valery [1 ]
Lemire, Daniel [1 ]
机构
[1] TELUQ Univ, 5800 Rue St Denis, Montreal, PQ H2S 3L5, Canada
关键词
Generative pre-trained transformers; GPT; Evaluation; MOOC; Online learning; Exercises assessments; Retrieval augmented generation;
D O I
10.1007/978-3-031-64315-6_40
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs), have demonstrated remarkable capabilities in natural language processing (NLP). However, these models often encounter challenges such as inaccuracies and hallucinations, which can undermine their utility. Retrieval-Augmented Generation (RAG) has emerged as a promising approach to enhance model accuracy and reliability by integrating external databases. This study investigates the use of RAG to improve the accuracy of GPT models in educational settings, particularly within the realm of Massive Open Online Courses (MOOCs). Through a comparative analysis of various GPT model iterations, we observed a significant improvement in accuracy, increasing from 60% with GPT-3.5 to 80% using the RAG-augmented GPT-4. This enhancement highlights the considerable potential of RAG-augmented GPT models in improving the accuracy of content generation. Such enhanced accuracy suggests revolutionizing assessment methodologies and learning experiences, fostering an educational environment that is more interactive and tailored to individual needs.
引用
收藏
页码:427 / 434
页数:8
相关论文
共 50 条
  • [21] Evaluation of a Retrieval-Augmented Generation-Powered Chatbot for Pre-CT Informed Consent: a Prospective Comparative Study
    Busch, Felix
    Kaibel, Lukas
    Nguyen, Hai
    Lemke, Tristan
    Ziegelmayer, Sebastian
    Graf, Markus
    Marka, Alexander W.
    Endroes, Lukas
    Prucker, Philipp
    Spitzl, Daniel
    Mergen, Markus
    Makowski, Marcus R.
    Bressem, Keno K.
    Petzoldt, Sebastian
    Adams, Lisa C.
    Landgraf, Tim
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2025,
  • [22] ChatGPT as a Source of Information for Bariatric Surgery Patients: a Comparative Analysis of Accuracy and Comprehensiveness Between GPT-4 and GPT-3.5
    Samaan, Jamil S.
    Rajeev, Nithya
    Ng, Wee Han
    Srinivasan, Nitin
    Busam, Jonathan A.
    Yeo, Yee Hui
    Samakar, Kamran
    OBESITY SURGERY, 2024, 34 (05) : 1987 - 1989
  • [23] Comparative analysis of GPT-4, Gemini, and Ernie as gloss sign language translators in special education
    Achraf Othman
    Khansa Chemnad
    Ahmed Tlili
    Ting Da
    Huanhuan Wang
    Ronghuai Huang
    Discover Global Society, 2 (1):
  • [24] Assessing ChatGPT4 with and without retrieval-augmented generation in anticoagulation management for gastrointestinal procedures
    Malik, Sheza
    Kharel, Himal
    Dahiya, Dushyant S.
    Ali, Hassam
    Blaney, Hanna
    Singh, Achintya
    Dhar, Jahnvi
    Perisetti, Abhilash
    Facciorusso, Antonio
    Chandan, Saurabh
    Mohan, Babu P.
    ANNALS OF GASTROENTEROLOGY, 2024, 37 (05): : 514 - 526
  • [25] Feasibility of GPT-3 and GPT-4 for in-Depth Patient Education Prior to Interventional Radiological Procedures: A Comparative Analysis
    Scheschenja, Michael
    Viniol, Simon
    Bastian, Moritz B.
    Wessendorf, Joel
    Koenig, Alexander M.
    Mahnken, Andreas H.
    CARDIOVASCULAR AND INTERVENTIONAL RADIOLOGY, 2024, 47 (02) : 245 - 250
  • [26] Feasibility of GPT-3 and GPT-4 for in-Depth Patient Education Prior to Interventional Radiological Procedures: A Comparative Analysis
    Michael Scheschenja
    Simon Viniol
    Moritz B. Bastian
    Joel Wessendorf
    Alexander M. König
    Andreas H. Mahnken
    CardioVascular and Interventional Radiology, 2024, 47 : 245 - 250
  • [27] Human guided empathetic AI agent for mental health support leveraging reinforcement learning-enhanced retrieval-augmented generation
    Soman, Gayathri
    Judy, M. V.
    Abou, Aadhil Muhammad
    COGNITIVE SYSTEMS RESEARCH, 2025, 90
  • [28] Integrating Small Language Models with Retrieval-Augmented Generation in Computing Education: Key Takeaways, Setup, and Practical Insights
    Yu, Zezhu
    Liu, Suqing
    Denny, Paul
    Bergen, Andreas
    Liut, Michael
    PROCEEDINGS OF THE 56TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, SIGCSE TS 2025, VOL 2, 2025, : 1302 - 1308
  • [29] Integrating Small Language Models with Retrieval-Augmented Generation in Computing Education: Key Takeaways, Setup, and Practical Insights
    Yu, Zezhu
    Liu, Suqing
    Denny, Paul
    Bergen, Andreas
    Liut, Michael
    PROCEEDINGS OF THE 56TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, SIGCSE TS 2025, VOL 1, 2025, : 1302 - 1308
  • [30] Unveiling the Power of Large Language Models: A Comparative Study of Retrieval-Augmented Generation, Fine-Tuning, and Their Synergistic Fusion for Enhanced Performance
    Budakoglu, Gulsum
    Emekci, Hakan
    IEEE ACCESS, 2025, 13 : 30936 - 30951