Leveraging GPT-4 for Accuracy in Education: A Comparative Study on Retrieval-Augmented Generation in MOOCs

被引:0
|
作者
Miladi, Fatma [1 ]
Psyche, Valery [1 ]
Lemire, Daniel [1 ]
机构
[1] TELUQ Univ, 5800 Rue St Denis, Montreal, PQ H2S 3L5, Canada
关键词
Generative pre-trained transformers; GPT; Evaluation; MOOC; Online learning; Exercises assessments; Retrieval augmented generation;
D O I
10.1007/978-3-031-64315-6_40
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs), have demonstrated remarkable capabilities in natural language processing (NLP). However, these models often encounter challenges such as inaccuracies and hallucinations, which can undermine their utility. Retrieval-Augmented Generation (RAG) has emerged as a promising approach to enhance model accuracy and reliability by integrating external databases. This study investigates the use of RAG to improve the accuracy of GPT models in educational settings, particularly within the realm of Massive Open Online Courses (MOOCs). Through a comparative analysis of various GPT model iterations, we observed a significant improvement in accuracy, increasing from 60% with GPT-3.5 to 80% using the RAG-augmented GPT-4. This enhancement highlights the considerable potential of RAG-augmented GPT models in improving the accuracy of content generation. Such enhanced accuracy suggests revolutionizing assessment methodologies and learning experiences, fostering an educational environment that is more interactive and tailored to individual needs.
引用
收藏
页码:427 / 434
页数:8
相关论文
共 50 条
  • [1] Using the Retrieval-Augmented Generation Technique to Improve the Performance of GPT-4 in Answering Quran Questions
    Alnefaie, Sarah
    Atwell, Eric
    Alsalka, Mohammed Ammar
    2024 6TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING, ICNLP 2024, 2024, : 377 - 381
  • [2] Leveraging Lecture Content for Improved Feedback: Explorations with GPT-4 and Retrieval Augmented Generation
    Jacobs, Sven
    Jaschke, Steffen
    2024 36TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING EDUCATION AND TRAINING, CSEE & T 2024, 2024,
  • [3] Retrieval-augmented generation improves precision and trust of a GPT-4 model for emergency radiology diagnosis and classification: a proof-of-concept study
    Fink, Anna
    Nattenmueller, Johanna
    Rau, Stephan
    Rau, Alexander
    Tran, Hien
    Bamberg, Fabian
    Reisert, Marco
    Kotter, Elmar
    Diallo, Thierno
    Russe, Maximilian F.
    EUROPEAN RADIOLOGY, 2025,
  • [4] A retrieval-augmented chatbot based on GPT-4 provides appropriate differential diagnosis in gastrointestinal radiology: a proof of concept study
    Rau, Stephan
    Rau, Alexander
    Nattenmueller, Johanna
    Fink, Anna
    Bamberg, Fabian
    Reisert, Marco
    Russe, Maximilian F.
    EUROPEAN RADIOLOGY EXPERIMENTAL, 2024, 8 (01)
  • [5] Leveraging Retrieval-Augmented Generation for Swahili Language Conversation Systems
    Ndimbo, Edmund V.
    Luo, Qin
    Fernando, Gimo C.
    Yang, Xu
    Wang, Bang
    APPLIED SCIENCES-BASEL, 2025, 15 (02):
  • [6] Enhancement of the Performance of Large Language Models inDiabetes Education through Retrieval-Augmented Generation:Comparative Study
    Wang, Dingqiao
    Liang, Jiangbo
    Ye, Jinguo
    Li, Jingni
    Li, Jingpeng
    Zhang, Qikai
    Hu, Qiuling
    Pan, Caineng
    Wang, Dongliang
    Liu, Zhong
    Shi, Wen
    Shi, Danli
    Li, Fei
    Qu, Bo
    Zheng, Yingfeng
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26
  • [7] Improving accuracy of GPT-3/4 results on biomedical data using a retrieval-augmented language model
    Soong, David
    Sridhar, Sriram
    Si, Han
    Wagner, Jan-Samuel
    Sa, Ana Caroline Costa
    Yu, Christina Y.
    Karagoz, Kubra
    Guan, Meijian
    Kumar, Sanyam
    Hamadeh, Hisham
    Higgs, Brandon W.
    PLOS DIGITAL HEALTH, 2024, 3 (08):
  • [8] Using Structured Queries versus Retrieval Augmented Generation Enabled GPT-4 to Phenotype Atherosclerotic Cardiovascular Disease
    Unlu, Ozan
    Shin, Jiyeon
    Zelle, David
    Wagholikar, Kavishwar
    Hassan, Shahzad
    Chang, Lee-Shing
    Colling, Caitlin
    Gabovitch, Dan
    Oates, Michael
    Varugheese, Matthew
    Wang, Fei
    Mailly, Charlotte
    Scirica, Benjamin
    Aronson, Samuel
    Blood, Alexander
    CIRCULATION, 2024, 150
  • [9] Potential for GPT Technology to Optimize Future Clinical Decision-Making Using Retrieval-Augmented Generation
    Calvin Wang
    Joshua Ong
    Chara Wang
    Hannah Ong
    Rebekah Cheng
    Dennis Ong
    Annals of Biomedical Engineering, 2024, 52 : 1115 - 1118
  • [10] Potential for GPT Technology to Optimize Future Clinical Decision-Making Using Retrieval-Augmented Generation
    Wang, Calvin
    Ong, Joshua
    Wang, Chara
    Ong, Hannah
    Cheng, Rebekah
    Ong, Dennis
    ANNALS OF BIOMEDICAL ENGINEERING, 2024, 52 (05) : 1115 - 1118