Leveraging GPT-4 for Accuracy in Education: A Comparative Study on Retrieval-Augmented Generation in MOOCs

被引:0
|
作者
Miladi, Fatma [1 ]
Psyche, Valery [1 ]
Lemire, Daniel [1 ]
机构
[1] TELUQ Univ, 5800 Rue St Denis, Montreal, PQ H2S 3L5, Canada
关键词
Generative pre-trained transformers; GPT; Evaluation; MOOC; Online learning; Exercises assessments; Retrieval augmented generation;
D O I
10.1007/978-3-031-64315-6_40
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs), have demonstrated remarkable capabilities in natural language processing (NLP). However, these models often encounter challenges such as inaccuracies and hallucinations, which can undermine their utility. Retrieval-Augmented Generation (RAG) has emerged as a promising approach to enhance model accuracy and reliability by integrating external databases. This study investigates the use of RAG to improve the accuracy of GPT models in educational settings, particularly within the realm of Massive Open Online Courses (MOOCs). Through a comparative analysis of various GPT model iterations, we observed a significant improvement in accuracy, increasing from 60% with GPT-3.5 to 80% using the RAG-augmented GPT-4. This enhancement highlights the considerable potential of RAG-augmented GPT models in improving the accuracy of content generation. Such enhanced accuracy suggests revolutionizing assessment methodologies and learning experiences, fostering an educational environment that is more interactive and tailored to individual needs.
引用
收藏
页码:427 / 434
页数:8
相关论文
共 50 条
  • [31] The Accuracy and Potential Racial and Ethnic Biases of GPT-4 in the Diagnosis and Triage of Health Conditions: Evaluation Study
    Ito, Naoki
    Kadomatsu, Sakina
    Fujisawa, Mineto
    Fukaguchi, Kiyomitsu
    Ishizawa, Ryo
    Kanda, Naoki
    Kasugai, Daisuke
    Nakajima, Mikio
    Goto, Tadahiro
    Tsugawa, Yusuke
    JMIR MEDICAL EDUCATION, 2023, 9
  • [32] Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation
    Phung, Tung
    Padurean, Victor-Alexandru
    Singh, Anjali
    Brooks, Christopher
    Cambronero, Jose
    Gulwani, Sumit
    FOURTEENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, LAK 2024, 2024, : 12 - 23
  • [33] Utilizing GPT-4 and generative artificial intelligence platforms for surgical education: an experimental study on skin ulcers
    Seth, Ishith
    Lim, Bryan
    Cevik, Jevan
    Sofiadellis, Foti
    Ross, Richard J.
    Cuomo, Roberto
    Rozen, Warren M.
    EUROPEAN JOURNAL OF PLASTIC SURGERY, 2024, 47 (01)
  • [34] The Implementation of Multimodal Large Language Models for Hydrological Applications: A Comparative Study of GPT-4 Vision, Gemini, LLaVa, and Multimodal-GPT
    Kadiyala, Likith Anoop
    Mermer, Omer
    Samuel, Dinesh Jackson
    Sermet, Yusuf
    Demir, Ibrahim
    HYDROLOGY, 2024, 11 (09)
  • [35] Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources
    Srinivasan, Nitin
    Samaan, Jamil S.
    Rajeev, Nithya D.
    Kanu, Mmerobasi U.
    Yeo, Yee Hui
    Samakar, Kamran
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2024, 38 (05): : 2522 - 2532
  • [36] Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources
    Nitin Srinivasan
    Jamil S. Samaan
    Nithya D. Rajeev
    Mmerobasi U. Kanu
    Yee Hui Yeo
    Kamran Samakar
    Surgical Endoscopy, 2024, 38 : 2522 - 2532
  • [37] Leveraging GPT-4 for Post Hoc Transformation of Free-text Radiology Reports into Structured Reporting: A Multilingual Feasibility Study
    Adams, Lisa C.
    Truhn, Daniel
    Busch, Felix
    Kader, Avan
    Niehues, Stefan M.
    Makowski, Marcus R.
    Bressem, Keno K.
    RADIOLOGY, 2023, 307 (04)
  • [38] Evaluation of GPT-4's Chest X-Ray Impression Generation: A Reader Study on Performance and Perception
    Ziegelmayer, Sebastian
    Marka, Alexander W.
    Lenhart, Nicolas
    Nehls, Nadja
    Reischl, Stefan
    Harder, Felix
    Sauter, Andreas
    Makowski, Marcus
    Graf, Markus
    Gawlitza, Joshua
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2023, 25
  • [39] Wizard-of-Oz vs. GPT-4: A Comparative Study of Perceived Social Intelligence in HRI Brainstorming
    Vrins, Anita
    Pruss, Ethel
    Ceccato, Caterina
    Prinsen, Jos
    De Rooij, Alwin
    Alimardani, Maryam
    COMPANION OF THE 2024 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2024 COMPANION, 2024, : 1090 - 1094
  • [40] Exploring Diagnostic Precision and Triage Proficiency: A Comparative Study of GPT-4 and Bard in Addressing Common Ophthalmic Complaints
    Zandi, Roya
    Fahey, Joseph D.
    Drakopoulos, Michael
    Bryan, John M.
    Dong, Siyuan
    Bryar, Paul J.
    Bidwell, Ann E.
    Bowen, R. Chris
    Lavine, Jeremy A.
    Mirza, Rukhsana G.
    BIOENGINEERING-BASEL, 2024, 11 (02):