Leveraging GPT-4 for Accuracy in Education: A Comparative Study on Retrieval-Augmented Generation in MOOCs

被引:0
|
作者
Miladi, Fatma [1 ]
Psyche, Valery [1 ]
Lemire, Daniel [1 ]
机构
[1] TELUQ Univ, 5800 Rue St Denis, Montreal, PQ H2S 3L5, Canada
关键词
Generative pre-trained transformers; GPT; Evaluation; MOOC; Online learning; Exercises assessments; Retrieval augmented generation;
D O I
10.1007/978-3-031-64315-6_40
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs), have demonstrated remarkable capabilities in natural language processing (NLP). However, these models often encounter challenges such as inaccuracies and hallucinations, which can undermine their utility. Retrieval-Augmented Generation (RAG) has emerged as a promising approach to enhance model accuracy and reliability by integrating external databases. This study investigates the use of RAG to improve the accuracy of GPT models in educational settings, particularly within the realm of Massive Open Online Courses (MOOCs). Through a comparative analysis of various GPT model iterations, we observed a significant improvement in accuracy, increasing from 60% with GPT-3.5 to 80% using the RAG-augmented GPT-4. This enhancement highlights the considerable potential of RAG-augmented GPT models in improving the accuracy of content generation. Such enhanced accuracy suggests revolutionizing assessment methodologies and learning experiences, fostering an educational environment that is more interactive and tailored to individual needs.
引用
收藏
页码:427 / 434
页数:8
相关论文
共 50 条
  • [41] Generating credible referenced medical research: A comparative study of openAI's GPT-4 and Google's gemini
    Omar, Mahmud
    Nassar, Saleh
    Hijazi, Kareem
    Glicksberg, Benjamin S.
    Nadkarni, Girish N.
    Klang, Eyal
    Computers in Biology and Medicine, 2025, 185
  • [42] Advantages and pitfalls in utilizing artificial intelligence for crafting medical examinations: a medical education pilot study with GPT-4
    Klang, E.
    Portugez, S.
    Gross, R.
    Lerner, Kassif R.
    Brenner, A.
    Gilboa, M.
    Ortal, T.
    Ron, S.
    Robinzon, V
    Meiri, H.
    Segal, G.
    BMC MEDICAL EDUCATION, 2023, 23 (01)
  • [43] Advantages and pitfalls in utilizing artificial intelligence for crafting medical examinations: a medical education pilot study with GPT-4
    Klang E
    Portugez S
    Gross R
    Kassif Lerner R
    Brenner A
    Gilboa M
    Ortal T
    Ron S
    Robinzon V
    Meiri H
    Segal G
    BMC Medical Education, 23
  • [44] Harnessing Large Language Models for Structured Reporting in Breast Ultrasound: A Comparative Study of Open AI (GPT-4.0) and Microsoft Bing (GPT-4)
    Liu, ChaoXu
    Wei, MinYan
    Qin, Yu
    Zhang, MeiXiang
    Jiang, Huan
    Xu, JiaLe
    Zhang, YuNing
    Hua, Qing
    Hou, YiQing
    Dong, YiJie
    Xia, ShuJun
    Li, Ning
    Zhou, JianQiao
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2024, 50 (11): : 1697 - 1703
  • [45] Assessing AI-generated (GPT-4) Versus Human Created MCQs in Mathematics Education: A Comparative Inquiry into Vector Topics
    Kuusemets, Laura
    Parve, Kristin
    Ain, Kati
    Kraav, Tiina
    INTERNATIONAL JOURNAL OF EDUCATION IN MATHEMATICS SCIENCE AND TECHNOLOGY, 2024, 12 (06):
  • [46] How do large language models answer breast cancer quiz questions? A comparative study of GPT-3.5, GPT-4 and Google Gemini
    Irmici, Giovanni
    Cozzi, Andrea
    Della Pepa, Gianmarco
    De Berardinis, Claudia
    D'Ascoli, Elisa
    Cellina, Michaela
    Ce, Maurizio
    Depretto, Catherine
    Scaperrotta, Gianfranco
    RADIOLOGIA MEDICA, 2024, 129 (10): : 1463 - 1467
  • [47] Integrating retrieval-augmented generation for enhanced personalized physician recommendations in web-based medical services: model development study
    Zheng, Yingbin
    Yan, Yiwei
    Chen, Sai
    Cai, Yunping
    Ren, Kun
    Liu, Yishan
    Zhuang, Jiaying
    Zhao, Min
    FRONTIERS IN PUBLIC HEALTH, 2025, 13
  • [48] Exploring Image Similarity through Generative Language Models: A Comparative Study of GPT-4 with Word Embeddings and Traditional Approaches
    Malla, Alejandro
    Omwenga, Maxwell M.
    Bera, Pallav Kumar
    2024 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY, EIT 2024, 2024, : 275 - 279
  • [49] ChatGPT (GPT-4) versus doctors on complex cases of the Swedish family medicine specialist examination: an observational comparative study
    Arvidsson, Rasmus
    Gunnarsson, Ronny
    Entezarjou, Artin
    Sundemo, David
    Wikberg, Carl
    BMJ OPEN, 2024, 14 (12):
  • [50] Transfer Learning and Lexicon-Based Approaches for Implicit Hate Speech Detection: A Comparative Study of Human and GPT-4 Annotation
    Almohaimeed, Saad
    Almohaimeed, Saleh
    Boloni, Ladislau
    18TH IEEE INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC 2024, 2024, : 142 - 147