Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications

被引：1
|
作者：
Herrmann-Werner, Anne [1 ,2 ]
Festl-Wietek, Teresa [1 ]
Holderried, Friederike [1 ,3 ]
Herschbach, Lea [1 ]
Griewatz, Jan [1 ]
Masters, Ken [4 ]
Zipfel, Stephan [2 ]
Mahling, Moritz [1 ,5 ]
机构：
[1] Univ Tubingen, Tubingen Inst Med Educ, Fac Med, Elfriede Aulhorn Str 10, D-72076 Tubingen, Germany
[2] Univ Hosp Tubingen, Dept Psychosomat Med & Psychotherapy, Tubingen, Germany
[3] Univ Tubingen, Tubingen Univ Hosp, Dept Anesthesiol & Intens Care Med, Tubingen, Germany
[4] Sultan Qaboos Univ, Coll Med & Hlth Sci, Med Educ & Informat Dept, Muscat, Oman
[5] Univ Hosp Tubingen, Dept Diabetol Endocrinol Nephrol, Sect Nephrol & Hypertens, Tubingen, Germany
来源：
JOURNAL OF MEDICAL INTERNET RESEARCH | 2024年 / 26卷
关键词：
answer; artificial intelligence; assessment; Bloom's taxonomy; ChatGPT; classification; error; exam; examination; generative; GPT-4; Generative Pre-trained Transformer 4; language model; learning outcome; LLM; MCQ; medical education; medical exam; multiple-choice question; natural language processing; NLP; psychosomatic; question; response; taxonomy;
D O I：
10.2196/57778
中图分类号：
R19 [保健组织与事业（卫生事业管理）];
学科分类号：
摘要：
引用
收藏
页数：2
相关论文
共 50 条
  • [41] Harnessing ChatGPT and GPT-4 for evaluating the rheumatology questions of the Spanish access exam to specialized medical training
    Alfredo Madrid-García
    Zulema Rosales-Rosado
    Dalifer Freites-Nuñez
    Inés Pérez-Sancristóbal
    Esperanza Pato-Cour
    Chamaida Plasencia-Rodríguez
    Luis Cabeza-Osorio
    Lydia Abasolo-Alcázar
    Leticia León-Mateos
    Benjamín Fernández-Gutiérrez
    Luis Rodríguez-Rodríguez
    Scientific Reports, 13 (1)
  • [42] Assessing GPT-4's accuracy in answering clinical pharmacological questions on pain therapy
    Stroop, Anna
    Stroop, Tabea
    Alsofy, Samer Zawy
    Wegner, Moritz
    Nakamura, Makoto
    Stroop, Ralf
    BRITISH JOURNAL OF CLINICAL PHARMACOLOGY, 2025,
  • [43] GPT-4 in Education: Evaluating Aptness, Reliability, and Loss of Coherence in Solving Calculus Problems and Grading Submissions
    Gandolfi, Alberto
    INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2025, 35 (01) : 367 - 397
  • [44] Advancements in AI for Gastroenterology Education: An Assessment of OpenAI's GPT-4 and GPT-3.5 in MKSAP Question Interpretation
    Patel, Akash
    Samreen, Isha
    Ahmed, Imran
    AMERICAN JOURNAL OF GASTROENTEROLOGY, 2024, 119 (10S): : S1580 - S1580
  • [45] Comparing Vision-Capable Models, GPT-4 and Gemini, With GPT-3.5 on Taiwan's Pulmonologist Exam
    Chen, Chih-Hsiung
    Hsieh, Kuang-Yu
    Huang, Kuo-En
    Lai, Hsien-Yun
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2024, 16 (08)
  • [46] Online Course Improvement Through GPT-4: Monitoring Student Engagement and Dynamic FAQ Generation
    Lundstrom, Oxana
    Maleki, Neda
    Ahlgren, Fredrik
    2024 IEEE GLOBAL ENGINEERING EDUCATION CONFERENCE, EDUCON 2024, 2024,
  • [47] Evaluating GPT-4V (GPT-4 with Vision) on Detection of Radiologic Findings on Chest Radiographs (May 7, 10.1148/radiol.233270, 2024)
    Zhou, Yiliang
    Ong, Hanley
    Kennedy, Patrick
    Wu, Carol C.
    Kazam, Jacob
    Hentel, Keith
    Flanders, Adam
    Shih, George
    Peng, Yifan
    RADIOLOGY, 2024, 311 (02)
  • [48] Evaluating the GPT-3.5 and GPT-4 Large Language Models for Zero-Shot Classification of South African Violent Event Data
    Kotze, Eduan
    Senekal, Burgert A.
    2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, BIG DATA, COMPUTING AND DATA COMMUNICATION SYSTEMS, ICABCD 2024, 2024,
  • [49] Assessing GPT-4's diagnostic accuracy with darker skin tones: underperformance and implications
    Akuffo-Addo, Edgar
    Samman, Luna
    Munawar, Leena
    Akbik, Maya
    Kokikian, Nelly
    Wescott, Raquel
    Wu, Jashin J.
    CLINICAL AND EXPERIMENTAL DERMATOLOGY, 2024, 49 (10) : 1244 - 1245
  • [50] Investigating the diagnostic accuracy of GPT-4's novel image analytics feature in dermatology
    Mackenzie, E. M.
    Sanabria, B.
    Tchack, M.
    Khan, S.
    Rao, B.
    JOURNAL OF THE EUROPEAN ACADEMY OF DERMATOLOGY AND VENEREOLOGY, 2024, 38 (11) : e954 - e956
12345