Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications

被引：1
|
作者：
Herrmann-Werner, Anne [1 ,2 ]
Festl-Wietek, Teresa [1 ]
Holderried, Friederike [1 ,3 ]
Herschbach, Lea [1 ]
Griewatz, Jan [1 ]
Masters, Ken [4 ]
Zipfel, Stephan [2 ]
Mahling, Moritz [1 ,5 ]
机构：
[1] Univ Tubingen, Tubingen Inst Med Educ, Fac Med, Elfriede Aulhorn Str 10, D-72076 Tubingen, Germany
[2] Univ Hosp Tubingen, Dept Psychosomat Med & Psychotherapy, Tubingen, Germany
[3] Univ Tubingen, Tubingen Univ Hosp, Dept Anesthesiol & Intens Care Med, Tubingen, Germany
[4] Sultan Qaboos Univ, Coll Med & Hlth Sci, Med Educ & Informat Dept, Muscat, Oman
[5] Univ Hosp Tubingen, Dept Diabetol Endocrinol Nephrol, Sect Nephrol & Hypertens, Tubingen, Germany
来源：
JOURNAL OF MEDICAL INTERNET RESEARCH | 2024年 / 26卷
关键词：
answer; artificial intelligence; assessment; Bloom's taxonomy; ChatGPT; classification; error; exam; examination; generative; GPT-4; Generative Pre-trained Transformer 4; language model; learning outcome; LLM; MCQ; medical education; medical exam; multiple-choice question; natural language processing; NLP; psychosomatic; question; response; taxonomy;
D O I：
10.2196/57778
中图分类号：
R19 [保健组织与事业（卫生事业管理）];
学科分类号：
摘要：
引用
收藏
页数：2
相关论文
共 50 条
  • [31] Evaluating the performance of Generative Pre-trained Transformer-4 (GPT-4) in standardizing radiology reports
    Hasani, Amir M.
    Singh, Shiva
    Zahergivar, Aryan
    Ryan, Beth
    Nethala, Daniel
    Bravomontenegro, Gabriela
    Mendhiratta, Neil
    Ball, Mark
    Farhadi, Faraz
    Malayeri, Ashkan
    EUROPEAN RADIOLOGY, 2024, 34 (06) : 3566 - 3574
  • [32] Limitations of GPT-4 in analyzing real-life medical notes related to cognitive impairment
    Shea, Yat-fung
    Ma, Nok-Yee Charlotte
    PSYCHOGERIATRICS, 2023, 23 (05) : 885 - 887
  • [33] Evaluating the accuracy, time and cost of GPT-4 and GPT-4o in liver disease diagnoses using cases from "What is Your Diagnosis"
    Guo, Yusheng
    Li, Tianxiang
    Xie, Jiao
    Luo, Miao
    Zheng, Chuansheng
    JOURNAL OF HEPATOLOGY, 2025, 82 (01) : e15 - e17
  • [34] Can AI Think Like a Plastic Surgeon? Evaluating GPT-4's Clinical Judgment in Reconstructive Procedures of the Upper Extremity
    Leypold, Tim
    Schaefer, Benedikt
    Boos, Anja
    Beier, Justus P.
    PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN, 2023, 11 (12) : E5471
  • [35] GPT-4/4V's performance on the Japanese National Medical Licensing Examination
    Kawahara, Tomoki
    Sumi, Yuki
    MEDICAL TEACHER, 2025, 47 (03) : 450 - 457
  • [36] Navigating Nephrology's Decline Through a GPT-4 Analysis of Internal Medicine Specialties in the United States: Qualitative Study
    Miao, Jing
    Thongprayoon, Charat
    Valencia, Oscar Garcia
    Craici, Iasmina M.
    Cheungpasitporn, Wisit
    JMIR MEDICAL EDUCATION, 2024, 10
  • [37] Evaluating Software Inspection Cognition Levels Using Bloom's Taxonomy
    McMeekin, David A.
    von Konsky, Brian R.
    Chang, Elizabeth
    Cooper, David J. A.
    22ND CONFERENCE ON SOFTWARE ENGINEERING EDUCATION AND TRAINING, PROCEEDINGS, 2009, : 232 - 239
  • [38] Harnessing ChatGPT and GPT-4 for evaluating the rheumatology questions of the Spanish access exam to specialized medical training
    Madrid-Garcia, Alfredo
    Rosales-Rosado, Zulema
    Freites-Nunez, Dalifer
    Perez-Sancristobal, Ines
    Pato-Cour, Esperanza
    Plasencia-Rodriguez, Chamaida
    Cabeza-Osorio, Luis
    Abasolo-Alcazar, Lydia
    Leon-Mateos, Leticia
    Fernandez-Gutierrez, Benjamin
    Rodriguez-Rodriguez, Luis
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [39] Evaluating GPT-4 as an academic support tool for clinicians: A comparative analysis of case records from the literature
    Fonseca Magalhaes Filho, M. A.
    Aguiar Junior, P. N.
    Fabre, B. L.
    Marques, F.
    Gutierres, B.
    William Junior, W. Nassib
    Del Giglio, A.
    ANNALS OF ONCOLOGY, 2023, 34 : S729 - S729
  • [40] Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks
    Sottana, Andrea
    Liang, Bin
    Zou, Kai
    Yuan, Zheng
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 8776 - 8788
12345