Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications

被引：1
|
作者：
Herrmann-Werner, Anne [1 ,2 ]
Festl-Wietek, Teresa [1 ]
Holderried, Friederike [1 ,3 ]
Herschbach, Lea [1 ]
Griewatz, Jan [1 ]
Masters, Ken [4 ]
Zipfel, Stephan [2 ]
Mahling, Moritz [1 ,5 ]
机构：
[1] Univ Tubingen, Tubingen Inst Med Educ, Fac Med, Elfriede Aulhorn Str 10, D-72076 Tubingen, Germany
[2] Univ Hosp Tubingen, Dept Psychosomat Med & Psychotherapy, Tubingen, Germany
[3] Univ Tubingen, Tubingen Univ Hosp, Dept Anesthesiol & Intens Care Med, Tubingen, Germany
[4] Sultan Qaboos Univ, Coll Med & Hlth Sci, Med Educ & Informat Dept, Muscat, Oman
[5] Univ Hosp Tubingen, Dept Diabetol Endocrinol Nephrol, Sect Nephrol & Hypertens, Tubingen, Germany
来源：
JOURNAL OF MEDICAL INTERNET RESEARCH | 2024年 / 26卷
关键词：
answer; artificial intelligence; assessment; Bloom's taxonomy; ChatGPT; classification; error; exam; examination; generative; GPT-4; Generative Pre-trained Transformer 4; language model; learning outcome; LLM; MCQ; medical education; medical exam; multiple-choice question; natural language processing; NLP; psychosomatic; question; response; taxonomy;
D O I：
10.2196/57778
中图分类号：
R19 [保健组织与事业（卫生事业管理）];
学科分类号：
摘要：
引用
收藏
页数：2
相关论文
共 50 条
  • [21] Evaluating student performance based on bloom’s taxonomy levels
    Prasad, G.N.R.
    [J]. Journal of Physics: Conference Series, 2021, 1797 (01)
  • [22] More Than Meets the AI: Evaluating the performance of GPT-4 on Computer Graphics assessment questions
    Feng, Tony Haoran
    Denny, Paul
    Wuensche, Burkhard C.
    Luxton-Reilly, Andrew
    Hooper, Steffan
    [J]. PROCEEDINGS OF THE 26TH AUSTRALASIAN COMPUTING EDUCATION CONFERENCE, ACE 2024, 2024, : 182 - 191
  • [23] GPT-4's Performance on the European Board of Interventional Radiology Sample Questions
    Muhammed Said Beşler
    [J]. CardioVascular and Interventional Radiology, 2024, 47 : 683 - 684
  • [24] Evaluating the performance of Generative Pre-trained Transformer-4 (GPT-4) in standardizing radiology reports
    Hasani, Amir M.
    Singh, Shiva
    Zahergivar, Aryan
    Ryan, Beth
    Nethala, Daniel
    Bravomontenegro, Gabriela
    Mendhiratta, Neil
    Ball, Mark
    Farhadi, Faraz
    Malayeri, Ashkan
    [J]. EUROPEAN RADIOLOGY, 2024, 34 (06) : 3566 - 3574
  • [25] GPT-4's Performance on the European Board of Interventional Radiology Sample Questions
    Besler, Muhammed Said
    [J]. CARDIOVASCULAR AND INTERVENTIONAL RADIOLOGY, 2024, 47 (05) : 683 - 684
  • [26] Limitations of GPT-4 in analyzing real-life medical notes related to cognitive impairment
    Shea, Yat-fung
    Ma, Nok-Yee Charlotte
    [J]. PSYCHOGERIATRICS, 2023, 23 (05) : 885 - 887
  • [27] Can AI Think Like a Plastic Surgeon? Evaluating GPT-4's Clinical Judgment in Reconstructive Procedures of the Upper Extremity
    Leypold, Tim
    Schaefer, Benedikt
    Boos, Anja
    Beier, Justus P.
    [J]. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN, 2023, 11 (12) : E5471
  • [28] GPT-4/4V's performance on the Japanese National Medical Licensing Examination
    Kawahara, Tomoki
    Sumi, Yuki
    [J]. MEDICAL TEACHER, 2024,
  • [29] Evaluating GPT-4 as an academic support tool for clinicians: A comparative analysis of case records from the literature
    Fonseca Magalhaes Filho, M. A.
    Aguiar Junior, P. N.
    Fabre, B. L.
    Marques, F.
    Gutierres, B.
    William Junior, W. Nassib
    Del Giglio, A.
    [J]. ANNALS OF ONCOLOGY, 2023, 34 : S729 - S729
  • [30] Harnessing ChatGPT and GPT-4 for evaluating the rheumatology questions of the Spanish access exam to specialized medical training
    Madrid-Garcia, Alfredo
    Rosales-Rosado, Zulema
    Freites-Nunez, Dalifer
    Perez-Sancristobal, Ines
    Pato-Cour, Esperanza
    Plasencia-Rodriguez, Chamaida
    Cabeza-Osorio, Luis
    Abasolo-Alcazar, Lydia
    Leon-Mateos, Leticia
    Fernandez-Gutierrez, Benjamin
    Rodriguez-Rodriguez, Luis
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01):
12345