Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications

被引:1
|
作者
Herrmann-Werner, Anne [1 ,2 ]
Festl-Wietek, Teresa [1 ]
Holderried, Friederike [1 ,3 ]
Herschbach, Lea [1 ]
Griewatz, Jan [1 ]
Masters, Ken [4 ]
Zipfel, Stephan [2 ]
Mahling, Moritz [1 ,5 ]
机构
[1] Univ Tubingen, Tubingen Inst Med Educ, Fac Med, Elfriede Aulhorn Str 10, D-72076 Tubingen, Germany
[2] Univ Hosp Tubingen, Dept Psychosomat Med & Psychotherapy, Tubingen, Germany
[3] Univ Tubingen, Tubingen Univ Hosp, Dept Anesthesiol & Intens Care Med, Tubingen, Germany
[4] Sultan Qaboos Univ, Coll Med & Hlth Sci, Med Educ & Informat Dept, Muscat, Oman
[5] Univ Hosp Tubingen, Dept Diabetol Endocrinol Nephrol, Sect Nephrol & Hypertens, Tubingen, Germany
关键词
answer; artificial intelligence; assessment; Bloom's taxonomy; ChatGPT; classification; error; exam; examination; generative; GPT-4; Generative Pre-trained Transformer 4; language model; learning outcome; LLM; MCQ; medical education; medical exam; multiple-choice question; natural language processing; NLP; psychosomatic; question; response; taxonomy;
D O I
10.2196/57778
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
引用
收藏
页数:2
相关论文
共 50 条
  • [1] Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications
    Huang, Kuan-Ju
    [J]. JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26
  • [2] Is GPT-4 a reliable rater? Evaluating consistency in GPT-4's text ratings
    Hackl, Veronika
    Mueller, Alexandra Elena
    Granitzer, Michael
    Sailer, Maximilian
    [J]. FRONTIERS IN EDUCATION, 2023, 8
  • [3] Evaluating GPT-4's proficiency in addressing cryptography examinations
    Mikhalev, Vasily
    Kopal, Nils
    Esslinger, Bernhard
    [J]. CRYPTOLOGIA, 2024,
  • [4] Re-evaluating GPT-4's bar exam performance
    Martinez, Eric
    [J]. ARTIFICIAL INTELLIGENCE AND LAW, 2024,
  • [5] Mind meets machine: Unravelling GPT-4’s cognitive psychology
    Dhingra, Sifatkaur
    Singh, Manmeet
    S.B., Vaisakh
    Malviya, Neetiraj
    Gill, Sukhpal Singh
    [J]. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2023, 3 (03):
  • [6] Evaluating GPT-4 on Impressions Generation in Radiology Reports
    Sun, Zhaoyi
    Ong, Hanley
    Kennedy, Patrick
    Tang, Liyan
    Chen, Shirley
    Elias, Jonathan
    Lucas, Eugene
    Shih, George
    Peng, Yifan
    [J]. RADIOLOGY, 2023, 307 (05)
  • [7] Evaluating the Utility of OpenAI's GPT-4 as a Diagnostic and Management Aid in Medicine
    Ge, Alan
    Pandya, Vidish
    Ferrick, Kevin J.
    Krumerman, Andrew
    [J]. CIRCULATION, 2023, 148
  • [8] Evaluating the potential of GPT-4 in assisting communication in clinical anaesthesia
    Chen, Wanpei
    Zheng, Zhinan
    Liu, Yang
    [J]. EUROPEAN JOURNAL OF ANAESTHESIOLOGY, 2024, 41 (04) : 321 - 323
  • [9] Transforming academic librarianship through AI reskilling: Insights from the GPT-4 exploration program
    Lo, Leo S.
    [J]. JOURNAL OF ACADEMIC LIBRARIANSHIP, 2024, 50 (03):
  • [10] Examining GPT-4's Capabilities and Enhancement with SocraSynth
    Chang, Edward Y.
    [J]. 2023 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE, CSCI 2023, 2023, : 7 - 14