Comparative Analysis of Multimodal Large Language Model Performance on Clinical Vignette Questions

被引：7
|
作者：
Han, Tianyu [1 ]
Adams, Lisa C. [2 ]
Bressem, Keno K. [3 ]
Busch, Felix [3 ]
Nebelung, Sven [1 ]
Truhn, Daniel [1 ,4 ]
机构：
[1] Univ Hosp Aachen, Dept Diagnost & Intervent Radiol, Aachen, Germany
[2] Tech Univ Munich, Dept Diagnost & Intervent Radiol, Munich, Germany
[3] Charite Univ Med Berlin, Dept Radiol, Berlin, Germany
[4] Univ Hosp Aachen, Pauwelsstr 30, D-52074 Aachen, Germany
来源：
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION | 2024年 / 331卷 / 15期
关键词：
D O I：
10.1001/jama.2023.27861
中图分类号：
R5 [内科学];
学科分类号：
1002 ; 100201 ;
摘要：
This study compares 2 large language models and their performance vs that of competing open-source models.
引用
收藏
页码：1320 / 1321
页数：2
相关论文
共 50 条
  • [1] Analysis of large-language model versus human performance for genetics questions
    Duong, Dat
    Solomon, Benjamin D.
    [J]. EUROPEAN JOURNAL OF HUMAN GENETICS, 2024, 32 (04) : 466 - 468
  • [2] Analysis of large-language model versus human performance for genetics questions
    Dat Duong
    Benjamin D. Solomon
    [J]. European Journal of Human Genetics, 2024, 32 : 466 - 468
  • [3] Performance of a Large Language Model on Practice Questions for the Neonatal Board Examination
    Beam, Kristyn
    Sharma, Puneet
    Kumar, Bhawesh
    Wang, Cindy
    Brodsky, Dara
    Martin, Camilia R.
    Beam, Andrew
    [J]. JAMA PEDIATRICS, 2023, 177 (09) : 977 - 979
  • [4] Response to correspondence regarding “Analysis of large-language model versus human performance for genetics questions”
    Dat Duong
    Benjamin D. Solomon
    [J]. European Journal of Human Genetics, 2024, 32 : 379 - 380
  • [5] Performance of large language model artificial intelligence on dermatology board exam questions
    Park, Lily
    Ehlert, Brittany
    Susla, Lyudmyla
    Lum, Zachary C.
    Lee, Patrick K.
    [J]. CLINICAL AND EXPERIMENTAL DERMATOLOGY, 2023, 49 (07) : 733 - 734
  • [6] Multimodal large language models for bioimage analysis
    Zhang, Shanghang
    Dai, Gaole
    Huang, Tiejun
    Chen, Jianxu
    [J]. NATURE METHODS, 2024, 21 (08) : 1390 - 1393
  • [7] Performance and risk of harm of a large language model on dermatology continuing medical education questions
    Chen, M. L.
    Cai, Z. Ran
    Kim, J.
    Novoa, R.
    Barnes, L. A.
    Beam, A.
    Linos, E.
    [J]. JOURNAL OF INVESTIGATIVE DERMATOLOGY, 2024, 144 (08) : S25 - S25
  • [8] A medical multimodal large language model for future pandemics
    Liu, Fenglin
    Zhu, Tingting
    Wu, Xian
    Yang, Bang
    You, Chenyu
    Wang, Chenyang
    Lu, Lei
    Liu, Zhangdaihong
    Zheng, Yefeng
    Sun, Xu
    Yang, Yang
    Clifton, Lei
    Clifton, David A.
    [J]. NPJ DIGITAL MEDICINE, 2023, 6 (01)
  • [9] A medical multimodal large language model for future pandemics
    Fenglin Liu
    Tingting Zhu
    Xian Wu
    Bang Yang
    Chenyu You
    Chenyang Wang
    Lei Lu
    Zhangdaihong Liu
    Yefeng Zheng
    Xu Sun
    Yang Yang
    Lei Clifton
    David A. Clifton
    [J]. npj Digital Medicine, 6
  • [10] Large language model to multimodal large language model: A journey to shape the biological macromolecules to biological sciences and medicine
    Bhattacharya, Manojit
    Pal, Soumen
    Chatterjee, Srijan
    Lee, Sang -Soo
    Chakraborty, Chiranjib
    [J]. MOLECULAR THERAPY NUCLEIC ACIDS, 2024, 35 (03):
12345