Evaluation of GPT-4's Chest X-Ray Impression Generation: A Reader Study on Performance and Perception

被引:8
|
作者
Ziegelmayer, Sebastian [1 ,2 ]
Marka, Alexander W. [1 ]
Lenhart, Nicolas [1 ]
Nehls, Nadja [1 ]
Reischl, Stefan [1 ]
Harder, Felix [1 ]
Sauter, Andreas [1 ]
Makowski, Marcus [1 ]
Graf, Markus [1 ]
Gawlitza, Joshua [1 ]
机构
[1] Tech Univ Munich, Sch Med, Dept Diagnost & Intervent Radiol, Ismaninger Str 22, D-81675 Munich, Germany
[2] Tech Univ Munich, Klinikum Rechts Isar, Ismaninger Str 22, D-81675 Munich, Germany
关键词
generative model; GPT; medical imaging; artificial intelligence; imaging; radiology; radiological; radiography; diagnostic; chest; x-ray; x-rays; generative; multimodal; impression; impressions; image; images; AI;
D O I
10.2196/50865
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Exploring the generative capabilities of the multimodal GPT-4, our study uncovered significant differences between radiological assessments and automatic evaluation metrics for chest x-ray impression generation and revealed radiological bias.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] An X-ray photoelectron spectroscopy study of BaAl2S4 thin films
    Smet, PF
    Van Haecke, JE
    Van Meirhaeghe, RL
    Poelman, D
    JOURNAL OF ELECTRON SPECTROSCOPY AND RELATED PHENOMENA, 2005, 148 (02) : 91 - 95
  • [32] Comparative Analysis of M4CXR, an LLM-Based Chest X-Ray Report Generation Model, and ChatGPT in Radiological Interpretation
    Lee, Ro Woon
    Lee, Kyu Hong
    Yun, Jae Sung
    Kim, Myung Sub
    Choi, Hyun Seok
    JOURNAL OF CLINICAL MEDICINE, 2024, 13 (23)
  • [33] X-RAY SPECTRAL STUDY OF 2 X-RAY BINARIES - 4U 1957+11 AND 2S 1543-624
    SINGH, KP
    APPARAO, KMV
    KRAFT, RP
    ASTROPHYSICAL JOURNAL, 1994, 421 (02): : 753 - 761
  • [34] Interface study of a high-performance W/B4C X-ray mirror
    Siffalovic, Peter
    Jergel, Matej
    Chitu, Livia
    Majkova, Eva
    Matko, Igor
    Luby, Stefan
    Timmann, Andreas
    Roth, Stephan Volker
    Keckes, Jozef
    Maier, Guenter Alois
    Hembd, Alexandra
    Hertlein, Frank
    Wiesmann, Joerg
    JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2010, 43 : 1431 - 1439
  • [35] The Performance Evaluation of Transfer Learning VGG16 Algorithm on Various Chest X-ray Imaging Datasets for COVID-19 Classification
    Sunyoto, Andi
    Pristyanto, Yoga
    Setyanto, Arief
    Alarfaj, Fawaz
    Almusallam, Naif
    Alreshoodi, Mohammed
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (09) : 196 - 203
  • [36] An evaluation of chest X-ray screening for lung cancer in gunma prefecture, Japan: a population-based case-control study
    Nakayama, T
    Baba, T
    Suzuki, T
    Sagawa, M
    Kaneko, M
    EUROPEAN JOURNAL OF CANCER, 2002, 38 (10) : 1380 - 1387
  • [37] Performance of AI-based software for pulmonary nodule detection and characterization on chest X-ray and correlation with CT findings: A retrospective study
    Ravind, R.
    Chattoraj, S.
    Shivabasappa, S.
    Singh, A.
    Chamadia, R.
    Sathyamurthy, S.
    Robert, D.
    Jeeson, J.
    Vanpully, N. S.
    Shaikh, S. M. J.
    Bose K, R.
    Nasery, M.
    ANNALS OF ONCOLOGY, 2024, 35 : S1620 - S1620
  • [38] Performance Study on Deep Learning Covid-19 Prediction through Chest X-Ray Image with ResNet50 Model
    Kumar, Dhirendra
    Sharma, Pulkit
    Anupama
    Sharma, Parth
    2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [39] X-ray and Neutron Single Crystal Diffraction Study of Rb4LiH3(XO4)4 (X = S, Se).
    Troyanov, S. I.
    Ling, Ch. D.
    Kemnitz, E.
    ACTA CRYSTALLOGRAPHICA A-FOUNDATION AND ADVANCES, 2004, 60 : S296 - S296
  • [40] Compressibility of β-As4S4: an in situ high-pressure single-crystal X-ray study
    Lepore, G. O.
    Ballaran, T. Boffa
    Nestola, F.
    Bindi, L.
    Pasqual, D.
    Bonazzi, P.
    MINERALOGICAL MAGAZINE, 2012, 76 (04) : 963 - 973