Evaluation of GPT-4's Chest X-Ray Impression Generation: A Reader Study on Performance and Perception

被引:8
|
作者
Ziegelmayer, Sebastian [1 ,2 ]
Marka, Alexander W. [1 ]
Lenhart, Nicolas [1 ]
Nehls, Nadja [1 ]
Reischl, Stefan [1 ]
Harder, Felix [1 ]
Sauter, Andreas [1 ]
Makowski, Marcus [1 ]
Graf, Markus [1 ]
Gawlitza, Joshua [1 ]
机构
[1] Tech Univ Munich, Sch Med, Dept Diagnost & Intervent Radiol, Ismaninger Str 22, D-81675 Munich, Germany
[2] Tech Univ Munich, Klinikum Rechts Isar, Ismaninger Str 22, D-81675 Munich, Germany
关键词
generative model; GPT; medical imaging; artificial intelligence; imaging; radiology; radiological; radiography; diagnostic; chest; x-ray; x-rays; generative; multimodal; impression; impressions; image; images; AI;
D O I
10.2196/50865
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Exploring the generative capabilities of the multimodal GPT-4, our study uncovered significant differences between radiological assessments and automatic evaluation metrics for chest x-ray impression generation and revealed radiological bias.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] CHEST X-RAY(CXR) AND THORACIC CT SCAN EVALUATION OF MEDIASTINAL LYMPHADENOPATHY IN PATIENTS WITH HODGKIN'S LYMPHOMA REVISITED
    Angelopoulos, M. P.
    Angelopoulou, M.
    Pangalis, G.
    Gouliamos, A.
    Siakantaris, M.
    Kokoris, S.
    Dimitriadou, E.
    Kyrtsonis, M. -C.
    Tsaftaridis, P.
    Variamis, E.
    Kalpadakis, C.
    Sahanas, S.
    Masouridis, S.
    Vassilakopoulos, T.
    HAEMATOLOGICA-THE HEMATOLOGY JOURNAL, 2008, 93 : 247 - 248
  • [22] Chest X-ray (CXR) and thoracic CT scan evaluation of mediastinal lymphadenopathy in patients with Hodgkin's lymphoma revisited
    Arigelopoulos, M. P. K.
    Angelopoulou, M. K.
    Pangalis, G. A.
    Gouliamos, A. D.
    Siakantaris, M. P.
    Kokoris, S.
    Dimitriadou, E.
    Kirtsonis, M. C.
    Tsaftaridis, P.
    Variamis, E.
    Kalpadakis, C.
    Sachanas, S.
    Masouridis, S.
    Vassilakopoulos, T. P.
    HAEMATOLOGICA-THE HEMATOLOGY JOURNAL, 2007, 92 : 57 - 58
  • [23] X-Ray Image Generation as a Method of Performance Prediction for Real-Time Inspection: a Case Study
    Andriiashen, Vladyslav
    van Liere, Robert
    van Leeuwen, Tristan
    Batenburg, K. Joost
    JOURNAL OF NONDESTRUCTIVE EVALUATION, 2024, 43 (03)
  • [24] Evaluation of chest X-ray with automated interpretation algorithms for mass tuberculosis screening in prisons: A cross-sectional study
    Soares, Thiego Ramon
    de Oliveira, Roberto Dias
    Liu, Yiran E.
    Santos, Andrea da Silva
    dos Santos, Paulo Cesar Pereira
    Monte, Luma Ravena Soares
    de Oliveira, Lissandra Maia
    Park, Chang Min
    Hwang, Eui Jin
    Andrews, Jason R.
    Croda, Julio
    LANCET REGIONAL HEALTH-AMERICAS, 2023, 17
  • [25] Texture Feature Extraction: Impact of Variants on Performance of Machine Learning Classifiers: Study on Chest X-Ray - Pneumonia Images
    Gupta, Anamika
    Gupta, Anshuman
    Verma, Vaishnavi
    Khattar, Aayush
    Sharma, Devansh
    8TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS, BDA 2020, 2020, 12581 : 151 - 163
  • [26] Evaluation of chest X-ray with automated interpretation algorithms for mass tuberculosis screening in prisons: A cross-sectional study
    Soares, Thiego Ramon
    de Oliveira, Roberto Dias
    Liu, Yiran E.
    Santos, Andrea da Silva
    Pereira dos Santos, Paulo Cesar
    Soares Monte, Luma Ravena
    de Oliveira, Lissandra Maia
    Park, Chang Min
    Hwang, Eui Jin
    Andrews, Jason R.
    Croda, Julio
    LANCET REGIONAL HEALTH-AMERICAS, 2023, 17
  • [27] The Effectiveness of Full-body EOS Compared With Conventional Chest X-ray in Preoperative Evaluation of the Chest for Patients Undergoing Spine Operations A Preliminary Study
    Hey, Hwee Weng Dennis
    Chan, Chloe Xiaoyun
    Wong, Ying Mei
    Sng, Jonathan Weizhong
    Ong, Han Yang
    Tan, Chuen Seng
    Liu, Gabriel Ka-Po
    Wong, Hee-Kit
    Quek, Swee-Tian
    SPINE, 2018, 43 (21) : 1502 - 1511
  • [28] Cuboidal W3S4 cluster complexes as new generation X-ray contrast agents
    Yu, SB
    Droege, M
    Segal, B
    Kim, SH
    Sanderson, T
    Watson, AD
    INORGANIC CHEMISTRY, 2000, 39 (06) : 1325 - +
  • [29] Study on Evaluation Method of Impulse Dispersion Performance of Grounding Device Using X-ray Imagining System
    Han, Xiaoyan
    Luo, Donghui
    Zhang, Xin
    Cao, Yongxing
    Zhang, Yu
    Ban, Gege
    ENERGIES, 2021, 14 (16)
  • [30] Intersection of Performance, Interpretability, and Fairness in Neural Prototype Tree for Chest X-Ray Pathology Detection: Algorithm Development and Validation Study
    Chen, Hongbo
    Alfred, Myrtede
    Brown, Andrew
    Atinga, Angela
    Cohen, Eldan
    JMIR FORMATIVE RESEARCH, 2024, 8