Evaluation of GPT-4's Chest X-Ray Impression Generation: A Reader Study on Performance and Perception

被引：3
|
作者：
Ziegelmayer, Sebastian [1 ,2 ]
Marka, Alexander W. [1 ]
Lenhart, Nicolas [1 ]
Nehls, Nadja [1 ]
Reischl, Stefan [1 ]
Harder, Felix [1 ]
Sauter, Andreas [1 ]
Makowski, Marcus [1 ]
Graf, Markus [1 ]
Gawlitza, Joshua [1 ]
机构：
[1] Tech Univ Munich, Sch Med, Dept Diagnost & Intervent Radiol, Ismaninger Str 22, D-81675 Munich, Germany
[2] Tech Univ Munich, Klinikum Rechts Isar, Ismaninger Str 22, D-81675 Munich, Germany
来源：
JOURNAL OF MEDICAL INTERNET RESEARCH | 2023年 / 25卷
关键词：
generative model; GPT; medical imaging; artificial intelligence; imaging; radiology; radiological; radiography; diagnostic; chest; x-ray; x-rays; generative; multimodal; impression; impressions; image; images; AI;
D O I：
10.2196/50865
中图分类号：
R19 [保健组织与事业（卫生事业管理）];
学科分类号：
摘要：
Exploring the generative capabilities of the multimodal GPT-4, our study uncovered significant differences between radiological assessments and automatic evaluation metrics for chest x-ray impression generation and revealed radiological bias.
引用
收藏
页数：5
相关论文
共 50 条
  • [1] Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT models
    Ranjit, Mercy
    Ganapathy, Gopinath
    Manuel, Ranjit
    Ganu, Tanuja
    [J]. MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 219, 2023, 219
  • [2] Chest x-ray in the COVID-19 pandemic: Radiologists' real-world reader performance
    Cozzi, Andrea
    Schiaffino, Simone
    Arpaia, Francesco
    Della Pepa, Gianmarco
    Tritella, Stefania
    Bertolotti, Pietro
    Menicagli, Laura
    Monaco, Cristian Giuseppe
    Carbonaro, Luca Alessandro
    Spairani, Riccardo
    Paskeh, Bijan Babaei
    Sardanelli, Francesco
    [J]. EUROPEAN JOURNAL OF RADIOLOGY, 2020, 132
  • [3] The effect of a tuberculosis chest X-ray image reference set on non-expert reader performance
    Catriona J. Waitt
    Elizabeth C. Joekes
    Natasha Jesudason
    Peter I. Waitt
    Patrick Goodson
    Ganizani Likumbo
    Samuel Kampondeni
    E. Brian Faragher
    S. Bertel Squire
    [J]. European Radiology, 2013, 23 : 2459 - 2468
  • [4] The effect of a tuberculosis chest X-ray image reference set on non-expert reader performance
    Waitt, Catriona J.
    Joekes, Elizabeth C.
    Jesudason, Natasha
    Waitt, Peter I.
    Goodson, Patrick
    Likumbo, Ganizani
    Kampondeni, Samuel
    Faragher, E. Brian
    Squire, S. Bertel
    [J]. EUROPEAN RADIOLOGY, 2013, 23 (09) : 2459 - 2468
  • [5] Enhancing chest X-ray diagnosis with text-to-image generation: A data case study
    Bahani, Mourad
    El Ouaazizi, Aziza
    Avram, Robert
    Maalmi, Khalil
    [J]. DISPLAYS, 2024, 83
  • [6] Coronary risk assessment at X-ray dose equivalent ungated chest CT: Results of a multi-reader study
    Messerli, Michael
    Hechelhammer, Lukas
    Leschka, Sebastian
    Warschkow, Rene
    Wildermuth, Simon
    Bauer, Ralf W.
    [J]. CLINICAL IMAGING, 2018, 49 : 73 - 79
  • [7] Screening performance of the chest X-ray in adult blunt trauma evaluation: Is it effective and what does it miss?
    Dillon, David G.
    Rodriguez, Robert M.
    [J]. AMERICAN JOURNAL OF EMERGENCY MEDICINE, 2021, 49 : 310 - 314
  • [8] Evaluation of the impact of artificial intelligence-assisted image interpretation on the diagnostic performance of clinicians in identifying pneumothoraces on plain chest X-ray: a multi-case multi-reader study
    Novak, Alex
    Ather, Sarim
    Gill, Avneet
    Aylward, Peter
    Maskell, Giles
    Cowell, Gordon W.
    Morgado, Abdala Trinidad Espinosa
    Duggan, Tom
    Keevil, Melissa
    Gordon, Oliva
    Akrama, Osama
    Belcher, Elizabeth
    Taberham, Rhona
    Hallifax, Rob
    Bahra, Jasdeep
    Banerji, Abhishek
    Bailey, Jon
    James, Antonia
    Ansaripour, Ali
    Spence, Nathan
    Wrightson, John
    Jarral, Waqas
    Barry, Steven
    Bhatti, Saher
    Astley, Kerry
    Shadmaan, Amied
    Ghelman, Sharon
    Baenen, Alec
    Oke, Jason
    Bloomfield, Claire
    Beggs, Mark
    Gleeson, Fergus
    [J]. EMERGENCY MEDICINE JOURNAL, 2024,
  • [9] Value of chest x-ray study and MRI in patients with arterial hypertension and Marfan's syndrome
    Korobkova, I.
    Belichenko, O.
    Lazutkina, V.
    Ustyuzhanin, D.
    Shahvorostova, S.
    Guryakov, S.
    [J]. JOURNAL OF HYPERTENSION, 2006, 24 : S67 - S67
  • [10] Performance Evaluation of the Deep Learning Based Convolutional Neural Network Approach for the Recognition of Chest X-Ray Images
    Sharma, Sandhya
    Gupta, Sheifali
    Gupta, Deepali
    Rashid, Junaid
    Juneja, Sapna
    Kim, Jungeun
    Elarabawy, Mahmoud M.
    [J]. FRONTIERS IN ONCOLOGY, 2022, 12
12345