Optimizing adult-oriented artificial intelligence for pediatric chest radiographs by adjusting operating points

被引:0
|
作者
Shin, Hyun Joo [1 ,2 ]
Han, Kyunghwa [3 ]
Son, Nak-Hoon [4 ]
Kim, Eun-Kyung [1 ,2 ]
Kim, Min Jung [5 ]
Gatidis, Sergios [6 ]
Vasanawala, Shreyas [6 ]
机构
[1] Yonsei Univ, Yongin Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[2] Yonsei Univ, Coll Med, Ctr Clin Imaging Data Sci, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[3] Yonsei Univ, Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 50-1 Yonsei Ro, Seoul 03722, South Korea
[4] Keimyung Univ, Dept Stat, 1095 Dalgubeol Daero, Daegu 42601, South Korea
[5] Yonsei Univ, Yongin Severance Hosp, Coll Med, Dept Pediat, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[6] Stanford Univ, Lucile Packard Childrens Hosp, Dept Radiol, 725 Welch Rd, Palo Alto, CA 94304 USA
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Child; Artificial intelligence; ROC curve; Radiologists; Pneumothorax; RADIOLOGY; PAPER;
D O I
10.1038/s41598-024-82775-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The purpose of this study was to evaluate whether the optimal operating points of adult-oriented artificial intelligence (AI) software differ for pediatric chest radiographs and to assess its diagnostic performance. Chest radiographs from patients under 19 years old, collected between March and November 2021, were divided into test and exploring sets. A commercial adult-oriented AI software was utilized to detect lung lesions, including pneumothorax, consolidation, nodule, and pleural effusion, using a standard operating point of 15%. A pediatric radiologist reviewed the radiographs to establish ground truth for lesion presence. To determine the optimal operating points, receiver operating characteristic (ROC) curve analysis was conducted, varying thresholds to balance sensitivity and specificity by lesion type, age group, and imaging method. The test set (4,727 chest radiographs, mean 7.2 +/- 6.1 years) and exploring set (2,630 radiographs, mean 5.9 +/- 6.0 years) yielded optimal operating points of 11% for pneumothorax, 14% for consolidation, 15% for nodules, and 6% for pleural effusion. Using a 3% operating point improved pneumothorax sensitivity for children under 2 years, portable radiographs, and anteroposterior projections. Therefore, optimizing operating points of AI based on lesion type, age, and imaging method could improve diagnostic performance for pediatric chest radiographs, building on adult-oriented AI as a foundation.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Artificial intelligence system for identification of false-negative interpretations in chest radiographs
    Hwang, Eui Jin
    Park, Jongsoo
    Hong, Wonju
    Lee, Hyun-Ju
    Choi, Hyewon
    Kim, Hyungjin
    Nam, Ju Gang
    Goo, Jin Mo
    Yoon, Soon Ho
    Lee, Chang Hyun
    Park, Chang Min
    EUROPEAN RADIOLOGY, 2022, 32 (07) : 4468 - 4478
  • [32] Role of Artificial Intelligence on Chest Radiographs for Detecting Resectable Early Lung Cancer
    Lee, E.
    Kwak, S.
    Shin, H. J.
    JOURNAL OF THORACIC ONCOLOGY, 2022, 17 (09) : S521 - S521
  • [33] Efficacy of Artificial Intelligence in the Categorisation of Paediatric Pneumonia on Chest Radiographs: A Systematic Review
    Field, Erica Louise
    Tam, Winnie
    Moore, Niamh
    McEntee, Mark
    CHILDREN-BASEL, 2023, 10 (03):
  • [34] Artificial intelligence-based detection of aortic stenosis from chest radiographs
    Ueda, Daiju
    Yamamoto, Akira
    Ehara, Shoichi
    Iwata, Shinichi
    Abo, Koji
    Walston, Shannon L.
    Matsumoto, Toshimasa
    Shimazaki, Akitoshi
    Yoshiyama, Minoru
    Miki, Yukio
    EUROPEAN HEART JOURNAL - DIGITAL HEALTH, 2022, 3 (01): : 20 - 28
  • [35] Artificial intelligence system for identification of false-negative interpretations in chest radiographs
    Eui Jin Hwang
    Jongsoo Park
    Wonju Hong
    Hyun-Ju Lee
    Hyewon Choi
    Hyungjin Kim
    Ju Gang Nam
    Jin Mo Goo
    Soon Ho Yoon
    Chang Hyun Lee
    Chang Min Park
    European Radiology, 2022, 32 : 4468 - 4478
  • [36] Artificial intelligence: a potential prioritisation tool for chest radiographs with suspected thoracic malignancy
    Hussein, M. A. M.
    Brozik, J.
    Hopewell, H.
    Patel, H.
    Rasalingham, S.
    Dillard, L.
    Morgan, T. Naunton
    Tappouni, R.
    Malik, Q.
    Lucas, E.
    Das, I.
    LUNG CANCER, 2020, 139 : S25 - S25
  • [37] Incidentally found resectable lung cancer with the usage of artificial intelligence on chest radiographs
    Kwak, Se Hyun
    Kim, Eun-Kyung
    Kim, Myung Hyun
    Lee, Eun Hye
    Shin, Hyun Joo
    PLOS ONE, 2023, 18 (03):
  • [38] Incidentally found resectable lung cancer with the usage of artificial intelligence on chest radiographs
    Kwak, Se Hyun
    Kim, Eun-Kyung
    Kim, Myung Hyun
    Shin, Hyun Joo
    Lee, Eun Hye
    RESPIROLOGY, 2023, 28 : 301 - 301
  • [39] COVID-19 on Chest Radiographs: A Multireader Evaluation of an Artificial Intelligence System
    Murphy, Keelin
    Smits, Henk
    Knoops, Arnoud J. G.
    Korst, Michael B. J. M.
    Samson, Tijs
    Scholten, Ernst T.
    Schalekamp, Steven
    Schaefer-Prokop, Cornelia M.
    Philipsen, Rick H. H. M.
    Meijers, Annet
    Melendez, Jaime
    van Ginneken, Bram
    Rutten, Matthieu
    RADIOLOGY, 2020, 296 (03) : E166 - E172
  • [40] Diagnostic Performance of Artificial Intelligence in Chest Radiographs Referred from the Emergency Department
    Alcolea, Julia Lopez
    Alfonso, Ana Fernandez
    Alonso, Raquel Cano
    Vazquez, Ana Alvarez
    Moreno, Alejandro Diaz
    Castellanos, David Garcia
    Greciano, Lucia Sanabria
    Hayoun, Chawar
    Rodriguez, Manuel Recio
    Vazquez, Cristina Andreu
    Vasallo, Israel John Thuissard
    de Vega, Vicente Martinez
    DIAGNOSTICS, 2024, 14 (22)