Quantifying Uncertainty in Deep Learning of Radiologic Images

被引:14
|
作者
Faghani, Shahriar [1 ]
Moassefi, Mana [1 ]
Rouzrokh, Pouria [1 ]
Khosravi, Bardia [1 ]
Baffour, Francis I. [2 ]
Ringler, Michael D. [2 ]
Erickson, Bradley J. [1 ]
机构
[1] Mayo Clin, Artificial Intelligence Lab, 200 1st St SW, Rochester, MN 55905 USA
[2] Mayo Clin, Dept Radiol, Div Musculoskeletal Radiol, 200 1st St SW, Rochester, MN 55905 USA
关键词
ARTIFICIAL-INTELLIGENCE;
D O I
10.1148/radiol.222217
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
In recent years, deep learning (DL) has shown impressive performance in radiologic image analysis. However, for a DL model to be useful in a real-world setting, its confidence in a prediction must also be known. Each DL model's output has an estimated probability, and these estimated probabilities are not always reliable. Uncertainty represents the trustworthiness (validity) of estimated probabilities. The higher the uncertainty, the lower the validity. Uncertainty quantification (UQ) methods determine the uncertainty level of each prediction. Predictions made without UQ methods are generally not trustworthy. By implementing UQ in medical DL models, users can be alerted when a model does not have enough information to make a confident decision. Consequently, a medical expert could reevaluate the uncertain cases, which would eventually lead to gaining more trust when using a model. This review focuses on recent trends using UQ methods in DL radiologic image analysis within a conceptual framework. Also discussed in this review are potential applications, challenges, and future directions of UQ in DL radiologic image analysis.(c) RSNA, 2023
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Quantifying Uncertainty in Environmental Sensing with Evidential Deep Learning
    Mittermaier, Simon
    Patra, Subhankar
    Carbonelli, Cecilia
    [J]. 2023 IEEE SENSORS, 2023,
  • [2] Quantifying uncertainty in deep learning approaches to radio galaxy classification
    Mohan, Devina
    Scaife, Anna M. M.
    Porter, Fiona
    Walmsley, Mike
    Bowles, Micah
    [J]. MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2022, 511 (03) : 3722 - 3740
  • [3] Quantifying the uncertainty of precipitation forecasting using probabilistic deep learning
    Xu, Lei
    Chen, Nengcheng
    Yang, Chao
    Yu, Hongchu
    Chen, Zeqiang
    [J]. HYDROLOGY AND EARTH SYSTEM SCIENCES, 2022, 26 (11) : 2923 - 2938
  • [4] Quantifying Uncertainty of Deep Learning Models for the Segmentation of Geographic Atrophy
    Spaide, Theodore
    Owen, Julia
    De Sisternes, Luis
    Lewis, Warren
    Manivannan, Niranchana
    Pramil, Varsha
    Sheikh, Harris Asad
    Waheed, Nadia K.
    Lee, Cecilia S.
    Lee, Aaron Y.
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2023, 64 (08)
  • [5] Quantifying Predictive Uncertainty in Medical Image Analysis with Deep Kernel Learning
    Wu, Zhiliang
    Yang, Yinchong
    Gu, Jindong
    Tresp, Volker
    [J]. 2021 IEEE 9TH INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI 2021), 2021, : 63 - 72
  • [6] Quantifying Uncertainty in Deep Spatiotemporal Forecasting
    Wu, Dongxia
    Gao, Liyao
    Xiong, Xinyue
    Chinazzi, Matteo
    Vespignani, Alessandro
    Ma, Yi-An
    Yu, Rose
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1841 - 1851
  • [7] Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning
    Vandal, Thomas
    Kodra, Evan
    Dy, Jennifer
    Ganguly, Sangram
    Nemani, Ramakrishna
    Ganguly, Auroop R.
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 2377 - 2386
  • [8] Building reliable AI for quantifying uncertainty in particulate matter predictions with deep learning
    Lee, Donghyun
    Lee, Beomhui
    [J]. JOURNAL OF CLEANER PRODUCTION, 2024, 473
  • [9] Prediction of optimal surgical outcomes with radiologic images using deep learning artificial intelligence
    Newtson, A. M.
    Mattson, J. N.
    Goodheart, M. J.
    Bender, D. P.
    Rajput, M.
    McDonald, M.
    Lyons, Y. A.
    Reyes, H. D.
    Gonzalez-Bosquet, J.
    [J]. GYNECOLOGIC ONCOLOGY, 2019, 154 : 156 - 156
  • [10] Towards Safe Deep Learning: Accurately Quantifying Biomarker Uncertainty in Neural Network Predictions
    Eaton-Rosen, Zach
    Bragman, Felix
    Bisdas, Sotirios
    Ourselin, Sebastien
    Cardoso, M. Jorge
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 691 - 699