A novel uncertainty-aware deep learning technique with an application on skin cancer diagnosis

被引:2
|
作者
Shamsi, Afshar [1 ,6 ]
Asgharnezhad, Hamzeh [5 ]
Bouchani, Ziba [2 ]
Jahanian, Khadijeh [3 ]
Saberi, Morteza [3 ]
Wang, Xianzhi [3 ]
Razzak, Imran [4 ]
Alizadehsani, Roohallah [5 ]
Mohammadi, Arash [6 ]
Alinejad-Rokny, Hamid [1 ,7 ,8 ]
机构
[1] UNSW Sydney, Grad Sch Biomed Engn, Biomed Machine Learning Lab BML, Sydney, Australia
[2] Univ Tehran, Dept Elect & Comp Engn, Tehran, Iran
[3] Univ Technol Sydney, Fac Engn & IT, Sydney, Australia
[4] Univ New South Wales UNSW, Sch Comp Sci & Engn, Sydney, Australia
[5] Deakin Univ, Intelligent Syst Res & Innovat IISRI, Waurn Ponds, Vic 3216, Australia
[6] Concordia Univ, Inst Informat Syst Engn, Montreal, PQ, Canada
[7] Univ New South Wales UNSW SYDNEY, UNSW Data Sci Hub, Sydney, Australia
[8] Macquarie Univ, Ctr Appl Artificial Intelligence, Hlth Data Analyt Program, Sydney, Australia
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 30期
关键词
Deep learning; Machine learning; Classification; Uncertainty quantification; Skin cancer; CLASSIFICATION;
D O I
10.1007/s00521-023-08930-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Skin cancer, primarily resulting from the abnormal growth of skin cells, is among the most common cancer types. In recent decades, the incidence of skin cancer cases worldwide has risen significantly (one in every three newly diagnosed cancer cases is a skin cancer). Such an increase can be attributed to changes in our social and lifestyle habits coupled with devastating man-made alterations to the global ecosystem. Despite such a notable increase, diagnosis of skin cancer is still challenging, which becomes critical as its early detection is crucial for increasing the overall survival rate. This calls for advancements of innovative computer-aided systems to assist medical experts with their decision making. In this context, there has been a recent surge of interest in machine learning (ML), in particular, deep neural networks (DNNs), to provide complementary assistance to expert physicians. While DNNs have a high processing capacity far beyond that of human experts, their outputs are deterministic, i.e., providing estimates without prediction confidence. Therefore, it is of paramount importance to develop DNNs with uncertainty-awareness to provide confidence in their predictions. Monte Carlo dropout (MCD) is vastly used for uncertainty quantification; however, MCD suffers from overconfidence and being miss calibrated. In this paper, we use MCD algorithm to develop an uncertainty-aware DNN that assigns high predictive entropy to erroneous predictions and enable the model to optimize the hyper-parameters during training, which leads to more accurate uncertainty quantification. We use two synthetic (two moons and blobs) and a real dataset (skin cancer) to validate our algorithm. Our experiments on these datasets prove effectiveness of our approach in quantifying reliable uncertainty. Our method achieved 85.65 & PLUSMN; 0.18 prediction accuracy, 83.03 & PLUSMN; 0.25 uncertainty accuracy, and 1.93 & PLUSMN; 0.3 expected calibration error outperforming vanilla MCD and MCD with loss enhanced based on predicted entropy.
引用
收藏
页码:22179 / 22188
页数:10
相关论文
共 50 条
  • [1] A novel uncertainty-aware deep learning technique with an application on skin cancer diagnosis
    Afshar Shamsi
    Hamzeh Asgharnezhad
    Ziba Bouchani
    Khadijeh Jahanian
    Morteza Saberi
    Xianzhi Wang
    Imran Razzak
    Roohallah Alizadehsani
    Arash Mohammadi
    Hamid Alinejad-Rokny
    [J]. Neural Computing and Applications, 2023, 35 : 22179 - 22188
  • [2] Uncertainty-Aware Deep Learning: A Promising Tool for Trustworthy Fault Diagnosis
    Jiaxin Ren
    Jingcheng Wen
    Zhibin Zhao
    Ruqiang Yan
    Xuefeng Chen
    Asoke K. Nandi
    [J]. IEEE/CAA Journal of Automatica Sinica, 2024, 11 (06) : 1317 - 1330
  • [3] Uncertainty-Aware Deep Learning: A Promising Tool for Trustworthy Fault Diagnosis
    Ren, Jiaxin
    Wen, Jingcheng
    Zhao, Zhibin
    Yan, Ruqiang
    Chen, Xuefeng
    Nandi, Asoke K.
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (06) : 1317 - 1330
  • [4] Uncertainty-aware deep learning for monitoring and fault diagnosis from synthetic data
    Das, Laya
    Gjorgiev, Blazhe
    Sansavini, Giovanni
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 251
  • [5] Uncertainty-Aware Deep Learning Based Deformable Registration
    Grigorescu, Irina
    Uus, Alena
    Christiaens, Daan
    Cordero-Grande, Lucilio
    Hutter, Jana
    Batalle, Dafnis
    Edwards, A. David
    Hajnal, Joseph V.
    Modat, Marc
    Deprez, Maria
    [J]. UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING, AND PERINATAL IMAGING, PLACENTAL AND PRETERM IMAGE ANALYSIS, 2021, 12959 : 54 - 63
  • [6] Training Uncertainty-Aware Classifiers with Conformalized Deep Learning
    Einbinder, Bat-Sheva
    Romano, Yaniv
    Sesia, Matteo
    Zhou, Yanfei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [7] Uncertainty-Aware Data Aggregation for Deep Imitation Learning
    Cui, Yuchen
    Isele, David
    Niekum, Scott
    Fujimura, Kikuo
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 761 - 767
  • [8] Uncertainty-aware autonomous sensing with deep reinforcement learning
    Murad, Abdulmajid
    Kraemer, Frank Alexander
    Bach, Kerstin
    Taylor, Gavin
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 156 : 242 - 253
  • [9] Uncertainty-aware skin cancer detection: The element of doubt
    Tabarisaadi, Pegah
    Khosravi, Abbas
    Nahavandi, Saeid
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 144
  • [10] Uncertainty-aware deep learning for robot touch: Application to Bayesian tactile servo control
    Vazquez, Manuel Floriano
    Lepora, Nathan F.
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 1615 - 1621