Lung cancer diagnosis using deep attention-based multiple instance learning and radiomics

被引:18
|
作者
Chen, Junhua [1 ]
Zeng, Haiyan [1 ]
Zhang, Chong [1 ]
Shi, Zhenwei [1 ]
Dekker, Andre [1 ]
Wee, Leonard [1 ]
Bermejo, Inigo [1 ]
机构
[1] Maastricht Univ Med Ctr, GROW Sch Oncol & Dev Biol, Dept Radiat Oncol MAASTRO, NL-6229 ET Maastricht, Netherlands
关键词
attention mechanism; lung cancer diagnosis; multiple instance learning; radiomics; COMPUTER-AIDED DIAGNOSIS; PULMONARY NODULES; CT; CLASSIFICATION; INFORMATION; TEXTURE; COMBINATION; ALGORITHMS; FRAMEWORK; FEATURES;
D O I
10.1002/mp.15539
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Background Early diagnosis of lung cancer is a key intervention for the treatment of lung cancer in which computer-aided diagnosis (CAD) can play a crucial role. Most published CAD methods perform lung cancer diagnosis by classifying each lung nodule in isolation. However, this does not reflect clinical practice, where clinicians diagnose a patient based on a set of images of nodules, instead of looking at one nodule at a time. Besides, the low interpretability of the output provided by these methods presents an important barrier for their adoption. Method In this article, we treat lung cancer diagnosis as a multiple instance learning (MIL) problem, which better reflects the diagnosis process in the clinical setting and provides higher interpretability of the output. We selected radiomics as the source of input features and deep attention-based MIL as the classification algorithm. The attention mechanism provides higher interpretability by estimating the importance of each instance in the set for the final diagnosis. To improve the model's performance in a small imbalanced dataset, we propose a new bag simulation method for MIL. Results and conclusion The results show that our method can achieve a mean accuracy of 0.807 with a standard error of the mean (SEM) of 0.069, a recall of 0.870 (SEM 0.061), a positive predictive value of 0.928 (SEM 0.078), a negative predictive value of 0.591$0.591$ (SEM 0.155), and an area under the curve (AUC) of 0.842 (SEM 0.074), outperforming other MIL methods. Additional experiments show that the proposed oversampling strategy significantly improves the model's performance. In addition, experiments show that our method provides a good indication of the importance of each nodule in determining the diagnosis, which combined with the well-defined radiomic features, to make the results more interpretable and acceptable for doctors and patients.
引用
收藏
页码:3134 / 3143
页数:10
相关论文
共 50 条
  • [1] Attention-based Deep Multiple Instance Learning
    Ilse, Maximilian
    Tomczak, Jakub M.
    Welling, Max
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [2] ATTENTION-BASED DEEP MULTIPLE INSTANCE LEARNING WITH ADAPTIVE INSTANCE SAMPLING
    Tarkhan, Aliasghar
    Trung Kien Nguyen
    Simon, Noah
    Bengtsson, Thomas
    Ocampo, Paolo
    Dai, Jian
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [3] Hierarchical Attention-Based Multiple Instance Learning Network for Patient-Level Lung Cancer Diagnosis
    Wang, Qingfeng
    Zhou, Ying
    Huang, Jun
    Liu, Zhiqin
    Li, Ling
    Xu, Weiyun
    Cheng, Jie-Zhi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1156 - 1160
  • [4] Attention-Based Target Localization Using Multiple Instance Learning
    Sankaranarayanan, Karthik
    Davis, James W.
    [J]. ADVANCES IN VISUAL COMPUTING, PT I, 2010, 6453 : 381 - 392
  • [5] Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
    Atsushi Teramoto
    Yuka Kiriyama
    Tetsuya Tsukamoto
    Eiko Sakurai
    Ayano Michiba
    Kazuyoshi Imaizumi
    Kuniaki Saito
    Hiroshi Fujita
    [J]. Scientific Reports, 11
  • [6] Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
    Teramoto, Atsushi
    Kiriyama, Yuka
    Tsukamoto, Tetsuya
    Sakurai, Eiko
    Michiba, Ayano
    Imaizumi, Kazuyoshi
    Saito, Kuniaki
    Fujita, Hiroshi
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [7] MILL: Channel Attention-based Deep Multiple Instance Learning for Landslide Recognition
    Tang, Xiaochuan
    Liu, Mingzhe
    Zhong, Hao
    Ju, Yuanzhen
    Li, Weile
    Xu, Qiang
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (02)
  • [8] Attention Based Deep Multiple Instance Learning Approach for Lung Cancer Prediction using Histopathological Images
    Moranguinho, Joao
    Pereira, Tania
    Ramos, Bernardo
    Morgado, Joana
    Costa, Jose Luis
    Oliveira, Helder P.
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2852 - 2855
  • [9] Generalized attention-based deep multi-instance learning
    Lu Zhao
    Liming Yuan
    Kun Hao
    Xianbin Wen
    [J]. Multimedia Systems, 2023, 29 : 275 - 287
  • [10] Generalized attention-based deep multi-instance learning
    Zhao, Lu
    Yuan, Liming
    Hao, Kun
    Wen, Xianbin
    [J]. MULTIMEDIA SYSTEMS, 2023, 29 (01) : 275 - 287