ATTENTION-BASED DEEP MULTIPLE INSTANCE LEARNING WITH ADAPTIVE INSTANCE SAMPLING

被引:1
|
作者
Tarkhan, Aliasghar [1 ]
Trung Kien Nguyen [2 ]
Simon, Noah [1 ]
Bengtsson, Thomas [2 ]
Ocampo, Paolo [2 ]
Dai, Jian [2 ]
机构
[1] Univ Washington, Dept Biostat, Seattle, WA 98195 USA
[2] Genentech Inc, PHC Imaging Grp, San Francisco, CA 94080 USA
关键词
Attention; computational pathology; deep learning; multiple instance learning; prostate cancer; transfer learning; weekly supervised learning; PREDICTION;
D O I
10.1109/ISBI52829.2022.9761661
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
One challenge of training deep neural networks with gigapixel whole-slide images (WSIs) in computational pathology is the lack of annotation at pixel level or regional level due to the high cost and time-consuming labeling effort. Multiple instance learning (MIL) and its attention-based versions are typical weakly supervised learning methods, which allow us to use slide-level labels directly, without the need for pixel or region labels, thus reducing the cost of annotation. However, training a deep neural network with thousands of image regions (patches) per slide is computationally expensive, and it needs a lot of time for convergence. This paper proposes a fast adaptive attention-based deep MIL approach. This approach adaptively selects image regions that are highly predictive of outcome and ignores image regions with little or no information. We empirically show that our proposed approach outperforms the random sampling approach while it is faster than the standard attention-based MIL method (which uses all image regions for training).
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Triple-kernel gated attention-based multiple instance learning with contrastive learning for medical image analysis
    Huafeng Hu
    Ruijie Ye
    Jeyan Thiyagalingam
    Frans Coenen
    Jionglong Su
    [J]. Applied Intelligence, 2023, 53 : 20311 - 20326
  • [32] Explaining Anomalous Events in Flight Data of UAV With Deep Attention-Based Multi-Instance Learning
    Yang, Jie
    Tang, Diyin
    Yu, Jinsong
    Zhang, Jian
    Liu, Haigang
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (01) : 107 - 119
  • [33] Deep Forest for Multiple Instance Learning
    Ren J.
    Hou B.
    Jiang Y.
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (08): : 1670 - 1676
  • [34] Query-Adaptive Multiple Instance Learning for Video Instance Retrieval
    Lin, Ting-Chu
    Yang, Min-Chun
    Tsai, Chia-Yin
    Wang, Yu-Chiang Frank
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (04) : 1330 - 1340
  • [35] The effects of sparsity induction methods on attention-based multiple instance learning applied to Camelyon16
    Tavolara, Thomas E.
    Gurcan, Metin N.
    Niazi, M. Khalid Khan
    [J]. MEDICAL IMAGING 2023, 2023, 12471
  • [36] Hierarchical Attention-Based Multiple Instance Learning Network for Patient-Level Lung Cancer Diagnosis
    Wang, Qingfeng
    Zhou, Ying
    Huang, Jun
    Liu, Zhiqin
    Li, Ling
    Xu, Weiyun
    Cheng, Jie-Zhi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 1156 - 1160
  • [37] False Positive Reduction of Pulmonary Nodule on CT image using Attention-based Multiple Instance Learning
    Nguyen, Chi Cuong
    Tran, Giang Son
    Nguyen, Vincent
    [J]. 20TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2023, 2023, : 199 - 202
  • [38] Attention-Based Transformers for Instance Segmentation of Cells in Microstructures
    Prangemeier, Tim
    Reich, Christoph
    Koeppl, Heinz
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 700 - 707
  • [39] Multi-attention multiple instance learning
    Konstantinov, Andrei, V
    Utkin, Lev, V
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (16): : 14029 - 14051
  • [40] NESTED MULTIPLE INSTANCE LEARNING WITH ATTENTION MECHANISMS
    Fuster, Saul
    Eftestol, Trygve
    Engan, Kjersti
    [J]. 2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 220 - 225