Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Bag-Level Classifier is a Good Instance-Level Teacher

被引：0
|
作者：
Wang, Hongyi [3 ]
Luo, Luyang [1 ]
Wang, Fang [2 ]
Tong, Ruofeng [3 ,4 ]
Chen, Yen-Wei [3 ,5 ]
Hu, Hongjie [2 ]
Lin, Lanfen [3 ]
Chen, Hao [6 ]
机构：
[1] The Hong Kong University of Science and Technology, Department of Computer Science and Engineering, Hong Kong, Hong Kong
[2] Sir Run Run Shaw Hospital, Department of Radiology, Hangzhou,310016, China
[3] Zhejiang University, College of Computer Science and Technology, Hangzhou,310063, China
[4] Zhejiang Laboratory, Research Center for Healthcare Data Science, Hangzhou,311121, China
[5] Ritsumeikan University, College of Information Science and Engineering, Osaka, Ibaraki,567-8570, Japan
[6] The Hong Kong University of Science and Technology, Division of Life Science, Department of Computer Science and Engineering, Department of Chemical and Biological Engineering, Hong Kong, Hong Kong
来源：
IEEE Transactions on Medical Imaging | 2024年 / 43卷 / 11期
关键词：
Multiple Instance Learning (MIL) has demonstrated promise in Whole Slide Image (WSI) classification. However; a major challenge persists due to the high computational cost associated with processing these gigapixel images. Existing methods generally adopt a two-stage approach; comprising a non-learnable feature embedding stage and a classifier training stage. Though it can greatly reduce memory consumption by using a fixed feature embedder pre-trained on other domains; such a scheme also results in a disparity between the two stages; leading to suboptimal classification accuracy. To address this issue; we propose that a bag-level classifier can be a good instance-level teacher. Based on this idea; we design Iteratively Coupled Multiple Instance Learning (ICMIL) to couple the embedder and the bag classifier at a low cost. ICMIL initially fixes the patch embedder to train the bag classifier; followed by fixing the bag classifier to fine-tune the patch embedder. The refined embedder can then generate better representations in return; leading to a more accurate classifier for the next iteration. To realize more flexible and more effective embedder fine-tuning; we also introduce a teacher-student framework to efficiently distill the category knowledge in the bag classifier to help the instance-level embedder fine-tuning. Intensive experiments were conducted on four distinct datasets to validate the effectiveness of ICMIL. The experimental results consistently demonstrated that our method significantly improves the performance of existing MIL backbones; achieving state-of-the-art results. The code and the organized datasets can be accessed by: https://github.com/Dootmaan/ICMIL/tree/confidence-based. © 1982-2012 IEEE;
D O I：
10.1109/TMI.2024.3404549
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：3964 / 3976
相关论文
共 50 条
  • [1] Rethinking Multiple Instance Learning for Whole Slide Image Classification: A Good Instance Classifier Is All You Need
    Qu, Linhao
    Ma, Yingfan
    Luo, Xiaoyuan
    Guo, Qinhao
    Wang, Manning
    Song, Zhijian
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (10) : 9732 - 9744
  • [2] Instance-level accuracy versus bag-level accuracy in multi-instance learning
    Vanwinckelen, Gitte
    do O, Vinicius Tragante
    Fierens, Daan
    Blockeel, Hendrik
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2016, 30 (02) : 313 - 341
  • [3] Instance-level accuracy versus bag-level accuracy in multi-instance learning
    Gitte Vanwinckelen
    Vinicius Tragante do O
    Daan Fierens
    Hendrik Blockeel
    [J]. Data Mining and Knowledge Discovery, 2016, 30 : 313 - 341
  • [4] Iteratively Coupled Multiple Instance Learning from Instance to Bag Classifier for Whole Slide Image Classification
    Wang, Hongyi
    Luo, Luyang
    Wang, Fang
    Tong, Ruofeng
    Chen, Yen-Wei
    Hu, Hongjie
    Lin, Lanfen
    Chen, Hao
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VI, 2023, 14225 : 467 - 476
  • [5] Bag-Level Aggregation for Multiple-Instance Active Learning in Instance Classification Problems
    Carbonneau, Marc-Andre
    Granger, Eric
    Gagnon, Ghyslain
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) : 1441 - 1451
  • [6] Multiple Instance Learning with Bag-Level Randomized Trees
    Komarek, Tomas
    Somol, Petr
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT I, 2019, 11051 : 259 - 272
  • [7] Rethinking Overfitting of Multiple Instance Learning for Whole Slide Image Classification
    Song, Hongjian
    Tang, Jie
    Xiao, Hongzhao
    Hu, Juncheng
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 546 - 551
  • [8] IIB-MIL: Integrated Instance-Level and Bag-Level Multiple Instances Learning with Label Disambiguation for Pathological Image Analysis
    Ren, Qin
    Zhao, Yu
    He, Bing
    Wu, Bingzhe
    Mai, Sijie
    Xu, Fan
    Huang, Yueshan
    He, Yonghong
    Huang, Junzhou
    Yao, Jianhua
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VI, 2023, 14225 : 560 - 569
  • [9] MULTIPLE INSTANCE LEARNING WITH CRITICAL INSTANCE FOR WHOLE SLIDE IMAGE CLASSIFICATION
    Zhou, Yuanpin
    Lu, Yao
    [J]. 2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [10] Discriminative and Consistent Similarities in Instance-Level Multiple Instance Learning
    Rastegari, Mohammad
    Hajishirzi, Hannaneh
    Farhadi, Ali
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 740 - 748
12345