CVMIL: Cluster Variance Multiple Instance Learning for Whole Slide Images Survival Prediction

被引:0
|
作者
Chen, Shiqi [1 ]
Cai, Du [2 ]
Li, Chenghang [3 ]
Wang, Ruixuan [1 ]
Gao, Feng [2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Guangdong, Peoples R China
[2] Sun Yat Sen Univ, Affiliated Hosp 6, Guangzhou, Guangdong, Peoples R China
[3] Hong Kong Univ Sci & Technol, Guangzhou, Guangdong, Peoples R China
关键词
whole slide image; computational pathology; survival prediction;
D O I
10.1145/3663976.3663993
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Tumor survival prediction using whole slide images (WSIs) is a crucial application in pathology aimed at assisting doctors in better formulating post-surgical treatment plans. The key challenges in current WSIs survival prediction lie in the vast scale of WSIs and the scarcity of manual annotations, which hinders the extraction of effective information from WSIs. To address these issues, previous studies have mainly employed the multiple instance learning (MIL) approach. However, existing methods often fail to consider the complexity of tumors and integrate clinically relevant knowledge, leading to suboptimal outcomes in survival prediction. To capture the intricate characteristics of tumors, we propose Cluster Variance Multiple Instance Learning (CVMIL) framework capable of representing tumor heterogeneity. By leveraging the differences from cluster centers, CVMIL represents both intra-tumor and inter-tumor heterogeneity, thereby enhancing the performance of MIL methods in WSI survival prediction. Results from prognosis tasks conducted on three publicly available TCGA datasets and the in-house ARGO dataset demonstrate that our approach outperforms current state-of-the-art methods, enabling more effective prediction of patient prognosis.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Deep Multi-instance Learning for Survival Prediction from Whole Slide Images
    Yao, Jiawen
    Zhu, Xinliang
    Huang, Junzhou
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I, 2019, 11764 : 496 - 504
  • [2] AdvMIL: Adversarial multiple instance learning for the survival analysis on whole-slide images
    Liu, Pei
    Ji, Luping
    Ye, Feng
    Fu, Bo
    [J]. MEDICAL IMAGE ANALYSIS, 2024, 91
  • [3] Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks
    Yao, Jiawen
    Zhu, Xinliang
    Jonnagaddala, Jitendra
    Hawkins, Nicholas
    Huang, Junzhou
    [J]. MEDICAL IMAGE ANALYSIS, 2020, 65
  • [4] Differentiable Zooming for Multiple Instance Learning on Whole-Slide Images
    Thandiackal, Kevin
    Chen, Boqi
    Pati, Pushpak
    Jaume, Guillaume
    Williamson, Drew F. K.
    Gabrani, Maria
    Goksel, Orcun
    [J]. COMPUTER VISION, ECCV 2022, PT XXI, 2022, 13681 : 699 - 715
  • [5] Immune subtyping of melanoma whole slide images using multiple instance learning
    Godson, Lucy
    Alemi, Navid
    Nsengimana, Jeremie
    Cook, Graham P.
    Clarke, Emily L.
    Treanor, Darren
    Bishop, D. Timothy
    Newton-Bishop, Julia
    Gooya, Ali
    Magee, Derek
    [J]. MEDICAL IMAGE ANALYSIS, 2024, 93
  • [6] MULTIPLE INSTANCE LEARNING WITH CRITICAL INSTANCE FOR WHOLE SLIDE IMAGE CLASSIFICATION
    Zhou, Yuanpin
    Lu, Yao
    [J]. 2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [7] Multiple instance learning for eosinophil quantification of sinonasal histopathology images: A hierarchical determination on whole slide images
    Hsu, Yen-Chi
    Lin, Kao-Tsung
    Lee, Ming-Sui
    Shen, Li-Sung
    Yeh, Te-Huei
    Lin, Yi-Tsen
    [J]. INTERNATIONAL FORUM OF ALLERGY & RHINOLOGY, 2024, 14 (09) : 1513 - 1516
  • [8] Weakly supervised instance learning for thyroid malignancy prediction from whole slide cytopathology images
    Dov, David
    Kovalsky, Shahar Z.
    Assaad, Serge
    Cohen, Jonathan
    Range, Danielle Elliott
    Pendse, Avani A.
    Henao, Ricardo
    Carin, Lawrence
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 67
  • [9] Learning Visual Features by Colorization for Slide-Consistent Survival Prediction from Whole Slide Images
    Fan, Lei
    Sowmya, Arcot
    Meijering, Erik
    Song, Yang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VIII, 2021, 12908 : 592 - 601
  • [10] Cancer Survival Prediction From Whole Slide Images With Self-Supervised Learning and Slide Consistency
    Fan, Lei
    Sowmya, Arcot
    Meijering, Erik
    Song, Yang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1401 - 1412