CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images

被引:0
|
作者
Zhao, Lu [1 ]
Zhao, Wangyuan [1 ]
Qiu, Lu [1 ]
Jiang, Mengqi [2 ]
Qian, Liqiang [3 ]
Ting, Hua-Nong [4 ]
Fu, Xiaolong [2 ]
Zhang, Puming [1 ]
Han, Yuchen [5 ]
Zhao, Jun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] Shanghai Chest Hosp, Dept Radiat Oncol, Shanghai, Peoples R China
[3] Shanghai Chest Hosp, Dept Thorac Surg, Shanghai, Peoples R China
[4] Univ Malaya, Dept Biomed Engn, Kuala Lumpur, Malaysia
[5] Shanghai Chest Hosp, Dept Pathol, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Lung cancer; Whole slide image; Contrastive learning; Image translation; Multiple instance learning; ARTIFICIAL-INTELLIGENCE; DIAGNOSIS;
D O I
10.1016/j.bspc.2024.107097
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin- embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining afresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] A point cloud self-learning network based on contrastive learning for classification and segmentation
    Zhou, Haoran
    Wang, Wenju
    Chen, Gang
    Wang, Xiaolin
    VISUAL COMPUTER, 2024, 40 (12): : 8455 - 8479
  • [32] Classification of hyperspectral remote sensing images based on simulated annealing genetic algorithm and multiple instance learning
    Hong-min Gao
    Hui Zhou
    Li-zhong Xu
    Ai-ye Shi
    Journal of Central South University, 2014, 21 : 262 - 271
  • [33] A MIL-based framework via contrastive instance learning and multimodal learning for long-term ECG classification
    Han, Haozhan
    Lian, Cheng
    Xu, Bingrong
    Zeng, Zhigang
    Alhudhaif, Adi
    Polat, Kemal
    APPLIED SOFT COMPUTING, 2024, 167
  • [34] Anomaly classification in digital mammography based on multiple-instance learning
    Elmoufidi, Abdelali
    El Fahssi, Khalid
    Jai-andaloussi, Said
    Sekkaki, Abderrahim
    Gwenole, Quellec
    Lamard, Mathieu
    IET IMAGE PROCESSING, 2018, 12 (03) : 320 - 328
  • [35] Breast Ultrasound Image Classification Based on Multiple-Instance Learning
    Jianrui Ding
    H. D. Cheng
    Jianhua Huang
    Jiafeng Liu
    Yingtao Zhang
    Journal of Digital Imaging, 2012, 25 : 620 - 627
  • [36] Multiple-instance learning-based sonar image classification
    Cobb, J. Tory
    Du, Xiaoxiao
    Zare, Alina
    Emigh, Matthew
    DETECTION AND SENSING OF MINES, EXPLOSIVE OBJECTS, AND OBSCURED TARGETS XXII, 2017, 10182
  • [37] A Similarity-Based Classification Framework For Multiple-Instance Learning
    Xiao, Yanshan
    Liu, Bo
    Hao, Zhifeng
    Cao, Longbing
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (04) : 500 - 515
  • [38] Image classification and indexing by EM based multiple-instance learning
    Pao, H. T.
    Xu, Y. Y.
    Chuang, S. C.
    Fu, H. C.
    ADVANCES IN VISUAL INFORMATION SYSTEMS, 2007, 4781 : 146 - +
  • [39] Breast Ultrasound Image Classification Based on Multiple-Instance Learning
    Ding, Jianrui
    Cheng, H. D.
    Huang, Jianhua
    Liu, Jiafeng
    Zhang, Yingtao
    JOURNAL OF DIGITAL IMAGING, 2012, 25 (05) : 620 - 627
  • [40] Deep contrastive learning based hybrid network for Typhoon intensity classification
    Yin, Pengshuai
    Fang, Yupeng
    Chen, Huanxin
    Huang, Huichou
    Wan, Qilin
    Wu, Qingyao
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252