CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images

被引:0
|
作者
Zhao, Lu [1 ]
Zhao, Wangyuan [1 ]
Qiu, Lu [1 ]
Jiang, Mengqi [2 ]
Qian, Liqiang [3 ]
Ting, Hua-Nong [4 ]
Fu, Xiaolong [2 ]
Zhang, Puming [1 ]
Han, Yuchen [5 ]
Zhao, Jun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] Shanghai Chest Hosp, Dept Radiat Oncol, Shanghai, Peoples R China
[3] Shanghai Chest Hosp, Dept Thorac Surg, Shanghai, Peoples R China
[4] Univ Malaya, Dept Biomed Engn, Kuala Lumpur, Malaysia
[5] Shanghai Chest Hosp, Dept Pathol, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Lung cancer; Whole slide image; Contrastive learning; Image translation; Multiple instance learning; ARTIFICIAL-INTELLIGENCE; DIAGNOSIS;
D O I
10.1016/j.bspc.2024.107097
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin- embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining afresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] SMILE: Sparse-Attention based Multiple Instance Contrastive Learning for Glioma Sub-Type Classification Using Pathological Images
    Lu, Mengkang
    Pan, Yongsheng
    Nie, Dong
    Liu, Feihong
    Shi, Feng
    Xia, Yong
    Shen, Dinggang
    MICCAI WORKSHOP ON COMPUTATIONAL PATHOLOGY, VOL 156, 2021, 156 : 159 - 169
  • [2] Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
    Atsushi Teramoto
    Yuka Kiriyama
    Tetsuya Tsukamoto
    Eiko Sakurai
    Ayano Michiba
    Kazuyoshi Imaizumi
    Kuniaki Saito
    Hiroshi Fujita
    Scientific Reports, 11
  • [3] Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
    Teramoto, Atsushi
    Kiriyama, Yuka
    Tsukamoto, Tetsuya
    Sakurai, Eiko
    Michiba, Ayano
    Imaizumi, Kazuyoshi
    Saito, Kuniaki
    Fujita, Hiroshi
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [4] EVIDENCE DICTIONARY NETWORK USING MULTIPLE INSTANCE CONTRASTIVE LEARNING FOR EXPLAINABLE PATHOLOGICAL IMAGE ANALYSIS
    Uehara, Kazuki
    Uegami, Wataru
    Nosato, Hirokazu
    Murakawa, Masahiro
    Fukuoka, Junya
    Sakanashi, Hidenori
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [5] Multiple Instance Learning Research for the Classification of Lung Cancer in CT Diagnosis
    Chen, Huilong
    Zhang, Xiaoxia
    Zhou, Tong
    ENGINEERING LETTERS, 2024, 32 (07) : 1313 - 1324
  • [6] DOMAIN ADAPTIVE MULTIPLE INSTANCE LEARNING FOR INSTANCE-LEVEL PREDICTION OF PATHOLOGICAL IMAGES
    Takahama, Shusuke
    Kurose, Yusuke
    Mukuta, Yusuke
    Abe, Hiroyuki
    Yoshizawa, Akihiko
    Ushiku, Tetsuo
    Fukayama, Masashi
    Kitagawa, Masanobu
    Kitsuregawa, Masaru
    Harada, Tatsuya
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [7] Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learning
    Li, Bin
    Li, Yin
    Eliceiri, Kevin W.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14313 - 14323
  • [8] Diabetic Retinopathy Images Classification via Multiple Instance Learning
    Vocaturo, Eugenio
    Zumpano, Ester
    2021 IEEE/ACM CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES (CHASE 2021), 2021, : 143 - 148
  • [9] Transformer based multiple instance learning for WSI breast cancer classification
    Gao, Chengyang
    Sun, Qiule
    Zhu, Wen
    Zhang, Lizhi
    Zhang, Jianxin
    Liu, Bin
    Zhang, Junxing
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89
  • [10] Attention Based Deep Multiple Instance Learning Approach for Lung Cancer Prediction using Histopathological Images
    Moranguinho, Joao
    Pereira, Tania
    Ramos, Bernardo
    Morgado, Joana
    Costa, Jose Luis
    Oliveira, Helder P.
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2852 - 2855