Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning

被引:14
|
作者
Teramoto, Atsushi [1 ]
Kiriyama, Yuka [2 ]
Tsukamoto, Tetsuya [2 ]
Sakurai, Eiko [2 ]
Michiba, Ayano [3 ]
Imaizumi, Kazuyoshi [2 ]
Saito, Kuniaki [1 ]
Fujita, Hiroshi [4 ]
机构
[1] Fujita Hlth Univ, Sch Med Sci, Toyoake, Aichi, Japan
[2] Fujita Hlth Univ, Sch Med, Toyoake, Aichi, Japan
[3] Fujita Hlth Univ, Grad Sch Med, Toyoake, Aichi, Japan
[4] Gifu Univ, Fac Engn, Gifu, Japan
关键词
D O I
10.1038/s41598-021-99246-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label all cells. In this study, we developed a weakly supervised method for the classification of benign and malignant lung cells in cytological images using attention-based deep multiple instance learning (AD MIL). Images of lung cytological specimens were divided into small patch images and stored in bags. Each bag was then labeled as benign or malignant, and classification was conducted using AD MIL. The distribution of attention weights was also calculated as a color map to confirm the presence of malignant cells in the image. AD MIL using the AlexNet-like convolutional neural network model showed the best classification performance, with an accuracy of 0.916, which was better than that of supervised learning. In addition, an attention map of the entire image based on the attention weight allowed AD MIL to focus on most malignant cells. Our weakly supervised method automatically classifies cytological images with acceptable accuracy based on supervised learning without complex annotations.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
    Atsushi Teramoto
    Yuka Kiriyama
    Tetsuya Tsukamoto
    Eiko Sakurai
    Ayano Michiba
    Kazuyoshi Imaizumi
    Kuniaki Saito
    Hiroshi Fujita
    [J]. Scientific Reports, 11
  • [2] ACTIVE LEARNING ENHANCES CLASSIFICATION OF HISTOPATHOLOGY WHOLE SLIDE IMAGES WITH ATTENTION-BASED MULTIPLE INSTANCE LEARNING
    Sadafi, Ario
    Navab, Nassir
    Marr, Carsten
    [J]. 2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [3] Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning
    Zhao, Lu
    Xu, Xiaowei
    Hou, Runping
    Zhao, Wangyuan
    Zhong, Hai
    Teng, Haohua
    Han, Yuchen
    Fu, Xiaolong
    Sun, Jianqi
    Zhao, Jun
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2021, 66 (23):
  • [4] Ensemble Learning With Attention-Based Multiple Instance Pooling for Classification of SPT
    Zhou, Qinghua
    Zhang, Xin
    Zhang, Yu-Dong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 1927 - 1931
  • [5] Attention-based Deep Multiple Instance Learning
    Ilse, Maximilian
    Tomczak, Jakub M.
    Welling, Max
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [6] Attention-Based Target Localization Using Multiple Instance Learning
    Sankaranarayanan, Karthik
    Davis, James W.
    [J]. ADVANCES IN VISUAL COMPUTING, PT I, 2010, 6453 : 381 - 392
  • [7] Lung cancer diagnosis using deep attention-based multiple instance learning and radiomics
    Chen, Junhua
    Zeng, Haiyan
    Zhang, Chong
    Shi, Zhenwei
    Dekker, Andre
    Wee, Leonard
    Bermejo, Inigo
    [J]. MEDICAL PHYSICS, 2022, 49 (05) : 3134 - 3143
  • [8] Kernel Self-Attention for Weakly-supervised Image Classification using Deep Multiple Instance Learning
    Rymarczyk, Dawid
    Borowa, Adriana
    Tabor, Jacek
    Zielinski, Bartosz
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1720 - 1729
  • [9] ATTENTION-BASED DEEP MULTIPLE INSTANCE LEARNING WITH ADAPTIVE INSTANCE SAMPLING
    Tarkhan, Aliasghar
    Trung Kien Nguyen
    Simon, Noah
    Bengtsson, Thomas
    Ocampo, Paolo
    Dai, Jian
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [10] Weakly Supervised Pain Localization using Multiple Instance Learning
    Sikka, Karan
    Dhall, Abhinav
    Bartlett, Marian
    [J]. 2013 10TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG), 2013,