Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss

被引:12
|
作者
Peng, Zhen [1 ,3 ]
Tian, Shengwei [1 ,3 ]
Yu, Long [2 ]
Zhang, Dezhi [4 ,5 ,6 ]
Wu, Weidong [4 ,5 ,6 ]
Zhou, Shaofeng [1 ,3 ]
机构
[1] Xinjiang Univ, Collage Software, Urumqi 830000, Peoples R China
[2] Xinjiang Univ, Network Ctr, Urumqi 830046, Peoples R China
[3] Xinjiang Univ, Key Lab Software Engn Technol, Urumqi 830000, Peoples R China
[4] Peoples Hosp Xinjiang Uygur Autonomous Reg, Dept Dermatol & Venereol, Urumqi 830000, Peoples R China
[5] Xinjiang Clin Res Ctr Dermatol Dis, Urumqi 830000, Peoples R China
[6] Xinjiang Key Lab Dermatol Res XJYS1707, Urumqi 830000, Peoples R China
关键词
Semi-supervised learning; Pseudo-labeling; Contrastive learning; Medical image classification;
D O I
10.1016/j.bspc.2022.104142
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Semi-supervised learning (SSL) may employ unlabeled data to improve model performance, which has great significance in medical imaging tasks. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in medical image datasets: (1) the models' predictions are biased toward the majority class in imbalanced datasets, and (2) discarding unlabeled data with confidence below the thresholds results in the loss of useful information. To solve these issues, we propose a novel SSL framework, FullMatch, which improves the model's performance by utilizing all unlabeled data. Specifically, we propose adaptive threshold pseudo-labeling (ATPL), a method for generating pseudo-labels based on the model's current learning status. ATPL dynamically adjusts the thresholds for each class during the training process, which can generate more pseudo-labels for classes with learning difficulties, thus alleviating the problem of data imbalance. Unlike existing semi-supervised methods based on pseudo-labeling, we do not discard unlabeled data with confidence below the thresholds. We propose an unreliable sample contrastive loss (USCL) to leverage useful information from unlabeled data with confidence below the thresholds by learning the similarities and differences between sample features. To eval-uate the performance of the proposed method, we conducted experiments on the ISIC 2018 skin lesion classi-fication dataset and the blood cell classification dataset. The experimental results show that our method outperforms the state-of-the-art SSL methods.
引用
下载
收藏
页数:9
相关论文
共 50 条
  • [31] Semi-Supervised Multimodal Emotion Recognition with Class-Balanced Pseudo-Labeling
    Chen, Haifeng
    Guo, Chujia
    Li, Yan
    Zhang, Peng
    Jiang, Dongmei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9556 - 9560
  • [32] BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotation
    Zhang, Wenqiao
    Zhu, Lei
    Hallinan, James
    Zhang, Shengyu
    Makmur, Andrew
    Cai, Qingpeng
    Ooi, Beng Chin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20634 - 20644
  • [33] Compressed video ensemble based pseudo-labeling for semi-supervised action recognition
    Terao, Hayato
    Noguchi, Wataru
    Iizuka, Hiroyuki
    Yamamoto, Masahito
    MACHINE LEARNING WITH APPLICATIONS, 2022, 9
  • [34] Pseudo-labeling Algorithm Based on Optimal Transport for Deep Semi-supervised Learning
    Zhai, De-Ming
    Shen, Si-Xian
    Zhou, Xiong
    Jiang, Jun-Jun
    Liu, Xian-Ming
    Ji, Xiang-Yang
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (11): : 5196 - 5209
  • [35] Pseudolabel-Based Unreliable Sample Learning for Semi-Supervised Hyperspectral Image Classification
    Yao, Huaxiong
    Chen, Renyi
    Chen, Wenjing
    Sun, Hao
    Xie, Wei
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [36] Boosting semi-supervised learning under imbalanced regression via pseudo-labeling
    Zong, Nannan
    Su, Songzhi
    Zhou, Changle
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (19):
  • [37] CENTER BASED PSEUDO-LABELING FOR SEMI-SUPERVISED PERSON RE-IDENTIFICATION
    Ding, Guodong
    Zhang, Shanshan
    Khan, Salman
    Tang, Zhenmin
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
  • [38] Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization
    Takashima, Yuki
    Fujita, Yusuke
    Horiguchi, Shota
    Watanabe, Shinji
    Garcia, Paola
    Nagamatsu, Kenji
    INTERSPEECH 2021, 2021, : 3096 - 3100
  • [39] Pseudo-label Guided Contrastive Learning for Semi-supervised Medical Image Segmentation
    Basak, Hritam
    Yin, Zhaozheng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19786 - 19797
  • [40] Semi-Supervised Learning for Low-light Image Restoration through Quality Assisted Pseudo-Labeling
    Malik, Sameer
    Soundararajan, Rajiv
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4094 - 4103