Semi-supervise d me dical image segmentation via a triple d-uncertainty guided mean teacher model with contrastive learning

被引:100
|
作者
Wang, Kaiping [1 ]
Zhan, Bo [1 ]
Zu, Chen [2 ]
Wu, Xi [3 ]
Zhou, Jiliu [1 ,3 ]
Zhou, Luping [4 ]
Wang, Yan [1 ]
机构
[1] Sichuan Univ, Sch Comp Sci, Chengdu, Peoples R China
[2] JDCOM, Dept Risk Controlling Res, Beijing, Peoples R China
[3] Chengdu Univ Informat Technol, Sch Comp Sci, Chengdu, Peoples R China
[4] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW, Australia
关键词
Semi-supervised segmentation; Mean teacher; Multi-task learning; Tripled-uncertainty; Contrastive learning;
D O I
10.1016/j.media.2022.102447
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the difficulty in accessing a large amount of labeled data, semi-supervised learning is becoming an attractive solution in medical image segmentation. To make use of unlabeled data, current popular semisupervised methods (e.g., temporal ensembling, mean teacher) mainly impose data-level and model-level consistency on unlabeled data. In this paper, we argue that in addition to these strategies, we could further utilize auxiliary tasks and consider task-level consistency to better excavate effective representations from unlabeled data for segmentation. Specifically, we introduce two auxiliary tasks, i.e., a foreground and background reconstruction task for capturing semantic information and a signed distance field (SDF) prediction task for imposing shape constraint, and explore the mutual promotion effect between the two auxiliary and the segmentation tasks based on mean teacher architecture. Moreover, to handle the potential bias of the teacher model caused by annotation scarcity, we develop a tripled-uncertainty guided framework to encourage the three tasks in the student model to learn more reliable knowledge from the teacher. When calculating uncertainty, we propose an uncertainty weighted integration (UWI) strategy for yielding the segmentation predictions of the teacher. In addition, following the advance of unsupervised learning in leveraging the unlabeled data, we also incorporate a contrastive learning based constraint to help the encoders extract more distinct representations to promote the medical image segmentation performance. Extensive experiments on the public 2017 ACDC dataset and the PROMISE12 dataset have demonstrated the effectiveness of our method.
引用
收藏
页数:14
相关论文
共 19 条
  • [1] Uncertainty-aware multi-view co-training for semi-supervise d me dical image segmentation and domain adaptation
    Xia, Yingda
    Yang, Dong
    Yu, Zhiding
    Liu, Fengze
    Cai, Jinzheng
    Yu, Lequan
    Zhu, Zhuotun
    Xu, Daguang
    Yuille, Alan
    Roth, Holger
    MEDICAL IMAGE ANALYSIS, 2020, 65 (65)
  • [2] Tripled-Uncertainty Guided Mean Teacher Model for Semi-supervised Medical Image Segmentation
    Wang, Kaiping
    Zhan, Bo
    Zu, Chen
    Wu, Xi
    Zhou, Jiliu
    Zhou, Luping
    Wang, Yan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 450 - 460
  • [3] Residual attention based uncertainty-guided mean teacher model for semi-supervised breast masses segmentation in 2D ultrasonography
    Farooq, Muhammad Umar
    Ullah, Zahid
    Gwak, Jeonghwan
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 104
  • [4] Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation
    Hua, Yu
    Shu, Xin
    Wang, Zizhou
    Zhang, Lei
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (04)
  • [5] Constantly optimized mean teacher for semi-supervised 3D MRI image segmentation
    Li, Ning
    Pan, Yudong
    Qiu, Wei
    Xiong, Lianjin
    Wang, Yaobin
    Zhang, Yangsong
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2024, 62 (07) : 2231 - 2245
  • [6] Dual Attention Based Uncertainty-aware Mean Teacher Model for Semi-supervised Cardiac Image Segmentation
    Xu, An
    Wang, Shaoyu
    Fan, Jingyi
    Shi, Xiujin
    Chen, Qiang
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 82 - 86
  • [7] A regularization-driven Mean Teacher model based on semi-supervised learning for medical image segmentation
    Wang, Qing
    Li, Xiang
    Chen, Mingzhi
    Chen, Lingna
    Chen, Junxi
    PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (17):
  • [8] SEMI-SUPERVISED CONTRASTIVE LEARNING OF GLOBAL AND LOCAL REPRESENTATION FOR 3D MEDICAL IMAGE SEGMENTATION
    Jia, Chuang
    Xue, Jian
    Lu, Ke
    Wu, Zhongqi
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 26 - 30
  • [9] Dual Uncertainty-Guided Mixing Consistency for Semi-Supervised 3D Medical Image Segmentation
    Xu, Chenchu
    Yang, Yuan
    Xia, Zhiqiang
    Wang, Boyan
    Zhang, Dong
    Zhang, Yanping
    Zhao, Shu
    IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (04) : 1156 - 1170
  • [10] A novel Parallel Cooperative Mean-Teacher framework (PCMT) combined with prediction uncertainty guide and class contrastive learning for semi-supervised polyp segmentation
    Xia, Yang
    Yun, Haijiao
    Liu, Peiyu
    Li, Mingjing
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255