SEMI-SUPERVISED AND SELF-SUPERVISED COLLABORATIVE LEARNING FOR PROSTATE 3D MR IMAGE SEGMENTATION

被引:0
|
作者
Osman, Yousuf Babiker M. [1 ,2 ]
Li, Cheng [1 ]
Huang, Weijian [1 ,2 ]
Elsayed, Nazik [1 ,2 ,4 ]
Ying, Leslie [5 ,6 ]
Zheng, Hairong [1 ]
Wang, Shanshan [1 ,3 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Paul C Lauterbur Res Ctr Biomed Imaging, Shenzhen, Guangdong, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 3, Peoples R China
[3] Guangdong Prov Key Lab Artificial Intelligence Me, Guangzhou, Guangdong, Peoples R China
[4] Univ Gezira, Fac Math & Comp Sci, Wad Madani, Sudan
[5] SUNY Buffalo, Dept Biomed Engn, New York, NY USA
[6] SUNY Buffalo, Dept Elect Engn, New York, NY USA
基金
中国国家自然科学基金;
关键词
Semi-Supervised Learning; Self-Supervised Learning; Pseudo Labeling; Sparse Annotation;
D O I
10.1109/ISBI53787.2023.10230326
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Volumetric magnetic resonance (MR) image segmentation plays an important role in many clinical applications. Deep learning (DL) has recently achieved state-of-the-art or even human-level performance on various image segmentation tasks. Nevertheless, manually annotating volumetric MR images for DL model training is labor-exhaustive and time-consuming. In this work, we aim to train a semi-supervised and self-supervised collaborative learning framework for prostate 3D MR image segmentation while using extremely sparse annotations, for which the ground truth annotations are provided for just the central slice of each volumetric MR image. Specifically, semi-supervised learning and self-supervised learning methods are used to generate two independent sets of pseudo labels. These pseudo labels are then fused by the Boolean operation to extract a more confident pseudo label set. The images with either manual or network self-generated labels are then employed to train a segmentation model for target volume extraction. Experimental results on a publicly available prostate MR image dataset demonstrate that, while requiring significantly less annotation effort, our framework generates very encouraging segmentation results. The proposed framework is very useful in clinical applications when training data with dense annotations are difficult to obtain.
引用
收藏
页数:4
相关论文
共 50 条
  • [41] Joint Supervised and Self-Supervised Learning for 3D Real World Challenges
    Alliegro, Antonio
    Boscaini, Davide
    Tommasi, Tatiana
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6718 - 6725
  • [42] Self-Supervised Feature Extraction for 3D Axon Segmentation
    Klinghoffer, Tzofi
    Morales, Peter
    Park, Young-Gyun
    Evans, Nicholas
    Chung, Kwanghun
    Brattain, Laura J.
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4213 - 4219
  • [43] Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimation
    Hoyer, Lukas
    Dai, Dengxin
    Wang, Qin
    Chen, Yuhua
    Van Gool, Luc
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (08) : 2070 - 2096
  • [44] Self-Supervised Skill Learning for Semi-Supervised Long-Horizon Instruction Following
    Zhuang, Benhui
    Zhang, Chunhong
    Hu, Zheng
    ELECTRONICS, 2023, 12 (07)
  • [45] Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimation
    Lukas Hoyer
    Dengxin Dai
    Qin Wang
    Yuhua Chen
    Luc Van Gool
    International Journal of Computer Vision, 2023, 131 : 2070 - 2096
  • [46] Semi-supervised vessel wall detection and segmentation from 3D femoral MR images
    Yan, Qinhong
    Chiu, Bernard
    MEDICAL IMAGING 2023, 2023, 12464
  • [47] Self-supervised Pre-training and Semi-supervised Learning for Extractive Dialog Summarization
    Zhuang, Yingying
    Song, Jiecheng
    Sadagopan, Narayanan
    Beniwal, Anurag
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1069 - 1076
  • [48] Exploiting Self-Supervised and Semi-Supervised Learning for Facial Landmark Tracking with Unlabeled Data
    Yin, Shi
    Wang, Shangfei
    Chen, Xiaoping
    Chen, Enhong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2991 - 2998
  • [49] Medical Instrument Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning
    Yang, Hongxu
    Shan, Caifeng
    Bouwman, Arthur
    Dekker, Lukas R. C.
    Kolen, Alexander F.
    de With, Peter H. N.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (02) : 762 - 773
  • [50] Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
    Eldele, Emadeldeen
    Ragab, Mohamed
    Chen, Zhenghua
    Wu, Min
    Kwoh, Chee-Keong
    Li, Xiaoli
    Guan, Cuntai
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15604 - 15618