UPL-SFDA: Uncertainty-Aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

被引:12
|
作者
Wu, Jianghao [1 ]
Wang, Guotai [1 ,2 ]
Gu, Ran [1 ]
Lu, Tao [3 ]
Chen, Yinan [4 ]
Zhu, Wentao [5 ]
Vercauteren, Tom [6 ]
Ourselin, Sebastien [6 ]
Zhang, Shaoting [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Univ Elect Sci & Technol China, Sichuan Prov Peoples Hosp, Dept Radiol, Chengdu 610072, Peoples R China
[4] SenseTime Res, Shanghai 200233, Peoples R China
[5] Zhejiang Lab, Res Ctr Healthcare Data Sci, Hangzhou 311100, Peoples R China
[6] Kings Coll London, Sch Biomed Engn & Imaging Sci, London WC2R 2LS, England
基金
中国国家自然科学基金;
关键词
Adaptation models; Predictive models; Image segmentation; Training; Entropy; Minimization; Head; Source-free domain adaptation; self-training; fetal MRI; heart MRI; entropy minimization; FETAL-BRAIN MRI;
D O I
10.1109/TMI.2023.3318364
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Domain Adaptation (DA) is important for deep learning-based medical image segmentation models to deal with testing images from a new target domain. As the source-domain data are usually unavailable when a trained model is deployed at a new center, Source-Free Domain Adaptation (SFDA) is appealing for data and annotation-efficient adaptation to the target domain. However, existing SFDA methods have a limited performance due to lack of sufficient supervision with source-domain images unavailable and target-domain images unlabeled. We propose a novel Uncertainty-aware Pseudo Label guided (UPL) SFDA method for medical image segmentation. Specifically, we propose Target Domain Growing (TDG) to enhance the diversity of predictions in the target domain by duplicating the pre-trained model's prediction head multiple times with perturbations. The different predictions in these duplicated heads are used to obtain pseudo labels for unlabeled target-domain images and their uncertainty to identify reliable pseudo labels. We also propose a Twice Forward pass Supervision (TFS) strategy that uses reliable pseudo labels obtained in one forward pass to supervise predictions in the next forward pass. The adaptation is further regularized by a mean prediction-based entropy minimization term that encourages confident and consistent results in different prediction heads. UPL-SFDA was validated with a multi-site heart MRI segmentation dataset, a cross-modality fetal brain segmentation dataset, and a 3D fetal tissue segmentation dataset. It improved the average Dice by 5.54, 5.01 and 6.89 percentage points for the three tasks compared with the baseline, respectively, and outperformed several state-of-the-art SFDA methods.
引用
收藏
页码:3932 / 3943
页数:12
相关论文
共 50 条
  • [1] Uncertainty-aware pseudo-label filtering for source-free unsupervised domain adaptation
    Chen, Xi
    Yang, Haosen
    Zhang, Huicong
    Yao, Hongxun
    Zhu, Xiatian
    NEUROCOMPUTING, 2024, 575
  • [2] IPLC: Iterative Pseudo Label Correction Guided by SAM for Source-Free Domain Adaptation in Medical Image Segmentation
    Zhang, Guoning
    Qi, Xiaoran
    Yan, Bo
    Wang, Guotai
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 351 - 360
  • [3] Uncertainty-Aware Source-Free Domain Adaptive Semantic Segmentation
    Lu, Zhihe
    Li, Da
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M. M.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4664 - 4676
  • [4] UPL-TTA: Uncertainty-Aware Pseudo Label Guided Fully Test Time Adaptation for Fetal Brain Segmentation
    Wu, Jianghao
    Gu, Ran
    Lu, Tao
    Zhang, Shaoting
    Wang, Guotai
    INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2023, 2023, 13939 : 237 - 249
  • [5] ADAPTIVE PSEUDO LABELING FOR SOURCE-FREE DOMAIN ADAPTATION IN MEDICAL IMAGE SEGMENTATION
    Li, Chen
    Chen, Wei
    Luo, Xin
    He, Yulin
    Tan, Yusong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1091 - 1095
  • [6] A Chebyshev Confidence Guided Source-Free Domain Adaptation Framework for Medical Image Segmentation
    Hu, Jiesi
    Yang, Yanwu
    Guo, Xutao
    Ma, Ting
    Wang, Jinghua
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (09) : 5473 - 5486
  • [7] Source-free domain adaptation for image segmentation
    Bateson, Mathilde
    Kervadec, Hoel
    Dolz, Jose
    Lombaert, Herve
    Ben Ayed, Ismail
    MEDICAL IMAGE ANALYSIS, 2022, 82
  • [8] Uncertainty-Guided Source-Free Domain Adaptation
    Roy, Subhankar
    Trapp, Martin
    Pilzer, Andrea
    Kannala, Juho
    Sebe, Nicu
    Ricci, Elisa
    Solin, Arno
    COMPUTER VISION, ECCV 2022, PT XXV, 2022, 13685 : 537 - 555
  • [9] Context-Aware Pseudo-label Refinement for Source-Free Domain Adaptive Fundus Image Segmentation
    Huai, Zheang
    Ding, Xinpeng
    Li, Yi
    Li, Xiaomeng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VII, 2023, 14226 : 618 - 628
  • [10] Uncertainty-aware Pseudo Label Refinery for Domain Adaptive Semantic Segmentation
    Wang, Yuxi
    Peng, Junran
    Zhang, Zhaoxiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9072 - 9081