UPL-SFDA: Uncertainty-Aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

被引:12
|
作者
Wu, Jianghao [1 ]
Wang, Guotai [1 ,2 ]
Gu, Ran [1 ]
Lu, Tao [3 ]
Chen, Yinan [4 ]
Zhu, Wentao [5 ]
Vercauteren, Tom [6 ]
Ourselin, Sebastien [6 ]
Zhang, Shaoting [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Univ Elect Sci & Technol China, Sichuan Prov Peoples Hosp, Dept Radiol, Chengdu 610072, Peoples R China
[4] SenseTime Res, Shanghai 200233, Peoples R China
[5] Zhejiang Lab, Res Ctr Healthcare Data Sci, Hangzhou 311100, Peoples R China
[6] Kings Coll London, Sch Biomed Engn & Imaging Sci, London WC2R 2LS, England
基金
中国国家自然科学基金;
关键词
Adaptation models; Predictive models; Image segmentation; Training; Entropy; Minimization; Head; Source-free domain adaptation; self-training; fetal MRI; heart MRI; entropy minimization; FETAL-BRAIN MRI;
D O I
10.1109/TMI.2023.3318364
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Domain Adaptation (DA) is important for deep learning-based medical image segmentation models to deal with testing images from a new target domain. As the source-domain data are usually unavailable when a trained model is deployed at a new center, Source-Free Domain Adaptation (SFDA) is appealing for data and annotation-efficient adaptation to the target domain. However, existing SFDA methods have a limited performance due to lack of sufficient supervision with source-domain images unavailable and target-domain images unlabeled. We propose a novel Uncertainty-aware Pseudo Label guided (UPL) SFDA method for medical image segmentation. Specifically, we propose Target Domain Growing (TDG) to enhance the diversity of predictions in the target domain by duplicating the pre-trained model's prediction head multiple times with perturbations. The different predictions in these duplicated heads are used to obtain pseudo labels for unlabeled target-domain images and their uncertainty to identify reliable pseudo labels. We also propose a Twice Forward pass Supervision (TFS) strategy that uses reliable pseudo labels obtained in one forward pass to supervise predictions in the next forward pass. The adaptation is further regularized by a mean prediction-based entropy minimization term that encourages confident and consistent results in different prediction heads. UPL-SFDA was validated with a multi-site heart MRI segmentation dataset, a cross-modality fetal brain segmentation dataset, and a 3D fetal tissue segmentation dataset. It improved the average Dice by 5.54, 5.01 and 6.89 percentage points for the three tasks compared with the baseline, respectively, and outperformed several state-of-the-art SFDA methods.
引用
收藏
页码:3932 / 3943
页数:12
相关论文
共 50 条
  • [41] Enhancing source-free domain adaptation in Medical Image Segmentation via regulated model self-training
    Zhang, Tianwei
    Li, Kang
    Gu, Shi
    Heng, Pheng-Ann
    MEDICAL IMAGE ANALYSIS, 2025, 102
  • [42] Uncertainty-Aware Hierarchical Aggregation Network for Medical Image Segmentation
    Zhou, Tao
    Zhou, Yi
    Li, Guangyu
    Chen, Geng
    Shen, Jianbing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7440 - 7453
  • [43] SALAD : Source-free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection
    Kothandaraman, Divya
    Shekhar, Sumit
    Sancheti, Abhilasha
    Ghuhan, Manoj
    Shukla, Tripti
    Manocha, Dinesh
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 382 - 391
  • [44] Source-Free Domain Adaptation for Point Cloud Semantic Segmentation
    Duan, Jianshe
    Zhang, Yachao
    Qu, Yanyun
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,
  • [45] Source-Free Open Compound Domain Adaptation in Semantic Segmentation
    Zhao, Yuyang
    Zhong, Zhun
    Luo, Zhiming
    Lee, Gim Hee
    Sebe, Nicu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 7019 - 7032
  • [46] Unsupervised model adaptation for source-free segmentation of medical images
    Stan, Serban
    Rostami, Mohammad
    MEDICAL IMAGE ANALYSIS, 2024, 95
  • [47] Source-free domain transfer algorithm with reduced style sensitivity for medical image segmentation
    Lin, Jian
    Yu, Xiaomin
    Wang, Zhengxian
    Ma, Chaoqiong
    PLOS ONE, 2024, 19 (12):
  • [48] Pseudo-label refinement via hierarchical contrastive learning for source-free unsupervised domain adaptation
    Li, Deng
    Zhang, Jianguang
    Wu, Kunhong
    Shi, Yucheng
    Han, Yahong
    PATTERN RECOGNITION LETTERS, 2024, 186 : 236 - 242
  • [49] Source-Free Domain Adaptation for Medical Image Segmentation via Prototype-Anchored Feature Alignment and Contrastive Learning
    Yu, Qinji
    Xi, Nan
    Yuan, Junsong
    Zhou, Ziyu
    Dang, Kang
    Ding, Xiaowei
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VII, 2023, 14226 : 3 - 12
  • [50] Dual consistent pseudo label generation for multi-source domain adaptation without source data for medical image segmentation
    Cai, Binke
    Ma, Liyan
    Sun, Yan
    FRONTIERS IN NEUROSCIENCE, 2023, 17