Unsupervised Domain Adaptation with Contrastive Learning for OCT Segmentation

被引:5
|
作者
Gomariz, Alvaro [1 ]
Lu, Huanxiang [1 ]
Li, Yun Yvonna [1 ]
Albrecht, Thomas [1 ]
Maunz, Andreas [1 ]
Benmansour, Fethallah [1 ]
Valcarcel, Alessandra M. [2 ]
Luu, Jennifer [2 ]
Ferrara, Daniela [2 ]
Goksel, Orcun [3 ,4 ]
机构
[1] F Hoffmann La Roche & Cie AG, Basel, Switzerland
[2] Genentech Inc, South San Francisco, CA USA
[3] Swiss Fed Inst Technol, Comp Assisted Applicat Med, Zurich, Switzerland
[4] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
关键词
Segmentation of 3D volumes; Semi-supervised learning; FLUID;
D O I
10.1007/978-3-031-16452-1_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail for images that do not resemble labeled examples, e.g. for images acquired using different devices. We hereby propose a novel semi-supervised learning framework for segmentation of volumetric images from new unlabeled domains. We jointly use supervised and contrastive learning, also introducing a contrastive pairing scheme that leverages similarity between nearby slices in 3D. In addition, we propose channel-wise aggregation as an alternative to conventional spatial-pooling aggregation for contrastive feature map projection. We evaluate our methods for domain adaptation from a (labeled) source domain to an (unlabeled) target domain, each containing images acquired with different acquisition devices. In the target domain, our method achieves a Dice coefficient 13.8% higher than SimCLR (a state-of-the-art contrastive framework), and leads to results comparable to an upper bound with supervised training in that domain. In the source domain, our model also improves the results by 5.4% Dice, by successfully leveraging information from many unlabeled images.
引用
收藏
页码:351 / 361
页数:11
相关论文
共 50 条
  • [1] Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation
    Marsden, Robert A.
    Bartler, Alexander
    Doebler, Mario
    Yang, Bin
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [2] Domain Confused Contrastive Learning for Unsupervised Domain Adaptation
    Long, Quanyu
    Luo, Tianze
    Wang, Wenya
    Pan, Sinno Jialin
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 2982 - 2995
  • [3] Cross-Domain Contrastive Learning for Unsupervised Domain Adaptation
    Wang, Rui
    Wu, Zuxuan
    Weng, Zejia
    Chen, Jingjing
    Qi, Guo-Jun
    Jiang, Yu-Gang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1665 - 1673
  • [4] A Two-Stage Domain Adaptation Approach Based on Contrastive Learning and Unsupervised Semantic Segmentation
    Wu, Lei
    Wu, Tao
    Shi, Meiping
    Cao, Kai
    [J]. 2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 219 - 225
  • [5] Two-stage adversarial learning based unsupervised domain adaptation for retinal OCT segmentation
    Diao, Shengyong
    Yin, Ziting
    Chen, Xinjian
    Li, Menghan
    Zhu, Weifang
    Mateen, Muhammad
    Xu, Xun
    Shi, Fei
    Fan, Ying
    [J]. MEDICAL PHYSICS, 2024, 51 (08) : 5374 - 5385
  • [6] Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain Adaptation
    Shen, Kendrick
    Jones, Robbie
    Kumar, Ananya
    Xie, Sang Michael
    HaoChen, Jeff Z.
    Ma, Tengyu
    Liang, Percy
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022, : 19847 - 19878
  • [7] Contrastive Adaptation Network for Unsupervised Domain Adaptation
    Kang, Guoliang
    Jiang, Lu
    Yang, Yi
    Hauptmann, Alexander G.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4888 - 4897
  • [8] Task-oriented contrastive learning for unsupervised domain adaptation
    Wei, Xing
    Wen, Bin
    Yang, Fan
    Liu, Yujie
    Zhao, Chong
    Hu, Di
    Luo, Hui
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [9] Confidence-diffusion instance contrastive learning for unsupervised domain adaptation
    Tian, Qing
    Wu, Wangyuchen
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 293
  • [10] Contrastive Learning-Based Domain Adaptation for Semantic Segmentation
    Bhagwatkar, Rishika
    Kemekar, Saurabh
    Domatoti, Vinay
    Khan, Khursheed Munir
    Singh, Anamika
    [J]. 2022 NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2022, : 239 - 244