Liver Segmentation via Learning Cross-Modality Content-Aware Representation

被引:0
|
作者
Lin, Xingxiao [1 ]
Ji, Zexuan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
基金
美国国家科学基金会;
关键词
Segmentation; Cross-modality; Domain adaptation; Liver;
D O I
10.1007/978-981-99-8558-6_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Liver segmentation has important clinical implications using computed tomography (CT) and magnetic resonance imaging (MRI). MRI has complementary characteristics to improve the accuracy of medical analysis tasks. Compared with MRI, CT images of the liver are more abundant and readily available. Ideally, it is promising to transfer learned knowledge from the CT images with labels to the target domain MR images by unsupervised domain adaptation. In this paper, we propose a novel framework, i.e. cross-modality content-aware representation (CMCAR), to alleviate domain shifts for cross-modality semantic segmentation. The proposed framework mainly consists of two modules in an end-to-end manner. One module is an image-to-image translation network based on the generative adversarial method and representation disentanglement. The other module is a mutual learning model to reduce further the semantic gap between synthesis images and real images. Our model is validated on two cross-modality semantic segmentation datasets. Experimental results demonstrate that the proposed model outperforms state-of-the-art methods.
引用
收藏
页码:198 / 208
页数:11
相关论文
共 50 条
  • [1] Unsupervised Cross-modality Cardiac Image Segmentation via Disentangled Representation Learning and Consistency Regularization
    Wang, Runze
    Zheng, Guoyan
    [J]. MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 517 - 526
  • [2] Representation Learning for Cross-Modality Classification
    van Tulder, Gijs
    de Bruijne, Marleen
    [J]. MEDICAL COMPUTER VISION AND BAYESIAN AND GRAPHICAL MODELS FOR BIOMEDICAL IMAGING, 2017, 10081 : 126 - 136
  • [3] Anatomy-Regularized Representation Learning for Cross-Modality Medical Image Segmentation
    Chen, Xu
    Lian, Chunfeng
    Wang, Li
    Deng, Hannah
    Kuang, Tianshu
    Fung, Steve
    Gateno, Jaime
    Yap, Pew-Thian
    Xia, James J.
    Shen, Dinggang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (01) : 274 - 285
  • [4] Representation Learning Through Cross-Modality Supervision
    Sankaran, Nishant
    Mohan, Deen Dayal
    Setlur, Srirangaraj
    Govindaraju, Venugopal
    Fedorishin, Dennis
    [J]. 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 107 - 114
  • [5] Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learning
    Hong, Jin
    Yu, Simon Chun-Ho
    Chen, Weitian
    [J]. APPLIED SOFT COMPUTING, 2022, 121
  • [6] Cross-Modality Deep Transfer Learning: Application to Liver Segmentation in CT and MRI
    Bibars, Merna
    Salah, Peter E.
    Eldeib, Ayman
    Elattar, Mustafa A.
    Yassine, Inas A.
    [J]. MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, MIUA 2023, 2024, 14122 : 96 - 110
  • [7] Blood vessel segmentation of fundus images via cross-modality dictionary learning
    Yang, Yan
    Shao, Feng
    Fu, Zhenqi
    Fu, Randi
    [J]. APPLIED OPTICS, 2018, 57 (25) : 7287 - 7295
  • [8] Robust video question answering via contrastive cross-modality representation learning
    Yang, Xun
    Zeng, Jianming
    Guo, Dan
    Wang, Shanshan
    Dong, Jianfeng
    Wang, Meng
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (10)
  • [9] Robust video question answering via contrastive cross-modality representation learning
    Xun YANG
    Jianming ZENG
    Dan GUO
    Shanshan WANG
    Jianfeng DONG
    Meng WANG
    [J]. Science China(Information Sciences)., 2024, 67 (10) - 226
  • [10] Cross-Modality Person Re-Identification via Modality-Aware Collaborative Ensemble Learning
    Ye, Mang
    Lan, Xiangyuan
    Leng, Qingming
    Shen, Jianbing
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 9387 - 9399