EFFICIENT 3D TRANSFORMER WITH CLUSTER-BASED DOMAIN-ADVERSARIAL LEARNING FOR 3D MEDICAL IMAGE SEGMENTATION

被引:0
|
作者
Zhang, Haoran [1 ]
Chen, Hao [2 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] Hong Kong Univ Sci & Technol, Dept Chem & Biol Engn, Hong Kong, Peoples R China
关键词
Medical image segmentation; Efficient 3D Transformer; Domain-adversarial learning;
D O I
10.1109/ISBI53787.2023.10230683
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-world application of volumetric medical image segmentation is still challenging due to the domain shift problem and the disability to process volumetric information efficiently by existing algorithms. To address these problems, we propose a 3D Swin Transformer with a pyramidal downsampling strategy to process volumetric information efficiently, dubbed as PDSwin. Specifically, the improved 3D Swin Transformer includes a spatial downsampling strategy that downsamples 2D slices pyramidally according to the spatial relationship, reducing the computation complexity while providing a wider downsampled receptive field. Furthermore, we propose a cluster-based domain-adversarial learning algorithm to attenuate the domain shift problem. The algorithm generates fine-grained cluster-based domains instead of employing center-based domains, ameliorating the domain-adversarial learning performance. We evaluated our model against other competitive models on brain stroke lesion segmentation and prostate segmentation tasks. Extensive experimental results indicated that our proposed model outperforms other models, demonstrating the efficacy of our proposed method.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] A Transformer-Based Network for Anisotropic 3D Medical Image Segmentation
    Guo, Danfeng
    Terzopoulos, Demetri
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8857 - 8861
  • [2] Efficient 3D Deep Learning Model for Medical Image Semantic Segmentation
    Alalwan, Nasser
    Abozeid, Amr
    ElHabshy, AbdAllah A.
    Alzahrani, Ahmed
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2021, 60 (01) : 1231 - 1239
  • [3] nnFormer: Volumetric Medical Image Segmentation via a 3D Transformer
    Zhou, Hong-Yu
    Guo, Jiansen
    Zhang, Yinghao
    Han, Xiaoguang
    Yu, Lequan
    Wang, Liansheng
    Yu, Yizhou
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4036 - 4045
  • [4] 3D Medical Axial Transformer: A Lightweight Transformer Model for 3D Brain Tumor Segmentation
    Liu, Cheng
    Kiryu, Hisanori
    [J]. MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 799 - 813
  • [5] Efficient combined algorithm of Transformer and U-Net for 3D medical image segmentation
    Zhang, Mingyan
    Wang, Aixia
    Yang, Gang
    Li, Jingjiao
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4377 - 4382
  • [6] 3D medical image segmentation technique
    El-said, Shaimaa Ahmed
    [J]. INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2015, 17 (03) : 232 - 251
  • [7] Efficient 3D Semantic Segmentation with Superpoint Transformer
    Robert, Damien
    Raguet, Hugo
    Landrieu, Loic
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17149 - 17158
  • [8] Clusterformer: Cluster-based Transformer for 3D Object Detection in Point Clouds
    Pei, Yu
    Zhao, Xian
    Li, Hao
    Ma, Jingyuan
    Zhang, Jingwei
    Pu, Shiliang
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6641 - 6650
  • [9] A 3D Medical Image Segmentation Framework Fusing Convolution and Transformer Features
    Zhu, Fazhan
    Lv, Jiaxing
    Lu, Kun
    Wang, Wenyan
    Cong, Hongshou
    Zhang, Jun
    Chen, Peng
    Zhao, Yuan
    Wu, Ziheng
    [J]. INTELLIGENT COMPUTING THEORIES AND APPLICATION (ICIC 2022), PT I, 2022, 13393 : 772 - 786
  • [10] MCRformer: Morphological constraint reticular transformer for 3D medical image segmentation
    Li, Jun
    Chen, Nan
    Zhou, Han
    Lai, Taotao
    Dong, Heng
    Feng, Chunhui
    Chen, Riqing
    Yang, Changcai
    Cai, Fanggang
    Wei, Lifang
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 232