EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

被引:13
|
作者
Yang, Jingyi [1 ]
Jiao, Licheng [1 ]
Shang, Ronghua [1 ]
Liu, Xu [1 ]
Li, Ruiyang [2 ]
Xu, Longchang [2 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; convolu-tional neural networks; transformer; attention mechanism; ARCHITECTURE; ATTENTION;
D O I
10.1109/TMI.2023.3278461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The convolutional neural network has achieved remarkable results in most medical image seg- mentation applications. However, the intrinsic locality of convolution operation has limitations in modeling the long-range dependency. Although the Transformer designed for sequence-to-sequence global prediction was born to solve this problem, it may lead to limited positioning capability due to insufficient low-level detail features. Moreover, low-level features have rich fine-grained information, which greatly impacts edge segmentation decisions of different organs. However, a simple CNN module is difficult to capture the edge information in fine-grained features, and the computational power and memory consumed in processing high-resolution 3D features are costly. This paper proposes an encoder-decoder network that effectively combines edge perception and Transformer structure to segment medical images accurately, called EPT-Net. Under this framework, this paper proposes a Dual Position Transformer to enhance the 3D spatial positioning ability effectively. In addition, as low-level features contain detailed information, we conduct an Edge Weight Guidance module to extract edge information by minimizing the edge information function without adding network parameters. Furthermore, we verified the effectiveness of the proposed method on three datasets, including SegTHOR 2019, Multi-Atlas Labeling Beyond the Cranial Vault and the re-labeled KiTS19 dataset called KiTS19-M by us. The experimental results show that EPT-Net has significantly improved compared with the state-of-the-art medical image segmentation method.
引用
收藏
页码:3229 / 3243
页数:15
相关论文
共 50 条
  • [11] CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
    Xie, Yutong
    Zhang, Jianpeng
    Shen, Chunhua
    Xia, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 171 - 180
  • [12] EDGE: Edge distillation and gap elimination for heterogeneous networks in 3D medical image segmentation
    Yu, Xiangchun
    Wu, Tianqi
    Zhang, Dingwen
    Zheng, Jian
    Wu, Jianqing
    KNOWLEDGE-BASED SYSTEMS, 2025, 314
  • [13] Hybrid 3D Medical Image Segmentation Using CNN and Frequency Transformer Fusion
    Labbihi, Ismayl
    Meslouhi, Othmane El
    Elassad, Zouhair Elamrani Abou
    Benaddy, Mohamed
    Kardouchi, Mustapha
    Akhloufi, Moulay
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [14] DEU-Net: Dual Encoder U-Net for 3D Medical Image Segmentation
    Zhou, Yuxiang
    Kang, Xin
    Ren, Fuji
    Nakagawa, Satoshi
    Shan, Xiao
    2023 IEEE 22ND INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, BIGDATASE, CSE, EUC, ISCI 2023, 2024, : 2735 - 2741
  • [15] 3D Medical Axial Transformer: A Lightweight Transformer Model for 3D Brain Tumor Segmentation
    Liu, Cheng
    Kiryu, Hisanori
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 799 - 813
  • [16] Improved Medical Image Segmentation Model Based on 3D U-Net
    林威
    范红
    胡晨熙
    杨宜
    禹素萍
    倪林
    JournalofDonghuaUniversity(EnglishEdition), 2022, 39 (04) : 311 - 316
  • [17] 3D medical image segmentation technique
    El-said, Shaimaa Ahmed
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2015, 17 (03) : 232 - 251
  • [18] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Wu, Yixuan
    Liao, Kuanlun
    Chen, Jintai
    Wang, Jinhong
    Chen, Danny Z.
    Gao, Honghao
    Wu, Jian
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (02): : 1931 - 1944
  • [19] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Yixuan Wu
    Kuanlun Liao
    Jintai Chen
    Jinhong Wang
    Danny Z. Chen
    Honghao Gao
    Jian Wu
    Neural Computing and Applications, 2023, 35 : 1931 - 1944
  • [20] 3D U2-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation
    Huang, Chao
    Han, Hu
    Yao, Qingsong
    Zhu, Shankuan
    Zhou, S. Kevin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 291 - 299