EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

被引:13
|
作者
Yang, Jingyi [1 ]
Jiao, Licheng [1 ]
Shang, Ronghua [1 ]
Liu, Xu [1 ]
Li, Ruiyang [2 ]
Xu, Longchang [2 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ China, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; convolu-tional neural networks; transformer; attention mechanism; ARCHITECTURE; ATTENTION;
D O I
10.1109/TMI.2023.3278461
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The convolutional neural network has achieved remarkable results in most medical image seg- mentation applications. However, the intrinsic locality of convolution operation has limitations in modeling the long-range dependency. Although the Transformer designed for sequence-to-sequence global prediction was born to solve this problem, it may lead to limited positioning capability due to insufficient low-level detail features. Moreover, low-level features have rich fine-grained information, which greatly impacts edge segmentation decisions of different organs. However, a simple CNN module is difficult to capture the edge information in fine-grained features, and the computational power and memory consumed in processing high-resolution 3D features are costly. This paper proposes an encoder-decoder network that effectively combines edge perception and Transformer structure to segment medical images accurately, called EPT-Net. Under this framework, this paper proposes a Dual Position Transformer to enhance the 3D spatial positioning ability effectively. In addition, as low-level features contain detailed information, we conduct an Edge Weight Guidance module to extract edge information by minimizing the edge information function without adding network parameters. Furthermore, we verified the effectiveness of the proposed method on three datasets, including SegTHOR 2019, Multi-Atlas Labeling Beyond the Cranial Vault and the re-labeled KiTS19 dataset called KiTS19-M by us. The experimental results show that EPT-Net has significantly improved compared with the state-of-the-art medical image segmentation method.
引用
收藏
页码:3229 / 3243
页数:15
相关论文
共 50 条
  • [41] Feature clustering algorithm for 3D medical image segmentation
    Li, Xinwu
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2008, 48 (SUPPL.): : 1790 - 1793
  • [42] Elastic Boundary Projection for 3D Medical Image Segmentation
    Ni, Tianwei
    Xie, Lingxi
    Zheng, Huangjie
    Fishman, Elliot K.
    Yuille, Alan L.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2104 - 2113
  • [43] Medical Image Segmentation with Imperfect 3D Bounding Boxes
    Redekop, Ekaterina
    Chernyavskiy, Alexey
    DEEP GENERATIVE MODELS, AND DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS, 2021, 13003 : 193 - 200
  • [44] Adaptive metamorphs model for 3D medical image segmentation
    Huang, Junzhou
    Huang, Xiaolei
    Metaxas, Dimitris
    Axel, Leon
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2007, PT 1, PROCEEDINGS, 2007, 4791 : 302 - +
  • [45] Swarm Intelligence Approach to 3D Medical Image Segmentation
    Galinska, Marta
    Badura, Pawel
    INFORMATION TECHNOLOGIES IN MEDICINE, ITIB 2016, VOL 1, 2016, 471 : 15 - 24
  • [46] Volumetric Attention for 3D Medical Image Segmentation and Detection
    Wang, Xudong
    Han, Shizhong
    Chen, Yunqiang
    Gao, Dashan
    Vasconcelos, Nuno
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 175 - 184
  • [47] Medical image segmentation using 3D MRI data
    Voronin, V.
    Marchuk, V.
    Semenishchev, E.
    Cen, Yigang
    Agaian, S.
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2017, 2017, 10221
  • [48] Hybrid segmentation framework for 3D medical image analysis
    Chen, T
    Metaxas, D
    MEDICAL IMAGING 2003: IMAGE PROCESSING, PTS 1-3, 2003, 5032 : 1421 - 1432
  • [49] 3D MEDICAL IMAGE INTERACTION AND SEGMENTATION USING KINECT
    Chang, Cheng
    Gao, Yi
    2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 498 - 501
  • [50] Medical Image Segmentation by Improved 3D Adaptive Thresholding
    Kim, Cheol-Hwan
    Lee, Yun-Jung
    2015 INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC), 2015, : 263 - 265