A 3D boundary-guided hybrid network with convolutions and Transformers for lung tumor segmentation in CT images

被引:0
|
作者
Liu, Hong [1 ]
Zhuang, Yuzhou [1 ]
Song, Enmin [1 ]
Liao, Yongde [2 ]
Ye, Guanchao [2 ]
Yang, Fan [3 ]
Xu, Xiangyang [1 ]
Xiao, Xvhao [4 ]
Hung, Chih-Cheng [5 ]
机构
[1] Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan,430074, China
[2] Department of Thoracic Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[3] Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[4] Research Institute of High-Tech, Shaanxi, Xi'an,710025, China
[5] Center for Machine Vision and Security Research, Kennesaw State University, Marietta,MA,30060, United States
关键词
Biological organs - Computerized tomography - Decoding - Diagnosis - Image segmentation - Tumors;
D O I
10.1016/j.compbiomed.2024.109009
中图分类号
学科分类号
摘要
—Accurate lung tumor segmentation from Computed Tomography (CT) scans is crucial for lung cancer diagnosis. Since the 2D methods lack the volumetric information of lung CT images, 3D convolution-based and Transformer-based methods have recently been applied in lung tumor segmentation tasks using CT imaging. However, most existing 3D methods cannot effectively collaborate the local patterns learned by convolutions with the global dependencies captured by Transformers, and widely ignore the important boundary information of lung tumors. To tackle these problems, we propose a 3D boundary-guided hybrid network using convolutions and Transformers for lung tumor segmentation, named BGHNet. In BGHNet, we first propose the Hybrid Local-Global Context Aggregation (HLGCA) module with parallel convolution and Transformer branches in the encoding phase. To aggregate local and global contexts in each branch of the HLGCA module, we not only design the Volumetric Cross-Stripe Window Transformer (VCSwin-Transformer) to build the Transformer branch with local inductive biases and large receptive fields, but also design the Volumetric Pyramid Convolution with transformer-based extensions (VPConvNeXt) to build the convolution branch with multi-scale global information. Then, we present a Boundary-Guided Feature Refinement (BGFR) module in the decoding phase, which explicitly leverages the boundary information to refine multi-stage decoding features for better performance. Extensive experiments were conducted on two lung tumor segmentation datasets, including a private dataset (HUST-Lung) and a public benchmark dataset (MSD-Lung). Results show that BGHNet outperforms other state-of-the-art 2D or 3D methods in our experiments, and it exhibits superior generalization performance in both non-contrast and contrast-enhanced CT scans. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [41] 3D interpolation method for CT images of the lung
    Asada, N
    Ogura, M
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL III, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING I, 2002, : 11 - 16
  • [42] A hybrid method for 3D segmentation of MRI Brain Images
    Zhang, X
    Zhang, DZ
    Tian, JW
    Liu, J
    2002 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I AND II, 2002, : 608 - 611
  • [43] Hybrid method for 3D segmentation of magnetic resonance images
    Zhang, X
    Zhang, DZ
    Tian, JW
    Liu, J
    CHINESE JOURNAL OF ELECTRONICS, 2003, 12 (04): : 563 - 566
  • [44] Brain Tumor Segmentation Using Attention- Based Network in 3D MRI Images
    Xu, Xiaowei
    Zhao, Wangyuan
    Zhao, Jun
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2019), PT II, 2020, 11993 : 3 - 13
  • [45] HBNet: Hybrid Blocks Network for Segmentation of Gastric Tumor from Ordinary CT Images
    Zhang, Yongtao
    Lei, Baiying
    Fu, Chao
    Du, Jie
    Zhu, Xinjian
    Han, Xiaowei
    Du, Lei
    Gao, Wenwen
    Wang, Tianfu
    Ma, Guolin
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 217 - 220
  • [46] SwinUNETR-V2: Stronger Swin Transformers with Stagewise Convolutions for 3D Medical Image Segmentation
    He, Yufan
    Nath, Vishwesh
    Yang, Dong
    Tang, Yucheng
    Myronenko, Andriy
    Xu, Daguang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 : 416 - 426
  • [47] 3D Volumetric CT Liver Segmentation Using Hybrid Segmentation Techniques
    Yussof, Wan Nural Jawahir Wan
    Burkhardt, Hans
    2009 INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION, 2009, : 404 - 408
  • [48] Neural Network Boundary Detection for 3D Vessel Segmentation
    Palmer, Robert Ieuan
    Xie, Xianghua
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2016, 2016, 10016 : 25 - 36
  • [49] 3D segmentation and visualization of lung volume using CT
    Zhang, HB
    Sun, XJ
    Duan, HC
    MEDICAL IMAGING 2005: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND DISPLAY, PTS 1 AND 2, 2005, 5744 : 538 - 546
  • [50] iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Images
    Liu, Qin
    Xu, Zhenlin
    Jiao, Yining
    Niethammer, Marc
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT V, 2022, 13435 : 464 - 474