A 3D boundary-guided hybrid network with convolutions and Transformers for lung tumor segmentation in CT images

被引:0
|
作者
Liu, Hong [1 ]
Zhuang, Yuzhou [1 ]
Song, Enmin [1 ]
Liao, Yongde [2 ]
Ye, Guanchao [2 ]
Yang, Fan [3 ]
Xu, Xiangyang [1 ]
Xiao, Xvhao [4 ]
Hung, Chih-Cheng [5 ]
机构
[1] Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan,430074, China
[2] Department of Thoracic Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[3] Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[4] Research Institute of High-Tech, Shaanxi, Xi'an,710025, China
[5] Center for Machine Vision and Security Research, Kennesaw State University, Marietta,MA,30060, United States
关键词
Biological organs - Computerized tomography - Decoding - Diagnosis - Image segmentation - Tumors;
D O I
10.1016/j.compbiomed.2024.109009
中图分类号
学科分类号
摘要
—Accurate lung tumor segmentation from Computed Tomography (CT) scans is crucial for lung cancer diagnosis. Since the 2D methods lack the volumetric information of lung CT images, 3D convolution-based and Transformer-based methods have recently been applied in lung tumor segmentation tasks using CT imaging. However, most existing 3D methods cannot effectively collaborate the local patterns learned by convolutions with the global dependencies captured by Transformers, and widely ignore the important boundary information of lung tumors. To tackle these problems, we propose a 3D boundary-guided hybrid network using convolutions and Transformers for lung tumor segmentation, named BGHNet. In BGHNet, we first propose the Hybrid Local-Global Context Aggregation (HLGCA) module with parallel convolution and Transformer branches in the encoding phase. To aggregate local and global contexts in each branch of the HLGCA module, we not only design the Volumetric Cross-Stripe Window Transformer (VCSwin-Transformer) to build the Transformer branch with local inductive biases and large receptive fields, but also design the Volumetric Pyramid Convolution with transformer-based extensions (VPConvNeXt) to build the convolution branch with multi-scale global information. Then, we present a Boundary-Guided Feature Refinement (BGFR) module in the decoding phase, which explicitly leverages the boundary information to refine multi-stage decoding features for better performance. Extensive experiments were conducted on two lung tumor segmentation datasets, including a private dataset (HUST-Lung) and a public benchmark dataset (MSD-Lung). Results show that BGHNet outperforms other state-of-the-art 2D or 3D methods in our experiments, and it exhibits superior generalization performance in both non-contrast and contrast-enhanced CT scans. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [11] A Hybrid 3D Image Registration of Lung CT Images for Respiration
    Liang Rui
    Zhang Jian Xun
    Wang Ruo Fan
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 4182 - 4187
  • [12] Automatic lung tumor segmentation from CT images using improved 3D densely connected UNet
    Zhang, Guobin
    Yang, Zhiyong
    Jiang, Shan
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2022, 60 (11) : 3311 - 3323
  • [13] Automatic lung tumor segmentation from CT images using improved 3D densely connected UNet
    Guobin Zhang
    Zhiyong Yang
    Shan Jiang
    Medical & Biological Engineering & Computing, 2022, 60 : 3311 - 3323
  • [14] Automated 3D Mouse Lung Segmentation from CT Images for Extracting Quantitative Tumor Progression Biomarkers
    Ren, Ran
    Somayajula, Sangeetha
    Sevilla, Raquel
    Vanko, Amy
    Wiener, Matthew C.
    Dogdas, Belma
    Zhang, Weisheng
    MEDICAL IMAGING 2013: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING, 2013, 8672
  • [15] A Novel Hybrid Convolutional Neural Network for Accurate Organ Segmentation in 3D Head and Neck CT Images
    Chen, Zijie
    Li, Cheng
    He, Junjun
    Ye, Jin
    Song, Diping
    Wang, Shanshan
    Gu, Lixu
    Qiao, Yu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 569 - 578
  • [16] Multimodal weighted network for 3D brain tumor segmentation in MRI images
    Zhou, Zhiguo
    Wang, Rongfang
    Yang, Jing
    Xu, Rongbin
    Guo, Jinkun
    MEDICAL IMAGING 2021: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING, 2021, 11600
  • [17] A Hybrid Approach for Automatic Aorta Segmentation in Abdominal 3D CT Scan Images
    Ahmad, Iftikhar
    Rehman, Sami Ur
    Khan, Imran Ullah
    Ali, Arfa
    Rahman, Hussain
    Jan, Sadeeq
    Wadud, Zahid
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2021, 11 (03) : 712 - 719
  • [18] Automatic 3D Aorta Segmentation in CT Images
    Duan, Xiaojie
    Zhang, Meisong
    Wang, Jianming
    Chen, Qingliang
    2018 2ND INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND BIOINFORMATICS (ICBEB 2018), 2018, : 49 - 54
  • [19] Evidential Segmentation of 3D PET/CT Images
    Huang, Ling
    Ruan, Su
    Decazes, Pierre
    Denoeux, Thierry
    BELIEF FUNCTIONS: THEORY AND APPLICATIONS (BELIEF 2021), 2021, 12915 : 159 - 167
  • [20] Efficient 3D Depthwise and Separable Convolutions with Dilation for Brain Tumor Segmentation
    Zhang, Donghao
    Song, Yang
    Liu, Dongnan
    Zhang, Chaoyi
    Wu, Yicheng
    Wang, Heng
    Zhang, Fan
    Xia, Yong
    O'Donnell, Lauren J.
    Cai, Weidong
    AI 2019: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, 11919 : 563 - 573