A 3D boundary-guided hybrid network with convolutions and Transformers for lung tumor segmentation in CT images

被引:0
|
作者
Liu, Hong [1 ]
Zhuang, Yuzhou [1 ]
Song, Enmin [1 ]
Liao, Yongde [2 ]
Ye, Guanchao [2 ]
Yang, Fan [3 ]
Xu, Xiangyang [1 ]
Xiao, Xvhao [4 ]
Hung, Chih-Cheng [5 ]
机构
[1] Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan,430074, China
[2] Department of Thoracic Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[3] Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan,430074, China
[4] Research Institute of High-Tech, Shaanxi, Xi'an,710025, China
[5] Center for Machine Vision and Security Research, Kennesaw State University, Marietta,MA,30060, United States
关键词
Biological organs - Computerized tomography - Decoding - Diagnosis - Image segmentation - Tumors;
D O I
10.1016/j.compbiomed.2024.109009
中图分类号
学科分类号
摘要
—Accurate lung tumor segmentation from Computed Tomography (CT) scans is crucial for lung cancer diagnosis. Since the 2D methods lack the volumetric information of lung CT images, 3D convolution-based and Transformer-based methods have recently been applied in lung tumor segmentation tasks using CT imaging. However, most existing 3D methods cannot effectively collaborate the local patterns learned by convolutions with the global dependencies captured by Transformers, and widely ignore the important boundary information of lung tumors. To tackle these problems, we propose a 3D boundary-guided hybrid network using convolutions and Transformers for lung tumor segmentation, named BGHNet. In BGHNet, we first propose the Hybrid Local-Global Context Aggregation (HLGCA) module with parallel convolution and Transformer branches in the encoding phase. To aggregate local and global contexts in each branch of the HLGCA module, we not only design the Volumetric Cross-Stripe Window Transformer (VCSwin-Transformer) to build the Transformer branch with local inductive biases and large receptive fields, but also design the Volumetric Pyramid Convolution with transformer-based extensions (VPConvNeXt) to build the convolution branch with multi-scale global information. Then, we present a Boundary-Guided Feature Refinement (BGFR) module in the decoding phase, which explicitly leverages the boundary information to refine multi-stage decoding features for better performance. Extensive experiments were conducted on two lung tumor segmentation datasets, including a private dataset (HUST-Lung) and a public benchmark dataset (MSD-Lung). Results show that BGHNet outperforms other state-of-the-art 2D or 3D methods in our experiments, and it exhibits superior generalization performance in both non-contrast and contrast-enhanced CT scans. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [1] BG-Net: Boundary-Guided Network for Lung Segmentation on Clinical CT Images
    Xu, Rui
    Wang, Yi
    Liu, Tiantian
    Ye, Xinchen
    Lin, Lin
    Chen, Yen-Wei
    Kido, Shoji
    Tomiyama, Noriyuki
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8782 - 8788
  • [2] Segmentation of the ovine lung in 3D CT images
    Shi, LY
    Hoffman, EA
    Reinhardt, JM
    MEDICAL IMAGING 2004: PHYSIOLOGY, FUNCTION, AND STRUCTURE FROM MEDICAL IMAGES, 2004, 5 (23): : 455 - 463
  • [3] BGBF-Net: Boundary-Guided Buffer Feedback Network for Liver Tumor Segmentation
    Wang, Ying
    Wang, Kanqi
    Lu, Xiaowei
    Zhao, Yang
    Liu, Gang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT V, 2024, 14429 : 456 - 467
  • [4] A 3D hierarchical cross-modality interaction network using transformers and convolutions for brain glioma segmentation in MR images
    Zhuang, Yuzhou
    Liu, Hong
    Fang, Wei
    Ma, Guangzhi
    Sun, Sisi
    Zhu, Yunfeng
    Zhang, Xu
    Ge, Chuanbin
    Chen, Wenyang
    Long, Jiaosong
    Song, Enmin
    MEDICAL PHYSICS, 2024, : 8371 - 8389
  • [5] Automatic segmentation of lung tumors on CT images based on a 2D & 3D hybrid convolutional neural network
    Gan, Wutian
    Wang, Hao
    Gu, Hengle
    Duan, Yanhua
    Shao, Yan
    Chen, Hua
    Feng, Aihui
    Huang, Ying
    Fu, Xiaolong
    Ying, Yanchen
    Quan, Hong
    Xu, Zhiyong
    BRITISH JOURNAL OF RADIOLOGY, 2021, 94 (1126):
  • [6] SEMI-BGSEGNET: A SEMI-SUPERVISED BOUNDARY-GUIDED BREAST TUMOR SEGMENTATION NETWORK
    Zhao, Fengjun
    Chen, Yongfeng
    Huang, Kaiming
    He, Xiaowei
    Chen, Xin
    Hou, Yuqing
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [7] Autocorrection of lung boundary on 3D CT lung cancer images*
    Nurfauzi, R.
    Nugroho, H. A.
    Ardiyanto, I.
    Frannita, E. L.
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2021, 33 (05) : 518 - 527
  • [8] Spatial feature fusion in 3D convolutional autoencoders for lung tumor segmentation from 3D CT images
    Najeeb, Suhail
    Bhuiyan, Mohammed Imamul Hassan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 78
  • [9] A hard segmentation network guided by soft segmentation for tumor segmentation on PET/CT images
    Tong, Guoyu
    Jiang, Huiyan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [10] 3DUV-NetR+: A 3D hybrid semantic architecture using transformers for brain tumor segmentation with MultiModal MR images
    Aboussaleh, Ilyasse
    Riffi, Jamal
    el Fazazy, Khalid
    Mahraz, Adnane Mohamed
    Tairi, Hamid
    RESULTS IN ENGINEERING, 2024, 21