Multi-scale contextual semantic enhancement network for 3D medical image segmentation

被引:1
|
作者
Xia, Tingjian [1 ]
Huang, Guoheng [1 ]
Pun, Chi-Man [2 ]
Zhang, Weiwen [1 ]
Li, Jiajian [1 ]
Ling, Wing-Kuen [3 ]
Lin, Chao [4 ]
Yang, Qi [4 ]
机构
[1] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
[3] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Peoples R China
[4] Sun Yat sen Univ, State Key Lab Oncol South China, Collaborat Innovat Ctr Canc Med, Dept Nasopharyngeal,Carcinoma Guangdong Key Lab Na, Guangzhou 510060, Peoples R China
来源
PHYSICS IN MEDICINE AND BIOLOGY | 2022年 / 67卷 / 22期
关键词
3D medical image segmentation; nasopharyngeal carcinoma; liver tumor; multi-scale context; feature enhancement; class imbalance; NEURAL-NETWORKS; NET;
D O I
10.1088/1361-6560/ac9e41
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Accurate and automatic segmentation of medical images is crucial for improving the efficiency of disease diagnosis and making treatment plans. Although methods based on convolutional neural networks have achieved excellent results in numerous segmentation tasks of medical images, they still suffer from challenges including drastic scale variations of lesions, blurred boundaries of lesions and class imbalance. Our objective is to design a segmentation framework named multi-scale contextual semantic enhancement network (3D MCSE-Net) to address the above problems. Approach. The 3D MCSE-Net mainly consists of a multi-scale context pyramid fusion module (MCPFM), a triple feature adaptive enhancement module (TFAEM), and an asymmetric class correction loss (ACCL) function. Specifically, the MCPFM resolves the problem of unreliable predictions due to variable morphology and drastic scale variations of lesions by capturing the multi-scale global context of feature maps. Subsequently, the TFAEM overcomes the problem of blurred boundaries of lesions caused by the infiltrating growth and complex context of lesions by adaptively recalibrating and enhancing the multi-dimensional feature representation of suspicious regions. Moreover, the ACCL alleviates class imbalances by adjusting asy mmetric correction coefficient and weighting factor. Main results. Our method is evaluated on the nasopharyngeal cancer tumor segmentation (NPCTS) dataset, the public dataset of the MICCAI 2017 liver tumor segmentation (LiTS) challenge and the 3D image reconstruction for comparison of algorithm and DataBase (3Dircadb) dataset to verify its effectiveness and generalizability. The experimental results show the proposed components all have unique strengths and exhibit mutually reinforcing properties. More importantly, the proposed 3D MCSE-Net outperforms previous state-of-the-art methods for tumor segmentation on the NPCTS, LiTS and 3Dircadb dataset. Significance. Our method addresses the effects of drastic scale variations of lesions, blurred boundaries of lesions and class imbalance, and improves tumors segmentation accuracy, which facilitates clinical medical diagnosis and treatment planning.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Multi-scale semantic enhancement network for object detection
    Guo, Dongen
    Wu, Zechen
    Feng, Jiangfan
    Zou, Tao
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [32] Multi-scale semantic enhancement network for object detection
    Dongen Guo
    Zechen Wu
    Jiangfan Feng
    Tao Zou
    Scientific Reports, 13
  • [33] A multi-scale fully convolutional network for semantic labeling of 3D point clouds
    Yousefhussien, Mohammed
    Kelbe, David J.
    Lentilucci, Emmett J.
    Salvaggio, Carl
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 143 : 191 - 204
  • [34] Semantic segmentation network for remote sensing image based on multi-scale mutual attention
    Liu C.-J.
    Qiao Z.
    Yan H.-W.
    Wu X.-S.
    Wang J.-W.
    Xin Y.-Q.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (07): : 1335 - 1344
  • [35] Feature ensemble network for medical image segmentation with multi-scale atrous transformer
    Gai, Di
    Geng, Yuhan
    Huang, Xia
    Huang, Zheng
    Xiong, Xin
    Zhou, Ruihua
    Wang, Qi
    IET IMAGE PROCESSING, 2024, 18 (11) : 3082 - 3092
  • [36] MAPNet: A Multi-scale Attention Pooling Network for Ultrasound Medical Image Segmentation
    Wang, Shixun
    Wang, Mengjiao
    Li, Yuan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VIII, ICIC 2024, 2024, 14869 : 15 - 26
  • [37] A Medical Image Segmentation Network with Multi-Scale and Dual-Branch Attention
    Zhu, Cancan
    Cheng, Ke
    Hua, Xuecheng
    APPLIED SCIENCES-BASEL, 2024, 14 (14):
  • [38] MFEAFN: Multi-scale feature enhanced adaptive fusion network for image semantic segmentation
    Li, Shusheng
    Wan, Liang
    Tang, Lu
    Zhang, Zhining
    Seal, Ayan
    PLOS ONE, 2022, 17 (09):
  • [39] Medical image segmentation network based on multi-scale frequency domain filter
    Chen, Yufeng
    Zhang, Xiaoqian
    Peng, Lifan
    He, Youdong
    Sun, Feng
    Sun, Huaijiang
    NEURAL NETWORKS, 2024, 175
  • [40] Sub-pixel multi-scale fusion network for medical image segmentation
    Jing Li
    Qiaohong Chen
    Xian Fang
    Multimedia Tools and Applications, 2024, 83 (41) : 89355 - 89373