A lightweight network for abdominal multi-organ segmentation based on multi-scale context fusion and dual self-attention

被引:2
|
作者
Liao, Miao [1 ]
Tang, Hongliang [1 ]
Li, Xiong [2 ]
Vijayakumar, P. [3 ]
Arya, Varsha [4 ,5 ]
Gupta, Brij B. [6 ,7 ,8 ,9 ]
机构
[1] Hunan Univ Sci & Technol, Sch Comp Sci & Engn, Xiangtan 411100, Peoples R China
[2] Univ Elect Sci & Technol China, Inst Cyber Secur, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[3] Univ Coll Engn Tindivanam, Dept Comp Sci & Engn, Tindivanam 604001, Tamil Nadu, India
[4] Asia Univ, Int Ctr AI & Cyber Secur Res & Innovat CCRI, Taichung, Taiwan
[5] Lebanese Amer Univ, Dept Elect & Comp Engn, Beirut 1102, Lebanon
[6] Asia Univ, Dept Comp Sci & Informat Engn, Taichung 413, Taiwan
[7] Kyung Hee Univ, 26 Kyungheedae Ro, Seoul 02447, South Korea
[8] Symbiosis Int Univ, Symbiosis Ctr Informat Technol SCIT, Pune, India
[9] Univ Petr & Energy Studies UPES, Ctr Interdisciplinary Res, Dehra Dun, India
基金
中国国家自然科学基金;
关键词
CT image; Segmentation; Context-aware; Feature fusion; Self-attention;
D O I
10.1016/j.inffus.2024.102401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Segmenting the organs from abdominal CT images is a vital procedure for computer -aided diagnosis and treatment. Accurate and simultaneous segmentation of multiple abdominal organs remains challenging due to the complex structures, varying sizes, and fuzzy boundaries. Currently, most methods aiming at improving segmentation accuracy involve either deepening the network or employing large-scale models, which results in a heavy computation burden and a huge number of model parameters. It is difficult to deploy these methods in a medical environment. In this paper, we present a lightweight network based on multi -scale context fusion and dual self -attention. The dual self -attention mechanism is used to obtain target organ responses from channel domain, while also strengthening the correlation of global information from spatial domain. Considering the complex structure of abdominal organs, we design a multi -scale context fusion module comprised of a pyramid pooling (PP) and an anisotropic strip pooling (ASP). The PP is used to acquire rich local features by aggregating context information from different receptive fields, while the ASP is designed to extract strip features in different directions to help the network establish long-distance dependencies and capture the characteristics of elongated organs, such as pancreas and spleen. Moreover, a residual module is introduced in the skip connection to learn features related to edges and small objects. The proposed method achieves averaged Dice of 90.1% and 82.5% on the FLARE and BTCV datasets, respectively, with only 6.25M model parameters and 21.40G FLOPs, outperforming many state-of-the-art methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Spatial Context-Aware Self-Attention Model For Multi-Organ Segmentation
    Tang, Hao
    Liu, Xingwei
    Han, Kun
    Xie, Xiaohui
    Chen, Xuming
    Qian, Huang
    Liu, Yong
    Sun, Shanlin
    Bai, Narisu
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 938 - 948
  • [2] Abdominal multi-organ segmentation using multi-scale and context-aware neural networks
    Song, Yuhan
    Elibol, Armagan
    Chong, Nak Young
    [J]. IFAC JOURNAL OF SYSTEMS AND CONTROL, 2024, 27
  • [3] Abdominal multi-organ segmentation with organ-attention networks and statistical fusion
    Wang, Yan
    Zhou, Yuyin
    Shen, Wei
    Park, Seyoun
    Fishman, Elliot K.
    Yuille, Alan L.
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 55 : 88 - 102
  • [4] Multi-scale context fusion network for melanoma segmentation
    Li, Zhenhua
    Zhang, Lei
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2024, 18 (07): : 1888 - 1906
  • [5] Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation
    Hua, Zhongwei
    Qi, Lizhe
    Du, Daming
    Jiang, Wenxuan
    Sun, Yunquan
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3639 - 3644
  • [6] MSSA-Net: A novel multi-scale feature fusion and global self-attention network for lesion segmentation
    Huang, Zhaohong
    Zhang, Xiangchen
    Zhang, Guowei
    Cai, Guorong
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (21):
  • [7] DS-MSFF-Net: Dual-path self-attention multi-scale feature fusion network for CT image segmentation
    Xiaoqian Zhang
    Lei Pu
    Liming Wan
    Xiao Wang
    Ying Zhou
    [J]. Applied Intelligence, 2024, 54 : 4490 - 4506
  • [8] DS-MSFF-Net: Dual-path self-attention multi-scale feature fusion network for CT image segmentation
    Zhang, Xiaoqian
    Pu, Lei
    Wan, Liming
    Wang, Xiao
    Zhou, Ying
    [J]. APPLIED INTELLIGENCE, 2024, 54 (06) : 4490 - 4506
  • [9] SUnet: A multi-organ segmentation network based on multiple attention
    Li, Xiaosen
    Qin, Xiao
    Huang, Chengliang
    Lu, Yuer
    Cheng, Jinyan
    Wang, Liansheng
    Liu, Ou
    Shuai, Jianwei
    Yuan, Chang-an
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 167
  • [10] Clothing Parsing Based on Multi-Scale Fusion and Improved Self-Attention Mechanism
    陈诺
    王绍宇
    陆然
    李文萱
    覃志东
    石秀金
    [J]. Journal of Donghua University(English Edition), 2023, 40 (06) : 661 - 666