MAEF-Net: MLP Attention for Feature Enhancement in U-Net based Medical Image Segmentation Networks

被引:1
|
作者
Zhang, Yunchu [1 ,2 ]
Dong, Jianfei [3 ]
机构
[1] Univ Sci & Technol China, Sch Biomed Engn Suzhou, Div Life Sci & Med, Suzhou 215163, Peoples R China
[2] Chinese Acad Sci, Suzhou Inst Biomed Engn & Technol, Suzhou 215163, Peoples R China
[3] Soochow Univ, Sch Future Sci & Engn, Suzhou 215222, Peoples R China
关键词
MLP; attention; U-Net; image segmentation; LIVER-TUMOR;
D O I
10.1109/JBHI.2023.3332908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Medical image segmentation plays an important role in diagnosis. Since the introduction of U-Net, numerous advancements have been implemented to enhance its performance and expand its applicability. The advent of Transformers in computer vision has led to the integration of self-attention mechanisms into U-Net, resulting in significant breakthroughs. However, the inherent complexity of Transformers renders these networks computationally demanding and parameter-heavy. Recent studies have demonstrated that multilayer perceptrons (MLPs), with their simpler architecture, can achieve comparable performance to Transformers in natural language processing and computer vision tasks. Building upon these findings, we have enhanced the previously proposed "Enhanced-Feature-Four-Fold-Net" (EF3-Net) by introducing an MLP-attention block to learn long-range dependencies and expand the receptive field. This enhanced network is termed "MLP-Attention Enhanced-Feature-four-fold-Net", abbreviated as "MAEF-Net". To further enhance accuracy while reducing computational complexity, the proposed network incorporates additional efficient design elements. MAEF-Net was evaluated against several general and specialized medical image segmentation networks using four challenging medical image datasets. The results demonstrate that the proposed network exhibits high computational efficiency and comparable or superior performance to EF3-Net and several state-of-the-art methods, particularly in segmenting blurry objects.
引用
收藏
页码:846 / 857
页数:12
相关论文
共 50 条
  • [1] DRA U-Net: An Attention based U-Net Framework for 2D Medical Image Segmentation
    Zhang, Xian
    Feng, Ziyuan
    Zhong, Tianchi
    Shen, Sicheng
    Zhang, Ruolin
    Zhou, Lijie
    Zhang, Bo
    Wang, Wendong
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 3936 - 3942
  • [2] MAEF-Net: Multi-Attention Efficient Feature Fusion Network for Deep Learning Segmentation
    Zeng, Yan
    Tsui, Po-Hsiang
    Wu, Weiwei
    Zhou, Zhuhuang
    Wu, Shuicai
    INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS 2021), 2021,
  • [3] An Attention-oriented U-Net Model and Global Feature for Medical Image Segmentation
    Han, Yandong
    Li, Jiangjiang
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2020, 23 (04): : 731 - 738
  • [4] Medical Image Segmentation based on U-Net: A Review
    Du, Getao
    Cao, Xu
    Liang, Jimin
    Chen, Xueli
    Zhan, Yonghua
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2020, 64 (02)
  • [5] SAU-Net: Medical Image Segmentation Method Based on U-Net and Self-Attention
    Zhang S.-J.
    Peng Z.
    Li H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (10): : 2433 - 2442
  • [6] Hybrid dilation and attention residual U-Net for medical image segmentation
    Wang, Zekun
    Zou, Yanni
    Liu, Peter X.
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 134
  • [7] Study on Echocardiographic Image Segmentation Based on Attention U-Net
    Wang, Kai
    Zhang, Jiwei
    Hachiya, Hirotaka
    Wu, Haiyuan
    PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 1091 - 1096
  • [8] Hybrid Swin Deformable Attention U-Net for Medical Image Segmentation
    Wang, Lichao
    Huang, Jiahao
    Xing, Xiaodan
    Yang, Guang
    2023 19TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, SIPAIM, 2023,
  • [9] U-Net Transformer: Self and Cross Attention for Medical Image Segmentation
    Petit, Olivier
    Thome, Nicolas
    Rambour, Clement
    Themyr, Loic
    Collins, Toby
    Soler, Luc
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 267 - 276
  • [10] Wavelet U-Net for Medical Image Segmentation
    Ying Li
    Yu Wang
    Tuo Leng
    Wen Zhijie
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT I, 2020, 12396 : 800 - 810