RM-UNet: UNet-like Mamba with rotational SSM module for medical image segmentation

被引:0
|
作者
Tang, Hao [1 ]
Huang, Guoheng [1 ]
Cheng, Lianglun [1 ]
Yuan, Xiaochen [2 ]
Tao, Qi [3 ]
Chen, Xuhang [4 ]
Zhong, Guo [5 ]
Yang, Xiaohui [6 ]
机构
[1] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R China
[2] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Dept Mech Engn Robot, Shantou 515063, Peoples R China
[4] Huizhou Univ, Sch Comp Sci & Engn, Huizhou 516007, Peoples R China
[5] Guangdong Univ Foreign Studies, Sch Informat Sci & Technol, Guangzhou 510006, Peoples R China
[6] Sun Yat sen Univ, Affiliated Hosp 3, Dept Gynecol, Guangzhou, Peoples R China
关键词
U-Net; State Space Models; Medical image segmentation; Mamba; LSIL; U-NET ARCHITECTURE;
D O I
10.1007/s11760-024-03484-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Accurate segmentation of tissues and lesions is crucial for disease diagnosis, treatment planning, and surgical navigation. Yet, the complexity of medical images presents significant challenges for traditional Convolutional Neural Networks and Transformer models due to their limited receptive fields or high computational complexity. State Space Models (SSMs) have recently shown notable vision performance, particularly Mamba and its variants. However, their feature extraction methods may not be sufficiently effective and retain some redundant structures, leaving room for parameter reduction. In response to these challenges, we introduce a methodology called Rotational Mamba-UNet, characterized by Residual Visual State Space (ResVSS) block and Rotational SSM Module. The ResVSS block is devised to mitigate network degradation caused by the diminishing efficacy of information transfer from shallower to deeper layers. Meanwhile, the Rotational SSM Module is devised to tackle the challenges associated with channel feature extraction within State Space Models. Finally, we propose a weighted multi-level loss function, which fully leverages the outputs of the decoder's three stages for supervision. We conducted experiments on ISIC17, ISIC18, CVC-300, Kvasir-SEG, CVC-ColonDB, Kvasir-Instrument datasets, and Low-grade Squamous Intraepithelial Lesion datasets provided by The Third Affiliated Hospital of Sun Yat-sen University, demonstrating the superior segmentation performance of our proposed RM-UNet. Additionally, compared to the previous VM-UNet, our model achieves a one-third reduction in parameters. Our code is available at https://github.com/Halo2Tang/RM-UNet.
引用
收藏
页码:8427 / 8443
页数:17
相关论文
共 50 条
  • [41] N-Net: an UNet architecture with dual encoder for medical image segmentation
    Liang, Bingtao
    Tang, Chen
    Zhang, Wei
    Xu, Min
    Wu, Tianbo
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (06) : 3073 - 3081
  • [42] Pie-UNet: A Novel Parallel Interaction Encoder for Medical Image Segmentation
    Jiang, Youtao
    Zhang, Xiaoqian
    Chen, Yufeng
    Yang, Shukai
    Sun, Feng
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT II, 2023, 14255 : 558 - 569
  • [43] N-Net: an UNet architecture with dual encoder for medical image segmentation
    Bingtao Liang
    Chen Tang
    Wei Zhang
    Min Xu
    Tianbo Wu
    Signal, Image and Video Processing, 2023, 17 : 3073 - 3081
  • [44] VIG-UNET: VISION GRAPH NEURAL NETWORKS FOR MEDICAL IMAGE SEGMENTATION
    Jiang, Juntao
    Chen, Xiyu
    Tian, Guanzhong
    Liu, Yong
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [45] DSTUNET: UNET WITH EFFICIENT DENSE SWIN TRANSFORMER PATHWAY FOR MEDICAL IMAGE SEGMENTATION
    Cai, Zhuotong
    Xin, Jingmin
    Shi, Peiwen
    Wu, Jiayi
    Zheng, Nanning
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [46] MFLUnet: multi-scale fusion lightweight Unet for medical image segmentation
    Cao, Dianlei
    Zhang, Rui
    Zhang, Yunfeng
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (10): : 5574 - 5591
  • [47] LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation
    Xu, Guoping
    Zhang, Xuan
    He, Xinwei
    Wu, Xinglong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 42 - 53
  • [48] MCNMF-Unet: a mixture Conv-MLP network with multi-scale features fusion Unet for medical image segmentation
    Yuan, Lei
    Song, Jianhua
    Fan, Yazhuo
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [49] TMD-Unet: Triple-Unet with Multi-Scale Input Features and Dense Skip Connection for Medical Image Segmentation
    Tran, Song-Toan
    Cheng, Ching-Hwa
    Nguyen, Thanh-Tuan
    Le, Minh-Hai
    Liu, Don-Gey
    HEALTHCARE, 2021, 9 (01)
  • [50] C2BA-UNet: A context-coordination multi-atlas boundary-aware UNet-like method for PET/CT images based tumor segmentation
    Luo, Shijie
    Jiang, Huiyan
    Wang, Meng
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 103