AM-MulFSNet: A fast semantic segmentation network combining attention mechanism and multi-branch

被引:0
|
作者
Jiang, Rui [1 ]
Chen, Runa [1 ]
Zhang, Li [2 ]
Wang, Xiaoming [1 ]
Xu, Youyun [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Forestry Univ, Coll Comp Sci & Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; convolutional neural nets; feature extraction; image processing; image segmentation;
D O I
10.1049/ipr2.13058
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to balance accuracy and real-time performance in semantic segmentation, this paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi-branch feature fusion using Fast convolutional neural network model (Fast-SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at . This paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi branch feature fusion. Firstly, spatial detail feature enhancement branches and convolutional attention modules are introduced to enhance the global feature representation of the network. At the same time, spatial detail enhancement features are aggregated with deep semantic features, and shallow features are weighted and fused together. Finally, an adaptive attention module is introduced to improve overall network performance. image
引用
收藏
页码:1733 / 1744
页数:12
相关论文
共 50 条
  • [41] Channel Attention Multi-Branch Network for Fine-Grained Image Recognition
    Wang Binzhou
    Xiao Zhiyong
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (22)
  • [42] Automated thorax disease diagnosis using multi-branch residual attention network
    Li, Dongfang
    Huo, Hua
    Jiao, Shupei
    Sun, Xiaowei
    Chen, Shuya
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01):
  • [43] Remote Sensing Scene Classification via Multi-Branch Local Attention Network
    Chen, Si-Bao
    Wei, Qing-Song
    Wang, Wen-Zhong
    Tang, Jin
    Luo, Bin
    Wang, Zu-Yuan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 99 - 109
  • [44] Multi-manipulation Detection Network Combining Multi-scale Feature and Multi-branch Prediction
    Zhu, Xinshan
    Lu, Junyan
    Gan, Yongdong
    Ren, Honghao
    Wang, Hongquan
    Xue, Juntao
    Chen, Ying
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (08): : 94 - 105
  • [45] A robust multi-branch multi-attention-mechanism EEGNet for motor imagery BCI decoding
    Deng, Haodong
    Li, Mengfan
    Li, Jundi
    Guo, Miaomiao
    Xu, Guizhi
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2024, 405
  • [46] Multi-branch residual image semantic segmentation combined with inverse weight gated-control
    Qu, Haicheng
    Wang, Xiaona
    Wang, Ying
    Chen, Yao
    [J]. IMAGE AND VISION COMPUTING, 2024, 143
  • [47] MRF-Net: A multi-branch residual fusion network for fast and accurate whole-brain MRI segmentation
    Wei, Chong
    Yang, Yanwu
    Guo, Xutao
    Ye, Chenfei
    Lv, Haiyan
    Xiang, Yang
    Ma, Ting
    [J]. FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [48] A Dual-Decoding branch U-shaped semantic segmentation network combining Transformer attention with Decoder: DBUNet
    Wang, Yuefei
    Yu, Xi
    Guo, Xiaoyan
    Wang, Xilei
    Wei, Yuanhong
    Zeng, Shijie
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [49] Attention-modulated multi-branch convolutional neural networks for neonatal brain tissue segmentation
    Fan, Xunli
    Shan, Shixi
    Li, Xianjun
    Li, Jinhang
    Mi, Jizong
    Yang, Jian
    Zhang, Yongqin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 146
  • [50] Two-branch encoding and iterative attention decoding network for semantic segmentation
    Zhu, Hegui
    Zhang, Min
    Zhang, Xiangde
    Zhang, Libo
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (10): : 5151 - 5166