AM-MulFSNet: A fast semantic segmentation network combining attention mechanism and multi-branch

被引:0
|
作者
Jiang, Rui [1 ]
Chen, Runa [1 ]
Zhang, Li [2 ]
Wang, Xiaoming [1 ]
Xu, Youyun [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Forestry Univ, Coll Comp Sci & Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; convolutional neural nets; feature extraction; image processing; image segmentation;
D O I
10.1049/ipr2.13058
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to balance accuracy and real-time performance in semantic segmentation, this paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi-branch feature fusion using Fast convolutional neural network model (Fast-SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at . This paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi branch feature fusion. Firstly, spatial detail feature enhancement branches and convolutional attention modules are introduced to enhance the global feature representation of the network. At the same time, spatial detail enhancement features are aggregated with deep semantic features, and shallow features are weighted and fused together. Finally, an adaptive attention module is introduced to improve overall network performance. image
引用
收藏
页码:1733 / 1744
页数:12
相关论文
共 50 条
  • [1] Multi-branch reverse attention semantic segmentation network for building extraction
    Jiang, Wenxiang
    Chen, Yan
    Wang, Xiaofeng
    Kang, Menglei
    Wang, Mengyuan
    Zhang, Xuejun
    Xu, Lixiang
    Zhang, Cheng
    [J]. EGYPTIAN JOURNAL OF REMOTE SENSING AND SPACE SCIENCES, 2024, 27 (01): : 10 - 17
  • [2] A multi-branch hierarchical attention network for medical target segmentation
    Yu, Yongtao
    Tao, Yifei
    Guan, Haiyan
    Xiao, Shaozhang
    Li, Fenfen
    Yu, Changhui
    Liu, Zuojun
    Li, Jonathan
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 78
  • [3] Reconsidering Multi-Branch Aggregation for Semantic Segmentation
    Cai, Pengjie
    Yang, Derong
    Zou, Yonglin
    Chen, Ruihan
    Dai, Ming
    [J]. ELECTRONICS, 2023, 12 (15)
  • [4] Multi-Branch Supervised Learning on Semantic Segmentation
    Chen, Wenxin
    Zhang, Ting
    Zhao, Xing
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 6841 - 6845
  • [5] Multi-branch Segmentation-guided Attention Network for crowd counting
    Fan, Zheyi
    Song, Zihao
    Wu, Di
    Zhu, Yixuan
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 97
  • [6] Multi-Branch Attention Fusion Network for Cloud and Cloud Shadow Segmentation
    Gu, Hongde
    Gu, Guowei
    Liu, Yi
    Lin, Haifeng
    Xu, Yao
    [J]. REMOTE SENSING, 2024, 16 (13)
  • [7] A multi-branch dual attention segmentation network for epiphyte drone images
    Variyar, V. V. Sajith
    Sowmya, V.
    Sivanpillai, Ramesh
    Brown, Gregory K.
    [J]. IMAGE AND VISION COMPUTING, 2024, 148
  • [8] Image super-resolution network based on a multi-branch attention mechanism
    Xin Yang
    Yingqing Guo
    Zhiqiang Li
    Dake Zhou
    [J]. Signal, Image and Video Processing, 2021, 15 : 1397 - 1405
  • [9] Image super-resolution network based on a multi-branch attention mechanism
    Yang, Xin
    Guo, Yingqing
    Li, Zhiqiang
    Zhou, Dake
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (07) : 1397 - 1405
  • [10] Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes
    Weng, Xi
    Yan, Yan
    Dong, Genshun
    Shu, Chang
    Wang, Biao
    Wang, Hanzi
    Zhang, Ji
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 17224 - 17240