AM-MulFSNet: A fast semantic segmentation network combining attention mechanism and multi-branch

被引:0
|
作者
Jiang, Rui [1 ]
Chen, Runa [1 ]
Zhang, Li [2 ]
Wang, Xiaoming [1 ]
Xu, Youyun [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing, Peoples R China
[2] Nanjing Forestry Univ, Coll Comp Sci & Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; convolutional neural nets; feature extraction; image processing; image segmentation;
D O I
10.1049/ipr2.13058
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to balance accuracy and real-time performance in semantic segmentation, this paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi-branch feature fusion using Fast convolutional neural network model (Fast-SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at . This paper proposes a real-time semantic segmentation algorithm model based on attention mechanism and multi branch feature fusion. Firstly, spatial detail feature enhancement branches and convolutional attention modules are introduced to enhance the global feature representation of the network. At the same time, spatial detail enhancement features are aggregated with deep semantic features, and shallow features are weighted and fused together. Finally, an adaptive attention module is introduced to improve overall network performance. image
引用
收藏
页码:1733 / 1744
页数:12
相关论文
共 50 条
  • [21] A novel network for semantic segmentation of landslide areas in remote sensing images with multi-branch and multi-scale fusion
    Wang, Kai
    He, Daojie
    Sun, Qingqiang
    Yi, Lizhi
    Yuan, Xiaofeng
    Wang, Yalin
    [J]. APPLIED SOFT COMPUTING, 2024, 158
  • [22] Latency Driven Spatially Sparse Optimization for Multi-Branch CNNs for Semantic Segmentation
    Zampokas, Georgios
    Bouganis, Christos-Savvas
    Tzovaras, Dimitrios
    [J]. 2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 949 - 957
  • [23] MANet: Multi-branch attention auxiliary learning for lung nodule detection and segmentation
    Nguyen, Tan-Cong
    Nguyen, Tien-Phat
    Cao, Tri
    Dao, Thao Thi Phuong
    Ho, Thi-Ngoc
    Nguyen, Tam, V
    Tran, Minh-Triet
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 241
  • [24] Multi-Branch CNN GRU with attention mechanism for human action recognition
    Verma, Updesh
    Tyagi, Pratibha
    Aneja, Manpreet Kaur
    [J]. ENGINEERING RESEARCH EXPRESS, 2023, 5 (02):
  • [25] Single image dehazing based on the fusion of multi-branch and attention mechanism
    Yu, Xiaohang
    Yu, Huikang
    [J]. 2022 INTERNATIONAL CONFERENCE ON BIG DATA, INFORMATION AND COMPUTER NETWORK (BDICN 2022), 2022, : 675 - 679
  • [26] MBANet: Multi-branch aware network for kidney ultrasound images segmentation
    Chen, Gongping
    Dai, Yu
    Zhang, Jianxun
    Yin, Xiaotao
    Cui, Liang
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 141
  • [27] Efficient multi-branch segmentation network for situation awareness in autonomous navigation
    Zhou, Guan-Cheng
    Cheng, Chen
    Chen, Yan-zhou
    [J]. OCEAN ENGINEERING, 2024, 302
  • [28] Multi-branch convolutional neural network for multiple sclerosis lesion segmentation
    Aslani, Shahab
    Dayan, Michael
    Storelli, Loredana
    Filippi, Massimo
    Murino, Vittorio
    Rocca, Maria A.
    Sona, Diego
    [J]. NEUROIMAGE, 2019, 196 : 1 - 15
  • [29] A Multi-branch Hybrid Transformer Network for Corneal Endothelial Cell Segmentation
    Zhang, Yinglin
    Higashita, Risa
    Fu, Huazhu
    Xu, Yanwu
    Zhang, Yang
    Liu, Haofeng
    Zhang, Jian
    Liu, Jiang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 99 - 108
  • [30] A multi-branch attention and alignment network for person re-identification
    Lyu, Chunyan
    Ning, Wu
    Wang, Chenhui
    Wang, Kejun
    [J]. APPLIED INTELLIGENCE, 2022, 52 (10) : 10845 - 10866