DEANet: A Real-Time Image Semantic Segmentation Method Based on Dual Efficient Attention Mechanism

被引:1
|
作者
Liu, Xu [1 ]
Liu, Rui [1 ]
Dong, Jing [1 ]
Yi, Pengfei [1 ]
Zhou, Dongsheng [1 ,2 ]
机构
[1] Dalian Univ, Sch Software Engn, Natl & Local Joint Engn Lab Comp Aided Design, Dalian, Peoples R China
[2] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Real-time semantic segmentation; Channel; Attention spatial attention;
D O I
10.1007/978-3-031-19214-2_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image semantic segmentation is the basis of performing various tasks in computer vision. It has been widely used in medical imaging, robotics and many other fields. However, the existing image semantic segmentation technology cannot improve the segmentation speed while ensuring the segmentation accuracy, and cannot meet the requirements of real-time applications. Therefore, this paper proposes a real-time image semantic segmentation method based on dual efficient attention mechanism (DEANet). Pyramid sampling is introduced into the channel dimension to extract multi-scale information, and higher resolution aggregation features are adopted as the input of the spatial dimension. It can achieve high efficiency and accuracy of image semantic segmentation. The proposed DEANet was tested on two classic datasets. On the Cityscapes dataset, when the input size is 512 x 1024, the segmentation accuracy reaches 74.90% mIoU, and the segmentation speed reaches 99.91FPS. On the CamVid dataset, when the input size is 360 x 480, the segmentation accuracy reaches 70.07% mIoU and the segmentation speed reaches 142.72 FPS.
引用
收藏
页码:193 / 205
页数:13
相关论文
共 50 条
  • [1] Real-Time Image Semantic Segmentation Based on Attention Mechanism and Multi-Label Classification
    Gao X.
    Li C.
    An J.
    [J]. Li, Chungeng (li_chungeng@dlmu.edu.cn), 1600, Institute of Computing Technology (33): : 59 - 67
  • [2] A real-time semantic segmentation method for small objects using attention mechanism
    Guan, Shijie
    Yu, Haojie
    [J]. International Journal of Web Engineering and Technology, 2024, 19 (02) : 194 - 210
  • [3] A Real-Time Image Semantic Segmentation Method Based on Multilabel Classification
    Jin, Ran
    Han, Xiaozhen
    Yu, Tongrui
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [4] LRDNet: A lightweight and efficient network with refined dual attention decorder for real-time semantic segmentation
    Zhuang, Mingxi
    Zhong, Xunyu
    Gu, Dongbing
    Feng, Liying
    Zhong, Xungao
    Hu, Huosheng
    [J]. NEUROCOMPUTING, 2021, 459 : 349 - 360
  • [5] Dual-inferences mechanism for real-time semantic segmentation
    Toan, Quyen Van
    Kim, Min Young
    [J]. 2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 12 - 17
  • [6] Real-Time Semantic Segmentation with Dual Encoder and Self-Attention Mechanism for Autonomous Driving
    Chang, Yu-Bang
    Tsai, Chieh
    Lin, Chang-Hong
    Chen, Poki
    [J]. SENSORS, 2021, 21 (23)
  • [7] Lightweight Real-Time Image Semantic Segmentation Network Based on Multi-Resolution Hybrid Attention Mechanism
    Wang, Xizhong
    Liu, Rui
    Dong, Jing
    Zhang, Qiang
    Zhou, Dongsheng
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [8] Real-Time Semantic Segmentation of Point Clouds Based on an Attention Mechanism and a Sparse Tensor
    Wang, Fei
    Yang, Yujie
    Wu, Zhao
    Zhou, Jingchun
    Zhang, Weishi
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [9] Real-Time Semantic Segmentation With Fast Attention
    Hu, Ping
    Perazzi, Federico
    Heilbron, Fabian Caba
    Wang, Oliver
    Lin, Zhe
    Saenko, Kate
    Sclaroff, Stan
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (01) : 263 - 270
  • [10] DEANet: Dual Encoder with Attention Network for Semantic Segmentation of Remote Sensing Imagery
    Wei, Haoran
    Xu, Xiangyang
    Ou, Ni
    Zhang, Xinru
    Dai, Yaping
    [J]. REMOTE SENSING, 2021, 13 (19)