Semantic Segmentation Algorithm of Night Images Based on Attention Mechanism

被引:0
|
作者
Xie, Xiaona [1 ]
Xu, Zhiyong [1 ]
Jiang, Tao [1 ]
Yuan, JianYing [1 ]
Chang, Zhengwei [2 ]
Zhang, Linghao [2 ]
机构
[1] Chengdu Univ Informat Technol, Chengdu, Sichuan, Peoples R China
[2] State Grid Sichuan Elect Power Res Inst, Chengdu, Sichuan, Peoples R China
关键词
Semantic segmentation; thermal infrared images; visible light images; channel spatial attention mechanism; feature fusion; NETWORK;
D O I
10.1142/S0218126623502638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, there are many semantic segmentation algorithms with excellent performance for intelligent driving vehicles, but most of them only work well on scenes with good illumination. In order to solve the problem of scene segmentation under low illumination, this paper proposes a novel semantic segmentation algorithm that combines visible and infrared images. In this algorithm, two parallel encoders are designed as the input of the images, and the decoder divides the fused images output from the encoder. The model is based on ResNet algorithm, and the residual attention module is used in each branch to mine and enhance the spatial features of multilevel channels to extract images information. Experiments are carried out on publicly available thermal infrared and visible datasets. The results show that the algorithm proposed in this paper is superior to the algorithm using only visible images in semantic segmentation of traffic environment.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Superpixel-Based Attention Graph Neural Network for Semantic Segmentation in Aerial Images
    Diao, Qi
    Dai, Yaping
    Zhang, Ce
    Wu, Yan
    Feng, Xiaoxue
    Pan, Feng
    REMOTE SENSING, 2022, 14 (02)
  • [42] A Synergistical Attention Model for Semantic Segmentation of Remote Sensing Images
    Li, Xin
    Xu, Feng
    Liu, Fan
    Lyu, Xin
    Tong, Yao
    Xu, Zhennan
    Zhou, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [43] Class Attention Network for Semantic Segmentation of Remote Sensing Images
    Rao, Zhibo
    He, Mingyi
    Dai, Yuchao
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 150 - 155
  • [44] Threshold Attention Network for Semantic Segmentation of Remote Sensing Images
    Long, Wei
    Zhang, Yongjun
    Cui, Zhongwei
    Xu, Yujie
    Zhang, Xuexue
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [45] A Synergistical Attention Model for Semantic Segmentation of Remote Sensing Images
    Li, Xin
    Xu, Feng
    Liu, Fan
    Lyu, Xin
    Tong, Yao
    Xu, Zhennan
    Zhou, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [46] Orientation Attention Network for semantic segmentation of remote sensing images?
    Wang, Junxiao
    Feng, Zhixi
    Jiang, Yao
    Yang, Shuyuan
    Meng, Huixiao
    KNOWLEDGE-BASED SYSTEMS, 2023, 267
  • [47] Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images
    Niu, Ruigang
    Sun, Xian
    Tian, Yu
    Diao, Wenhui
    Chen, Kaiqiang
    Fu, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [48] Research on Deep Learning-based Semantic Segmentation Algorithm for UAV Images
    Yan, Qiang
    Cheng, Guojian
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 1579 - 1584
  • [49] Liver Tumor Segmentation Algorithm Based on Receptive Field Attention Mechanism
    Yang, Yun
    Wang, Xiaoman
    Alqahtani, Fayez
    Tolba, Amr
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2025,
  • [50] Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net
    Jiang, Jionghui
    Feng, Xi'an
    Ye, QiLei
    Hu, Zhongyi
    Gu, Zhiyang
    Huang, Hui
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (19) : 6219 - 6232