Semantic Segmentation Algorithm of Night Images Based on Attention Mechanism

被引:0
|
作者
Xie, Xiaona [1 ]
Xu, Zhiyong [1 ]
Jiang, Tao [1 ]
Yuan, JianYing [1 ]
Chang, Zhengwei [2 ]
Zhang, Linghao [2 ]
机构
[1] Chengdu Univ Informat Technol, Chengdu, Sichuan, Peoples R China
[2] State Grid Sichuan Elect Power Res Inst, Chengdu, Sichuan, Peoples R China
关键词
Semantic segmentation; thermal infrared images; visible light images; channel spatial attention mechanism; feature fusion; NETWORK;
D O I
10.1142/S0218126623502638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, there are many semantic segmentation algorithms with excellent performance for intelligent driving vehicles, but most of them only work well on scenes with good illumination. In order to solve the problem of scene segmentation under low illumination, this paper proposes a novel semantic segmentation algorithm that combines visible and infrared images. In this algorithm, two parallel encoders are designed as the input of the images, and the decoder divides the fused images output from the encoder. The model is based on ResNet algorithm, and the residual attention module is used in each branch to mine and enhance the spatial features of multilevel channels to extract images information. Experiments are carried out on publicly available thermal infrared and visible datasets. The results show that the algorithm proposed in this paper is superior to the algorithm using only visible images in semantic segmentation of traffic environment.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] A Semantic Segmentation Algorithm Based on Improved Attention Mechanism
    Chen, Chunyu
    Wu, Xinsheng
    Chen, An
    2020 INTERNATIONAL SYMPOSIUM ON AUTONOMOUS SYSTEMS (ISAS), 2020, : 244 - 248
  • [2] Semantic Segmentation Algorithm Based on Attention Mechanism and Transfer Learning
    Ye, Jianfeng
    Lu, Chong
    Xiong, Junfeng
    Wang, Huaming
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [3] Semantic Segmentation With Attention Mechanism for Remote Sensing Images
    Zhao, Qi
    Liu, Jiahui
    Li, Yuewen
    Zhang, Hong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Semantic segmentation algorithm based on class feature attention mechanism fusion
    Chen, Na
    Zhang, Rong-fen
    Liu, Yu-hong
    Li, Li
    Zhang, Wen-wen
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (02) : 236 - 244
  • [5] Semantic segmentation of remote sensing images based on dual-channel attention mechanism
    Jiang, Jionghui
    Feng, Xi'an
    Huang, Hui
    IET IMAGE PROCESSING, 2024, 18 (09) : 2346 - 2356
  • [6] An Unmanned Aerial Vehicle Detection Algorithm Based on Semantic Segmentation and Visual Attention Mechanism
    Zhang, Jiaohao
    Zhang, Qiang
    Shi, Chunlei
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 309 - 313
  • [7] Multimodal image semantic segmentation based on attention mechanism
    Zhang Ji-you
    Zhang Rong-fen
    Liu Yu-hong
    Yuan Wen-hao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (07) : 975 - 984
  • [8] Box-driven Weakly Supervised Images Semantic Segmentation Algorithm Based on Attention Model
    Liu, Jianxin
    Geng, Yushui
    Zhao, Jing
    Li, Wenxiao
    Zhang, Kang
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1797 - 1802
  • [9] Segmentation algorithm of armor plate surface images based on improved visual attention mechanism
    Chen, Yue
    Zhang, Jianhua
    Zhang, Hongyan
    Open Cybernetics and Systemics Journal, 2015, 9 (01): : 1385 - 1392
  • [10] Semantic segmentation of hyperspectral images using convolutional neural networks and the attention mechanism
    Gribanov, Danil Nikolaevich
    Mukhin, Artem Vladimirovich
    Kilbas, Igor Alexandrovich
    Paringer, Rustam Alexandrovich
    COMPUTER OPTICS, 2024, 48 (06)