Semantic Segmentation Algorithm of Night Images Based on Attention Mechanism

被引:0
|
作者
Xie, Xiaona [1 ]
Xu, Zhiyong [1 ]
Jiang, Tao [1 ]
Yuan, JianYing [1 ]
Chang, Zhengwei [2 ]
Zhang, Linghao [2 ]
机构
[1] Chengdu Univ Informat Technol, Chengdu, Sichuan, Peoples R China
[2] State Grid Sichuan Elect Power Res Inst, Chengdu, Sichuan, Peoples R China
关键词
Semantic segmentation; thermal infrared images; visible light images; channel spatial attention mechanism; feature fusion; NETWORK;
D O I
10.1142/S0218126623502638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
At present, there are many semantic segmentation algorithms with excellent performance for intelligent driving vehicles, but most of them only work well on scenes with good illumination. In order to solve the problem of scene segmentation under low illumination, this paper proposes a novel semantic segmentation algorithm that combines visible and infrared images. In this algorithm, two parallel encoders are designed as the input of the images, and the decoder divides the fused images output from the encoder. The model is based on ResNet algorithm, and the residual attention module is used in each branch to mine and enhance the spatial features of multilevel channels to extract images information. Experiments are carried out on publicly available thermal infrared and visible datasets. The results show that the algorithm proposed in this paper is superior to the algorithm using only visible images in semantic segmentation of traffic environment.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Semantic segmentation based on double pyramid network with improved global attention mechanism
    Xianfeng Ou
    Hanpu Wang
    Guoyun Zhang
    Wujing Li
    Shuixiang Yu
    Applied Intelligence, 2023, 53 : 18898 - 18909
  • [32] Semantic Segmentation Method of Point Cloud Based on Sparse Convolution and Attention Mechanism
    Zuo Meng
    Liu Yiyang
    Cui Hao
    Bai Hongfei
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (20)
  • [33] Semantic Segmentation of Plant Leaves Based on Generative Adversarial Network and Attention Mechanism
    Cao, Liying
    Li, Hongda
    Liu, Xuerui
    Chen, Guifen
    Yu, Helong
    IEEE ACCESS, 2022, 10 : 76310 - 76317
  • [34] Semantic segmentation based on double pyramid network with improved global attention mechanism
    Ou, Xianfeng
    Wang, Hanpu
    Zhang, Guoyun
    Li, Wujing
    Yu, Shuixiang
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18898 - 18909
  • [35] Point cloud semantic segmentation network based on graph convolution and attention mechanism
    Yang, Nan
    Wang, Yong
    Zhang, Lei
    Jiang, Bin
    Engineering Applications of Artificial Intelligence, 2025, 141
  • [36] Multiple-Attention Mechanism Network for Semantic Segmentation
    Wang, Dongli
    Xiang, Shengliang
    Zhou, Yan
    Mu, Jinzhen
    Zhou, Haibin
    Irampaye, Richard
    SENSORS, 2022, 22 (12)
  • [37] Discriminative Feature Network Based on a Hierarchical Attention Mechanism for Semantic Hippocampus Segmentation
    Shi, Jiali
    Zhang, Rong
    Guo, Lijun
    Gao, Linlin
    Ma, Huifang
    Wang, Jianhua
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (02) : 504 - 513
  • [38] Image Semantic Segmentation Based on Combination of DeepLabV3+ and Attention Mechanism
    Qiu Yunfei
    Wen Jinyan
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [39] Attention Mechanism for Improving Facial Landmark Semantic Segmentation
    Kim, Hyungjoon
    Kim, Hyeonwoo
    Cho, Seongkuk
    Hwang, Eenjun
    ADVANCES IN ARTIFICIAL INTELLIGENCE AND APPLIED COGNITIVE COMPUTING, 2021, : 817 - 824
  • [40] Class-aware feature attention-based semantic segmentation on hyperspectral images
    Sevugan, Prabu
    Rudhrakoti, Venkatesan
    Kim, Tai-hoon
    Gunasekaran, Megala
    Purushotham, Swarnalatha
    Chinthaginjala, Ravikumar
    Ahmad, Irfan
    Kumar, A.
    PLOS ONE, 2025, 20 (02):