SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks

被引:5
|
作者
Wang, Yong [1 ]
Pu, Jianfei [1 ]
Miao, Duoqian [2 ]
Zhang, L. [3 ]
Zhang, Lulu [1 ]
Du, Xin [1 ]
机构
[1] Chongqing Univ Technol, Sch Artificial Intelligence, Chongqing 401135, Peoples R China
[2] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[3] Nanyang Technol Univ, Rehabil Res Inst Singapore, Sch Mech & Aerosp Engn, Singapore City 308232, Singapore
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared image; Visible image; Attention mechanisms; Gradient-aggregation residual dense block; GENERATIVE ADVERSARIAL NETWORK; MULTISCALE; PERFORMANCE; TRANSFORM; FRAMEWORK; LIGHT; NEST;
D O I
10.1016/j.engappai.2024.107898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of image fusion is to retain the strengths of different images in the fused result. However, existing fusion algorithms are often complex in design and overlook the influence of attention mechanisms on deep features. To address these issues, we propose an image fusion network based on spatial/channel attention mechanisms and gradient -aggregated residual dense blocks(SCGRFuse). Firstly, we design a novel gradientaggregated residual dense block (GRXDB) that combines the advantages of ResNeXt and DenseNet, which integrating the Sobel and Laplacian operators to preserve both strong and weak texture features. Then, we introduce spatial and channel attention mechanisms to refine the channel and spatial information of feature maps, enhancing their information capturing capability. Additionally, we leverage a pooling fusion block to merge the refined spatial and channel feature maps, yielding high -quality fusion features. Compared to the existing state-of-the-art methods, experimental results on the MSRS, RoadScene and TNO datasets demonstrate the outstanding fusion performance of our proposed approach. In addition, in the task -driven experiments, SCGRFuse achieved an mIoU accuracy of 71.37%.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models
    Li, Hui
    Wu, Xiao-Jun
    Durrani, Tariq
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) : 9645 - 9656
  • [22] Attention based dual UNET network for infrared and visible image fusion
    Wang, Xuejiao
    Hua, Zhen
    Li, Jinjiang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) : 66959 - 66980
  • [23] Wide Self-attention Mechanism Fusion Dense Residual Network Image Dehazing
    Wu K.
    Ding Y.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (08): : 13 - 22
  • [24] Visible-Assisted Infrared Image Super-Resolution Based on Spatial Attention Residual Network
    Yang, Xiaodong
    Zhang, Mengmeng
    Li, Wei
    Tao, Ran
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [25] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [26] LMDFusion: A lightweight infrared and visible image fusion network for substation equipment based on mask and residual dense connection
    Hao, Chi
    Delin, Luo
    Song, Wang
    INFRARED PHYSICS & TECHNOLOGY, 2024, 138
  • [27] MSCS: Multi-stage feature learning with channel-spatial attention mechanism for infrared and visible image fusion
    Huang, Zhenghua
    Xu, Biyun
    Xia, Menghan
    Li, Qian
    Zou, Lianying
    Li, Shaoyi
    Li, Xi
    INFRARED PHYSICS & TECHNOLOGY, 2024, 142
  • [28] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    Infrared Physics and Technology, 2022, 125
  • [29] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    INFRARED PHYSICS & TECHNOLOGY, 2022, 125
  • [30] Multi-Scale Aggregation Residual Channel Attention Fusion Network for Single Image Deraining
    Wang, Jyun-Guo
    Wu, Cheng-Shiuan
    APPLIED SCIENCES-BASEL, 2023, 13 (04):