SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks

被引:5
|
作者
Wang, Yong [1 ]
Pu, Jianfei [1 ]
Miao, Duoqian [2 ]
Zhang, L. [3 ]
Zhang, Lulu [1 ]
Du, Xin [1 ]
机构
[1] Chongqing Univ Technol, Sch Artificial Intelligence, Chongqing 401135, Peoples R China
[2] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[3] Nanyang Technol Univ, Rehabil Res Inst Singapore, Sch Mech & Aerosp Engn, Singapore City 308232, Singapore
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared image; Visible image; Attention mechanisms; Gradient-aggregation residual dense block; GENERATIVE ADVERSARIAL NETWORK; MULTISCALE; PERFORMANCE; TRANSFORM; FRAMEWORK; LIGHT; NEST;
D O I
10.1016/j.engappai.2024.107898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of image fusion is to retain the strengths of different images in the fused result. However, existing fusion algorithms are often complex in design and overlook the influence of attention mechanisms on deep features. To address these issues, we propose an image fusion network based on spatial/channel attention mechanisms and gradient -aggregated residual dense blocks(SCGRFuse). Firstly, we design a novel gradientaggregated residual dense block (GRXDB) that combines the advantages of ResNeXt and DenseNet, which integrating the Sobel and Laplacian operators to preserve both strong and weak texture features. Then, we introduce spatial and channel attention mechanisms to refine the channel and spatial information of feature maps, enhancing their information capturing capability. Additionally, we leverage a pooling fusion block to merge the refined spatial and channel feature maps, yielding high -quality fusion features. Compared to the existing state-of-the-art methods, experimental results on the MSRS, RoadScene and TNO datasets demonstrate the outstanding fusion performance of our proposed approach. In addition, in the task -driven experiments, SCGRFuse achieved an mIoU accuracy of 71.37%.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Infrared and visible image fusion based on residual dense network and gradient loss
    Li, Jiawei
    Liu, Jinyuan
    Zhou, Shihua
    Zhang, Qiang
    Kasabov, Nikola K.
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2023, 128
  • [2] Infrared and Visible Image Fusion Based on Dual Channel Residual Dense Network
    Feng Xin
    Yang Jieming
    Zhang Hongde
    Qiu Guohang
    [J]. ACTA PHOTONICA SINICA, 2023, 52 (11)
  • [3] FusionGRAM: An Infrared and Visible Image Fusion Framework Based on Gradient Residual and Attention Mechanism
    Wang, Jinxin
    Xi, Xiaoli
    Li, Dongmei
    Li, Fang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [4] RDCa-Net: Residual dense channel attention symmetric network for infrared and visible image fusion
    Huang, Zuyan
    Yang, Bin
    Liu, Chang
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2023, 130
  • [5] Infrared and visible image fusion based on dilated residual attention network
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Mustafa, Hamza
    Zareapoor, Masoumeh
    [J]. OPTIK, 2020, 224
  • [6] RAN: Infrared and Visible Image Fusion Network Based on Residual Attention Decomposition
    Yu, Jia
    Lu, Gehao
    Zhang, Jie
    [J]. ELECTRONICS, 2024, 13 (14)
  • [7] Multiscale channel attention network for infrared and visible image fusion
    Zhu, Jiahui
    Dou, Qingyu
    Jian, Lihua
    Liu, Kai
    Hussain, Farhan
    Yang, Xiaomin
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (22):
  • [8] RXDNFuse: A aggregated residual dense network for infrared and visible image fusion
    Long, Yongzhi
    Jia, Haitao
    Zhong, Yida
    Jiang, Yadong
    Jia, Yuming
    [J]. INFORMATION FUSION, 2021, 69 : 128 - 141
  • [9] Dual-Attention-Based Feature Aggregation Network for Infrared and Visible Image Fusion
    Tang, Zhimin
    Xiao, Guobao
    Guo, Junwen
    Wang, Shiping
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [10] Infrared and Visible Image Fusion Based on Residual Dense Block and Auto-Encoder Network
    Wang, Jianzhong
    Xu, Haonan
    Wang, Hongfeng
    Yu, Zibo
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2021, 41 (10): : 1077 - 1083