SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks

被引:5
|
作者
Wang, Yong [1 ]
Pu, Jianfei [1 ]
Miao, Duoqian [2 ]
Zhang, L. [3 ]
Zhang, Lulu [1 ]
Du, Xin [1 ]
机构
[1] Chongqing Univ Technol, Sch Artificial Intelligence, Chongqing 401135, Peoples R China
[2] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[3] Nanyang Technol Univ, Rehabil Res Inst Singapore, Sch Mech & Aerosp Engn, Singapore City 308232, Singapore
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared image; Visible image; Attention mechanisms; Gradient-aggregation residual dense block; GENERATIVE ADVERSARIAL NETWORK; MULTISCALE; PERFORMANCE; TRANSFORM; FRAMEWORK; LIGHT; NEST;
D O I
10.1016/j.engappai.2024.107898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of image fusion is to retain the strengths of different images in the fused result. However, existing fusion algorithms are often complex in design and overlook the influence of attention mechanisms on deep features. To address these issues, we propose an image fusion network based on spatial/channel attention mechanisms and gradient -aggregated residual dense blocks(SCGRFuse). Firstly, we design a novel gradientaggregated residual dense block (GRXDB) that combines the advantages of ResNeXt and DenseNet, which integrating the Sobel and Laplacian operators to preserve both strong and weak texture features. Then, we introduce spatial and channel attention mechanisms to refine the channel and spatial information of feature maps, enhancing their information capturing capability. Additionally, we leverage a pooling fusion block to merge the refined spatial and channel feature maps, yielding high -quality fusion features. Compared to the existing state-of-the-art methods, experimental results on the MSRS, RoadScene and TNO datasets demonstrate the outstanding fusion performance of our proposed approach. In addition, in the task -driven experiments, SCGRFuse achieved an mIoU accuracy of 71.37%.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network
    Xu, Dongdong
    Wang, Yongcheng
    Xu, Shuyan
    Zhu, Kaiguang
    Zhang, Ning
    Zhang, Xin
    APPLIED SCIENCES-BASEL, 2020, 10 (02):
  • [32] Remote Sensing Image Fusion Algorithm Based on Two-Stream Fusion Network and Residual Channel Attention Mechanism
    Huang, Mengxing
    Liu, Shi
    Li, Zhenfeng
    Feng, Siling
    Wu, Di
    Wu, Yuanyuan
    Shu, Feng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [33] An Image Fusion Method Based on Special Residual Network and Efficient Channel Attention
    Li, Yang
    Yang, Haitao
    Wang, Jinyu
    Zhang, Changgong
    Liu, Zhengjun
    Chen, Hang
    ELECTRONICS, 2022, 11 (19)
  • [34] Unsupervised densely attention network for infrared and visible image fusion
    Li, Yang
    Wang, Jixiao
    Miao, Zhuang
    Wang, Jiabao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (45-46) : 34685 - 34696
  • [35] MAFusion: Multiscale Attention Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Chen, Houjin
    Li, Yanfeng
    Peng, Yahui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [36] Unsupervised densely attention network for infrared and visible image fusion
    Yang Li
    Jixiao Wang
    Zhuang Miao
    Jiabao Wang
    Multimedia Tools and Applications, 2020, 79 : 34685 - 34696
  • [37] MRASFusion: A multi-scale residual attention infrared and visible image fusion network based on semantic segmentation guidance
    An, Rongsheng
    Liu, Gang
    Qian, Yao
    Xing, Mengliang
    Tang, Haojie
    INFRARED PHYSICS & TECHNOLOGY, 2024, 139
  • [38] Infrared and visible image fusion with deep wavelet-dense network
    Chen, Yanling
    Cheng, Lianglun
    Wu, Heng
    Chen, Ziyang
    LI, Feng
    OPTICA APPLICATA, 2023, 53 (01) : 49 - 64
  • [39] MTDFusion: A Multilayer Triple Dense Network for Infrared and Visible Image Fusion
    Karim, Shahid
    Tong, Geng
    Li, Jinyang
    Yu, Xiaochang
    Hao, Jia
    Qadir, Akeel
    Yu, Yiting
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 17
  • [40] CrossFuse: A novel cross attention mechanism based infrared and visible image fusion approach
    Li, Hui
    Wu, Xiao-Jun
    INFORMATION FUSION, 2024, 103