SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks

被引:5
|
作者
Wang, Yong [1 ]
Pu, Jianfei [1 ]
Miao, Duoqian [2 ]
Zhang, L. [3 ]
Zhang, Lulu [1 ]
Du, Xin [1 ]
机构
[1] Chongqing Univ Technol, Sch Artificial Intelligence, Chongqing 401135, Peoples R China
[2] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[3] Nanyang Technol Univ, Rehabil Res Inst Singapore, Sch Mech & Aerosp Engn, Singapore City 308232, Singapore
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared image; Visible image; Attention mechanisms; Gradient-aggregation residual dense block; GENERATIVE ADVERSARIAL NETWORK; MULTISCALE; PERFORMANCE; TRANSFORM; FRAMEWORK; LIGHT; NEST;
D O I
10.1016/j.engappai.2024.107898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of image fusion is to retain the strengths of different images in the fused result. However, existing fusion algorithms are often complex in design and overlook the influence of attention mechanisms on deep features. To address these issues, we propose an image fusion network based on spatial/channel attention mechanisms and gradient -aggregated residual dense blocks(SCGRFuse). Firstly, we design a novel gradientaggregated residual dense block (GRXDB) that combines the advantages of ResNeXt and DenseNet, which integrating the Sobel and Laplacian operators to preserve both strong and weak texture features. Then, we introduce spatial and channel attention mechanisms to refine the channel and spatial information of feature maps, enhancing their information capturing capability. Additionally, we leverage a pooling fusion block to merge the refined spatial and channel feature maps, yielding high -quality fusion features. Compared to the existing state-of-the-art methods, experimental results on the MSRS, RoadScene and TNO datasets demonstrate the outstanding fusion performance of our proposed approach. In addition, in the task -driven experiments, SCGRFuse achieved an mIoU accuracy of 71.37%.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] IR-MSDNet: Infrared and Visible Image Fusion Based On Infrared Features and Multiscale Dense Network
    Raza, Asif
    Liu, Jingdong
    Liu, Yifan
    Liu, Jian
    Li, Zeng
    Chen, Xi
    Huo, Hong
    Fang, Tao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 3426 - 3437
  • [42] Multibranch Attention Mechanism Based on Channel and Spatial Attention Fusion
    Mao, Guojun
    Liao, Guanyi
    Zhu, Hengliang
    Sun, Bo
    MATHEMATICS, 2022, 10 (21)
  • [43] Gradient residual attention network for infrared image super-resolution
    Yuan, Xilin
    Zhang, Baohui
    Zhou, Jinjie
    Lian, Cheng
    Zhang, Qian
    Yue, Jiang
    OPTICS AND LASERS IN ENGINEERING, 2024, 175
  • [44] ResCCFusion: Infrared and visible image fusion network based on ResCC module and spatial criss-cross attention models
    Xiong, Zhang
    Zhang, Xiaohui
    Han, Hongwei
    Hu, Qingping
    INFRARED PHYSICS & TECHNOLOGY, 2024, 136
  • [45] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Li Gao
    DeLin Luo
    Song Wang
    Science China Technological Sciences, 2024, 67 : 408 - 422
  • [46] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Gao, Li
    Luo, Delin
    Wang, Song
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (02) : 408 - 422
  • [47] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    GAO Li
    LUO DeLin
    WANG Song
    Science China Technological Sciences, 2024, 67 (02) : 408 - 422
  • [48] Hyperspectral and Multispectral Image Fusion Based on Residual Dense Fusion Network
    Yuyuan Luo
    Jiawei Deng
    Bin Yang
    Sensing and Imaging, 26 (1):
  • [49] DRSNFuse: Deep Residual Shrinkage Network for Infrared and Visible Image Fusion
    Wang, Hongfeng
    Wang, Jianzhong
    Xu, Haonan
    Sun, Yong
    Yu, Zibo
    SENSORS, 2022, 22 (14)
  • [50] Self-Attention Progressive Network for Infrared and Visible Image Fusion
    Li, Shuying
    Han, Muyi
    Qin, Yuemei
    Li, Qiang
    REMOTE SENSING, 2024, 16 (18)