DGFusion: An effective dynamic generalizable network for infrared and visible image fusion

被引:0
|
作者
Zhao, Longjie [1 ]
Yang, Runlin [1 ]
Yan, Bao [1 ]
Wang, Song [2 ]
Guo, Zhengyu [3 ]
Luo, Delin [1 ]
机构
[1] Xiamen Univ, Sch Aerosp Engn, Xiamen 361102, Peoples R China
[2] China Southern Power Grid, Elect Power Res Inst, Guangzhou 510063, Peoples R China
[3] Natl Key Lab Air Based Informat Percept & Fus, Luoyang 471000, Peoples R China
关键词
Image fusion; Attention mechanism; Deep learning; Multi-modal; GENERATIVE ADVERSARIAL NETWORK; NEST;
D O I
10.1016/j.infrared.2024.105495
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
The objective of infrared and visible image fusion is to generate a unified image that highlights prominent targets and retains intricate texture details, even in scenarios with imbalanced source image information. However, current image fusion algorithms primarily consider factors like illumination, restricting their applicability to certain scenes and compromising their adaptability. To tackle the issue, this paper proposes the DGFusion, which utilizes TWSSLoss to balance the contribution of source images in the fused output, effectively mitigating the limitations linked to relying solely on illumination guidance. Additionally, modality- complement feature attention harmonizer (MCFAH) facilitates cross-modal channel attention learning. This process assigns weights to features and accomplishes fusion by exchanging cross-modal differential information, thereby enriching each feature with details from the other modality. Furthermore, the multi convolution attentive net (MCAN) dynamically adjusts the contributions of features from different modalities. It prioritizes the most expressive characteristics to accentuate complementary information, enabling efficient fusion. In conclusion, our method outperforms seven state-of-the-art alternatives in terms of preserving target details and retaining texture information. Rigorous generalization experiments across five diverse datasets demonstrate the robustness of our DGFusion model in various scenarios.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] MSFNet: MultiStage Fusion Network for infrared and visible image fusion
    Wang, Chenwu
    Wu, Junsheng
    Zhu, Zhixiang
    Chen, Hao
    [J]. NEUROCOMPUTING, 2022, 507 : 26 - 39
  • [2] MCnet: Multiscale visible image and infrared image fusion network
    Sun, Le
    Li, Yuhang
    Zheng, Min
    Zhong, Zhaoyi
    Zhang, Yanchun
    [J]. SIGNAL PROCESSING, 2023, 208
  • [3] An Efficient Network Model for Visible and Infrared Image Fusion
    Pan, Zhu
    Ouyang, Wanqi
    [J]. IEEE ACCESS, 2023, 11 : 86413 - 86430
  • [4] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [5] SimpliFusion: a simplified infrared and visible image fusion network
    Liu, Yong
    Li, Xingyuan
    Liu, Yong
    Zhong, Wei
    [J]. VISUAL COMPUTER, 2024,
  • [6] CFNet: An infrared and visible image compression fusion network
    Xing, Mengliang
    Liu, Gang
    Tang, Haojie
    Qian, Yao
    Zhang, Jun
    [J]. PATTERN RECOGNITION, 2024, 156
  • [7] Infrared and Visible Image Fusion via Decoupling Network
    Wang, Xue
    Guan, Zheng
    Yu, Shishuang
    Cao, Jinde
    Li, Ya
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] Infrared and Visible Image Fusion with a Generative Adversarial Network and a Residual Network
    Xu, Dongdong
    Wang, Yongcheng
    Xu, Shuyan
    Zhu, Kaiguang
    Zhang, Ning
    Zhang, Xin
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (02):
  • [9] Region-based infrared and visible dynamic image fusion
    Yang, Bo
    Xiao, Gang
    Jing, Zhongliang
    [J]. NONLINEAR SCIENCE AND COMPLEXITY, 2007, 1 : 498 - +
  • [10] Infrared and visible image fusion with supervised convolutional neural network
    An, Wen-Bo
    Wang, Hong-Mei
    [J]. OPTIK, 2020, 219