DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion

被引:8
|
作者
Wu, Dan [1 ,2 ]
Han, Mina [2 ,3 ]
Yang, Yang [2 ,3 ]
Zhao, Shan [2 ,3 ]
Rao, Yujing [2 ,3 ]
Li, Hao [2 ,3 ]
Lin, Xing [2 ,3 ]
Zhou, Chengjiang [2 ,3 ]
Bai, Haicheng [1 ,2 ]
机构
[1] Yunnan Normal Univ, Sch Phys & Elect Informat, Kunming 650500, Peoples R China
[2] Yunnan Normal Univ, Lab Pattern Recognit & Artificial Intelligence, Kunming 650500, Peoples R China
[3] Yunnan Normal Univ, Sch Informat Sci & Technol, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Low-pass filters; Generative adversarial networks; Generators; Transformers; Deep learning; Filter; frequency decomposition; frequency enhancement; image fusion; infrared image; visible image; PERFORMANCE; WEIGHT;
D O I
10.1109/TIM.2023.3267380
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [11] MCnet: Multiscale visible image and infrared image fusion network
    Sun, Le
    Li, Yuhang
    Zheng, Min
    Zhong, Zhaoyi
    Zhang, Yanchun
    SIGNAL PROCESSING, 2023, 208
  • [12] Infrared and Visible Image Fusion Based on Mask and Cross-Dynamic Fusion
    Fu, Qiang
    Fu, Hanxiang
    Wu, Yuezhou
    ELECTRONICS, 2023, 12 (20)
  • [13] An Efficient Network Model for Visible and Infrared Image Fusion
    Pan, Zhu
    Ouyang, Wanqi
    IEEE ACCESS, 2023, 11 : 86413 - 86430
  • [14] Multigrained Attention Network for Infrared and Visible Image Fusion
    Li, Jing
    Huo, Hongtao
    Li, Chang
    Wang, Renhua
    Sui, Chenhong
    Liu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [15] A dual-encoder network based on multi-layer feature fusion for infrared and visible image fusion
    Huang, Shuying
    Wu, Xueqiang
    Yang, Yong
    Wan, Weiguo
    Wang, Xiaozheng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (10) : 4511 - 4520
  • [16] SimpliFusion: a simplified infrared and visible image fusion network
    Liu, Yong
    Li, Xingyuan
    Liu, Yong
    Zhong, Wei
    VISUAL COMPUTER, 2024,
  • [17] CFNet: An infrared and visible image compression fusion network
    Xing, Mengliang
    Liu, Gang
    Tang, Haojie
    Qian, Yao
    Zhang, Jun
    PATTERN RECOGNITION, 2024, 156
  • [18] Infrared and Visible Image Fusion via Decoupling Network
    Wang, Xue
    Guan, Zheng
    Yu, Shishuang
    Cao, Jinde
    Li, Ya
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [19] PFCFuse: A Poolformer and CNN Fusion Network for Infrared-Visible Image Fusion
    Hu, Xinyu
    Liu, Yang
    Yang, Feng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [20] Laplacian Pyramid Fusion Network With Hierarchical Guidance for Infrared and Visible Image Fusion
    Yao, Jiaxin
    Zhao, Yongqiang
    Bu, Yuanyang
    Kong, Seong G.
    Chan, Jonathan Cheung-Wai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4630 - 4644