DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion

被引:8
|
作者
Wu, Dan [1 ,2 ]
Han, Mina [2 ,3 ]
Yang, Yang [2 ,3 ]
Zhao, Shan [2 ,3 ]
Rao, Yujing [2 ,3 ]
Li, Hao [2 ,3 ]
Lin, Xing [2 ,3 ]
Zhou, Chengjiang [2 ,3 ]
Bai, Haicheng [1 ,2 ]
机构
[1] Yunnan Normal Univ, Sch Phys & Elect Informat, Kunming 650500, Peoples R China
[2] Yunnan Normal Univ, Lab Pattern Recognit & Artificial Intelligence, Kunming 650500, Peoples R China
[3] Yunnan Normal Univ, Sch Informat Sci & Technol, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Low-pass filters; Generative adversarial networks; Generators; Transformers; Deep learning; Filter; frequency decomposition; frequency enhancement; image fusion; infrared image; visible image; PERFORMANCE; WEIGHT;
D O I
10.1109/TIM.2023.3267380
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [21] Enlighten Fusion Multiscale Network for Infrared and Visible Image Fusion in Dark Environments
    Wang, Haozhe
    Shu, Chang
    Li, Xiaofeng
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1167 - 1171
  • [22] DSMGN: Dual-Supervised Mask Generation Network for Infrared and Visible Image Fusion
    Yang, Yong
    Xia, Yukun
    Huang, Shuying
    Wan, Weiguo
    Sun, Xuemei
    IEEE MULTIMEDIA, 2023, 30 (04) : 82 - 90
  • [23] Lightweight infrared and visible image fusion network with edge-guided dual attention
    Zou, Xingyue
    Tang, Jiqiang
    Yang, Luqi
    Zhu, Zhenhang
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (06) : 63014
  • [24] Dual-Attention-Based Feature Aggregation Network for Infrared and Visible Image Fusion
    Tang, Zhimin
    Xiao, Guobao
    Guo, Junwen
    Wang, Shiping
    Ma, Jiayi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [25] Infrared and Visible Image Fusion Based on Improved Dual Path Generation Adversarial Network
    Yang, Shen
    Tian, Lifan
    Liang, Jiaming
    Huang, Zefeng
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 3012 - 3021
  • [26] MDAN: Multilevel dual-branch attention network for infrared and visible image fusion
    Wang, Jiawei
    Jiang, Min
    Kong, Jun
    OPTICS AND LASERS IN ENGINEERING, 2024, 176
  • [27] TDDFusion: A Target-Driven Dual Branch Network for Infrared and Visible Image Fusion
    Lu, Siyu
    Ye, Xiangzhou
    Rao, Junmin
    Li, Fanming
    Liu, Shijian
    SENSORS, 2024, 24 (01)
  • [28] Infrared and Visible Image Fusion with Deep Neural Network in Enhanced Flight Vision System
    Gao, Xuyang
    Shi, Yibing
    Zhu, Qi
    Fu, Qiang
    Wu, Yuezhou
    REMOTE SENSING, 2022, 14 (12)
  • [29] Infrared and visible image fusion method of dual NSCT and PCNN
    Wu, Chunming
    Chen, Long
    PLOS ONE, 2020, 15 (09):
  • [30] MACCNet: Multiscale Attention and Cross- Convolutional Network for Infrared and Visible Image Fusion
    Yang, Yong
    Zhou, Na
    Wan, Weiguo
    Huang, Shuying
    IEEE SENSORS JOURNAL, 2024, 24 (10) : 16587 - 16600