DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion

被引:8
|
作者
Wu, Dan [1 ,2 ]
Han, Mina [2 ,3 ]
Yang, Yang [2 ,3 ]
Zhao, Shan [2 ,3 ]
Rao, Yujing [2 ,3 ]
Li, Hao [2 ,3 ]
Lin, Xing [2 ,3 ]
Zhou, Chengjiang [2 ,3 ]
Bai, Haicheng [1 ,2 ]
机构
[1] Yunnan Normal Univ, Sch Phys & Elect Informat, Kunming 650500, Peoples R China
[2] Yunnan Normal Univ, Lab Pattern Recognit & Artificial Intelligence, Kunming 650500, Peoples R China
[3] Yunnan Normal Univ, Sch Informat Sci & Technol, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Low-pass filters; Generative adversarial networks; Generators; Transformers; Deep learning; Filter; frequency decomposition; frequency enhancement; image fusion; infrared image; visible image; PERFORMANCE; WEIGHT;
D O I
10.1109/TIM.2023.3267380
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] ACFNet: An adaptive cross-fusion network for infrared and visible image fusion
    Chen, Xiaoxuan
    Xu, Shuwen
    Hu, Shaohai
    Ma, Xiaole
    [J]. Pattern Recognition, 2025, 159
  • [2] A Dual-branch Network for Infrared and Visible Image Fusion
    Fu, Yu
    Wu, Xiao-Jun
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10675 - 10680
  • [3] DCFusion: Dual-Headed Fusion Strategy and Contextual Information Awareness for Infrared and Visible Remote Sensing Image
    Pu, Qin
    Chehri, Abdellah
    Jeon, Gwanggil
    Zhang, Lei
    Yang, Xiaomin
    [J]. REMOTE SENSING, 2023, 15 (01)
  • [4] DFPGAN: Dual fusion path generative adversarial network for infrared and visible image fusion
    Yi, Shi
    Li, Junjie
    Yuan, Xuesong
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2021, 119
  • [5] Attention based dual UNET network for infrared and visible image fusion
    Wang, Xuejiao
    Hua, Zhen
    Li, Jinjiang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) : 66959 - 66980
  • [6] MSFNet: MultiStage Fusion Network for infrared and visible image fusion
    Wang, Chenwu
    Wu, Junsheng
    Zhu, Zhixiang
    Chen, Hao
    [J]. NEUROCOMPUTING, 2022, 507 : 26 - 39
  • [7] Frequency Integration and Spatial Compensation Network for infrared and visible image fusion
    Zheng, Naishan
    Zhou, Man
    Huang, Jie
    Zhao, Feng
    [J]. INFORMATION FUSION, 2024, 109
  • [8] Infrared and Visible Image Fusion Based on Multi-scale Network with Dual-channel Information Cross Fusion Block
    Yang, Yong
    Kong, Xiangkai
    Huang, Shuying
    Wan, Weiguo
    Liu, Jiaxiang
    Zhang, Wang
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] Infrared and Visible Image Fusion Based on Dual Channel Residual Dense Network
    Feng Xin
    Yang Jieming
    Zhang Hongde
    Qiu Guohang
    [J]. ACTA PHOTONICA SINICA, 2023, 52 (11)
  • [10] Infrared and Visible Image Fusion Using Detail Enhanced Channel Attention Network
    Cui, Yinghan
    Du, Huiqian
    Mei, Wenbo
    [J]. IEEE ACCESS, 2019, 7 : 182185 - 182197