DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion

被引:8
|
作者
Wu, Dan [1 ,2 ]
Han, Mina [2 ,3 ]
Yang, Yang [2 ,3 ]
Zhao, Shan [2 ,3 ]
Rao, Yujing [2 ,3 ]
Li, Hao [2 ,3 ]
Lin, Xing [2 ,3 ]
Zhou, Chengjiang [2 ,3 ]
Bai, Haicheng [1 ,2 ]
机构
[1] Yunnan Normal Univ, Sch Phys & Elect Informat, Kunming 650500, Peoples R China
[2] Yunnan Normal Univ, Lab Pattern Recognit & Artificial Intelligence, Kunming 650500, Peoples R China
[3] Yunnan Normal Univ, Sch Informat Sci & Technol, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Low-pass filters; Generative adversarial networks; Generators; Transformers; Deep learning; Filter; frequency decomposition; frequency enhancement; image fusion; infrared image; visible image; PERFORMANCE; WEIGHT;
D O I
10.1109/TIM.2023.3267380
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [41] MAFusion: Multiscale Attention Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Chen, Houjin
    Li, Yanfeng
    Peng, Yahui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [42] Infrared and Visible Image Fusion with Convolutional Neural Network and Transformer
    Yang, Yang
    Ren, Zhennan
    Li, Beichen
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [43] A Multilevel Hybrid Transmission Network for Infrared and Visible Image Fusion
    Li, Qingqing
    Han, Guangliang
    Liu, Peixun
    Yang, Hang
    Chen, Dianbing
    Sun, Xinglong
    Wu, Jiajia
    Liu, Dongxu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [44] Unsupervised densely attention network for infrared and visible image fusion
    Yang Li
    Jixiao Wang
    Zhuang Miao
    Jiabao Wang
    Multimedia Tools and Applications, 2020, 79 : 34685 - 34696
  • [45] Infrared and visible image fusion of convolutional neural network and NSST
    Huan K.
    Li X.
    Cao Y.
    Chen X.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (03):
  • [46] Multiscale channel attention network for infrared and visible image fusion
    Zhu, Jiahui
    Dou, Qingyu
    Jian, Lihua
    Liu, Kai
    Hussain, Farhan
    Yang, Xiaomin
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (22):
  • [47] An efficient frequency domain fusion network of infrared and visible images
    Wang, Chenwu
    Wu, Junsheng
    Fang, Aiqing
    Zhu, Zhixiang
    Wang, Pei
    Chen, Hao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [48] A Generative Adversarial Network with Dual Discriminators for Infrared and Visible Image Fusion Based on Saliency Detection
    Zhang, Dazhi
    Hou, Jilei
    Wu, Wei
    Lu, Tao
    Zhou, Huabing
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [49] DBSD: DUAL branches network using semantic and detail information for infrared and visible image fusion
    Wang, Xuejiao
    Hua, Zhen
    Li, Jinjiang
    INFRARED PHYSICS & TECHNOLOGY, 2023, 133
  • [50] Infrared and Visible Image Fusion Method Based on Dual-Channel Generative Adversarial Network
    Hou Chunping
    Wang Xiaocong
    Xia Han
    Yang Yang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)