Infrared and Visible Image Fusion Based on Multi-scale Network with Dual-channel Information Cross Fusion Block

被引:1
|
作者
Yang, Yong [1 ]
Kong, Xiangkai [1 ]
Huang, Shuying [2 ]
Wan, Weiguo [3 ]
Liu, Jiaxiang [1 ]
Zhang, Wang [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang, Jiangxi, Peoples R China
[2] Tiangong Univ, Sch Comp Sci & Technol, Tianjin, Peoples R China
[3] Jiangxi Univ Finance & Econ, Sch Software & Internet Things Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
infrared and visible image fusion; pyramid network; information cross fusion; multi-scale features;
D O I
10.1109/IJCNN52387.2021.9533338
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of infrared and visible image fusion is to combine the complementary information of an infrared image and a visible image into a single image. In this paper, we propose an infrared and visible image fusion method based on dual-channel information cross fusion block (DICFB), which is developed to crossly extract and preliminarily fuse the multi-scale features of the source images. With the cascaded DICFB, we can obtain a series of fusion feature maps of the source images at different scales. Then, a progressive feature reconstruction module (PFRM) is designed to reconstruct the multi-scale fusion features to obtain the final fused image. Moreover, to better train the network, we design a joint loss function, in which a saliency map-based loss term is proposed to enhance the saliency targets in the fused images. Experimental results show that the proposed method has better performance than other state-of-the-art image fusion methods both objectively and subjectively.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion
    Wu, Dan
    Han, Mina
    Yang, Yang
    Zhao, Shan
    Rao, Yujing
    Li, Hao
    Lin, Xing
    Zhou, Chengjiang
    Bai, Haicheng
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [42] Adaptive Propagation Network Based on Multi-scale Information Fusion
    Ma, Qianli
    Wang, Chenzhi
    Fan, Zheng
    Qian, Yuhua
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VIII, 2023, 14261 : 51 - 62
  • [43] Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network
    Feng, Bin
    Ai, Chengbo
    Zhang, Haofei
    [J]. ELECTRONICS, 2024, 13 (12)
  • [44] Infrared and visual image fusion based on multi-scale feature decomposition
    Yan, Huibin
    Li, Zhongmin
    [J]. OPTIK, 2020, 203
  • [45] Infrared and Visible Image Fusion using Multi-Scale Decomposition and Visual Saliency Map
    Chen, Yunfan
    Xie, Han
    Yeo, Donghoon
    Shin, Hyunchul
    [J]. 2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 243 - 244
  • [46] Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion
    Xu, Qian
    Zheng, Yuan
    [J]. IEEE ACCESS, 2024, 12 : 8359 - 8372
  • [47] Infrared and Visible Image Fusion Using Multi-scale Decomposition and Partial Differential Equations
    Gargi Trivedi
    Rajesh Sanghvi
    [J]. International Journal of Applied and Computational Mathematics, 2024, 10 (4)
  • [48] ACFNet: An adaptive cross-fusion network for infrared and visible image fusion
    Chen, Xiaoxuan
    Xu, Shuwen
    Hu, Shaohai
    Ma, Xiaole
    [J]. Pattern Recognition, 2025, 159
  • [49] An infrared and visible image fusion method based upon multi-scale and top-hat transforms
    He, Gui-Qing
    Zhang, Qi-Qi
    Ji, Jia-Qi
    Dong, Dan-Dan
    Zhang, Hai-Xi
    Wang, Jun
    [J]. CHINESE PHYSICS B, 2018, 27 (11)
  • [50] Infrared and Visible Image Fusion Based on Contrast Enhancement and Multi-scale Edge-preserving Decomposition
    Zhu Haoran
    Liu Yunqing
    Zhang Wenying
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (06) : 1294 - 1300