Infrared and Visible Image Fusion Based on Multi-scale Network with Dual-channel Information Cross Fusion Block

被引:1
|
作者
Yang, Yong [1 ]
Kong, Xiangkai [1 ]
Huang, Shuying [2 ]
Wan, Weiguo [3 ]
Liu, Jiaxiang [1 ]
Zhang, Wang [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang, Jiangxi, Peoples R China
[2] Tiangong Univ, Sch Comp Sci & Technol, Tianjin, Peoples R China
[3] Jiangxi Univ Finance & Econ, Sch Software & Internet Things Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
infrared and visible image fusion; pyramid network; information cross fusion; multi-scale features;
D O I
10.1109/IJCNN52387.2021.9533338
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of infrared and visible image fusion is to combine the complementary information of an infrared image and a visible image into a single image. In this paper, we propose an infrared and visible image fusion method based on dual-channel information cross fusion block (DICFB), which is developed to crossly extract and preliminarily fuse the multi-scale features of the source images. With the cascaded DICFB, we can obtain a series of fusion feature maps of the source images at different scales. Then, a progressive feature reconstruction module (PFRM) is designed to reconstruct the multi-scale fusion features to obtain the final fused image. Moreover, to better train the network, we design a joint loss function, in which a saliency map-based loss term is proposed to enhance the saliency targets in the fused images. Experimental results show that the proposed method has better performance than other state-of-the-art image fusion methods both objectively and subjectively.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] Infrared and visible image fusion based on multi-channel convolutional neural network
    Wang, Hongmei
    An, Wenbo
    Li, Lin
    Li, Chenkai
    Zhou, Daming
    [J]. IET IMAGE PROCESSING, 2022, 16 (06) : 1575 - 1584
  • [32] Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
    Yuan, Yubin
    Shen, Yu
    Peng, Jing
    Wang, Lin
    Zhang, Hongguo
    [J]. JOURNAL OF SENSORS, 2020, 2020
  • [33] Dual-channel Rybak neural network based medical image fusion
    Goyal, Neeraj
    Goyal, Nandini
    Mendiratta, Taesha
    Kharbanda, Himani
    Bansal, Keshav
    Mann, Sukhmanpreet Kaur
    Panigrahy, Chinmaya
    Aggarwal, Ashutosh
    [J]. Optics and Laser Technology, 2025, 181
  • [34] A dual-encoder network based on multi-layer feature fusion for infrared and visible image fusion
    Huang, Shuying
    Wu, Xueqiang
    Yang, Yong
    Wan, Weiguo
    Wang, Xiaozheng
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (10) : 4511 - 4520
  • [35] Multi-scale Fusion of Stretched Infrared and Visible Images
    Jia, Weibin
    Song, Zhihuan
    Li, Zhengguo
    [J]. SENSORS, 2022, 22 (17)
  • [36] Multi-scale saliency measure and orthogonal space for visible and infrared image fusion
    Liu, Yaochen
    Dong, Lili
    Ren, Wei
    Xu, Wenhai
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2021, 118
  • [37] Attention based dual UNET network for infrared and visible image fusion
    Wang, Xuejiao
    Hua, Zhen
    Li, Jinjiang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) : 66959 - 66980
  • [38] Deep Neural Network for Infrared and Visible Image Fusion Based on Multi-scale Decomposition and Interactive Residual Coordinate Attention
    Zong, Sha
    Xie, Zhihua
    Li, Qiang
    Liu, Guodong
    [J]. ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 254 - 262
  • [39] Infrared and Visible Image Fusion Algorithm Based on Improved Guided Filtering and Dual-Channel Spiking Cortical Model
    Jiang Zetao
    Wu Hui
    Zhou Xiaoling
    [J]. ACTA OPTICA SINICA, 2018, 38 (02)
  • [40] Single image super-resolution with multi-scale information cross-fusion network
    Hu, Yanting
    Gao, Xinbo
    Li, Jie
    Huang, Yuanfei
    Wang, Hanzi
    [J]. SIGNAL PROCESSING, 2021, 179