Infrared and Visible Image Fusion Based on Multi-scale Network with Dual-channel Information Cross Fusion Block

被引:1
|
作者
Yang, Yong [1 ]
Kong, Xiangkai [1 ]
Huang, Shuying [2 ]
Wan, Weiguo [3 ]
Liu, Jiaxiang [1 ]
Zhang, Wang [1 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang, Jiangxi, Peoples R China
[2] Tiangong Univ, Sch Comp Sci & Technol, Tianjin, Peoples R China
[3] Jiangxi Univ Finance & Econ, Sch Software & Internet Things Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
infrared and visible image fusion; pyramid network; information cross fusion; multi-scale features;
D O I
10.1109/IJCNN52387.2021.9533338
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of infrared and visible image fusion is to combine the complementary information of an infrared image and a visible image into a single image. In this paper, we propose an infrared and visible image fusion method based on dual-channel information cross fusion block (DICFB), which is developed to crossly extract and preliminarily fuse the multi-scale features of the source images. With the cascaded DICFB, we can obtain a series of fusion feature maps of the source images at different scales. Then, a progressive feature reconstruction module (PFRM) is designed to reconstruct the multi-scale fusion features to obtain the final fused image. Moreover, to better train the network, we design a joint loss function, in which a saliency map-based loss term is proposed to enhance the saliency targets in the fused images. Experimental results show that the proposed method has better performance than other state-of-the-art image fusion methods both objectively and subjectively.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Infrared and Visible Image Fusion Method Based on Dual-Channel Generative Adversarial Network
    Hou Chunping
    Wang Xiaocong
    Xia Han
    Yang Yang
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [2] Infrared and visible image fusion based on FDST and dual-channel PCNN
    Dai J.
    Liu Y.
    Mao X.
    Sheng G.
    Jiang X.
    [J]. Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2019, 48 (02):
  • [3] A multi-scale information integration framework for infrared and visible image fusion
    Yang, Guang
    Li, Jie
    Lei, Hanxiao
    Gao, Xinbo
    [J]. NEUROCOMPUTING, 2024, 600
  • [4] Infrared and visible image fusion using multi-scale pyramid network
    Zuo, Fengyuan
    Huang, Yongdong
    Li, Qiufu
    Su, Weijian
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2022, 20 (05)
  • [5] MFT: Multi-scale Fusion Transformer for Infrared and Visible Image Fusion
    Zhang, Chen-Ming
    Yuan, Chengbo
    Luo, Yong
    Zhou, Xin
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 485 - 496
  • [6] Infrared and visible image fusion based on multi-scale dense attention connection network
    Chen Y.
    Zhang J.
    Wang Z.
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (18): : 2253 - 2266
  • [7] Fusion of visible and infrared images based on multi-scale image enhancement
    Sun, Ming-Chao
    Zhang, Chong
    Liu, Jing-Hong
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2012, 42 (03): : 738 - 742
  • [8] Multi-scale infrared and visible image fusion framework based on dual partial differential equations
    Guo, Chentong
    Liu, Chenhua
    Deng, Lei
    Chen, Zhixiang
    Dong, Mingli
    Zhu, Lianqing
    Chen, Hanrui
    Lu, Xitian
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2023, 135
  • [9] Infrared and Visible Image Fusion Based on Adaptive Dual-channel PCNN and Saliency Detection
    An, Ying
    Fan, Xunli
    Chen, Li
    Liu, Pei
    [J]. 2019 15TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS 2019), 2019, : 20 - 25
  • [10] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    [J]. Infrared Physics and Technology, 2022, 125