Infrared and Visible Image Fusion Method Based on Degradation Model

被引:0
|
作者
Jiang Yichun [1 ]
Liu Yunqing [1 ]
Zhan Weida [1 ]
Zhu Depeng [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Elect & Informat Engn, Changchun 130022, Peoples R China
关键词
Image fusion; Deep learning; Degradation model; Data augmentation; NETWORK;
D O I
10.11999/JEIT211112
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion algorithms based on deep learning rely on artificially designed similarity functions to measure the similarity between input and output. The unsupervised learning method can not effectively utilize the ability of neural networks to extract deep features, resulting in unsatisfactory fusion results. Considering this problem, a new fusion degradation model of infrared and visible image is proposed in this paper, which regards infrared and visible images as the degraded images produced by ideal fusion images through mixed degradation processes. Secondly, a data enhancement scheme for simulating image degradation is proposed, and a large number of simulated degradation images are generated by using high-definition datasets for training the network. Finally, a simple and efficient end- to-end network model and its network training framework are designed based on the proposed degradation model. The experimental results show that the method proposed in this paper not only has good visual effects and performance indicators, but also can effectively suppress interferences such as illumination, smoke and noise.
引用
收藏
页码:4405 / 4415
页数:11
相关论文
共 29 条
  • [1] Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    [J]. IEEE SENSORS JOURNAL, 2016, 16 (01) : 203 - 209
  • [2] Image Blind Deblurring Algorithm Based on Deep Multi-level Wavelet Transform
    Chen Shuzhen
    Cao Shipeng
    Cui Meiyue
    Lian Qiusheng
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (01) : 154 - 161
  • [3] Thermal Image Restoration Based on LWIR Sensor Statistics
    Han, Jaeduk
    Lee, Haegeun
    Kang, Moon Gi
    [J]. SENSORS, 2021, 21 (16)
  • [4] Image fusion method based on simultaneous sparse representation with non-subsampled contourlet transform
    He, Guiqing
    Xing, Siyuan
    He, Xingjian
    Wang, Jun
    Fan, Jianping
    [J]. IET COMPUTER VISION, 2019, 13 (02) : 240 - 248
  • [5] PIRM Challenge on Perceptual Image Enhancement on Smartphones: Report
    Ignatov, Andrey
    Timofte, Radu
    Vu, Thang Van
    Luu, Tung Minh
    Pham, Trung X.
    Nguyen, Cao Van
    Kim, Yongwoo
    Choi, Jae-Seok
    Kim, Munchurl
    Huang, Jie
    Ran, Jiewen
    Xing, Chen
    Zhou, Xingguang
    Zhu, Pengfei
    Geng, Mingrui
    Li, Yawei
    Agustsson, Eirikur
    Gu, Shuhang
    Gool, Luc Van
    de Stoutz, Etienne
    Kobyshev, Nikolay
    Nie, Kehui
    Zhao, Yan
    Li, Gen
    Tong, Tong
    Gao, Qinquan
    Liu, Hanwen
    Michelini, Pablo Navarrete
    Dan, Zhu
    Hu, Fengshuo
    Hui, Zheng
    Wang, Xiumei
    Deng, Lirui
    Meng, Rang
    Qin, Jinghui
    Shi, Yukai
    Wen, Wushao
    Lin, Liang
    Feng, Ruicheng
    Wu, Shixiang
    Dong, Chao
    Qiao, Yu
    Vasu, Subeesh
    Madam, Nimisha Thekke
    Kandula, Praveen
    Rajagopalan, A. N.
    Liu, Jie
    Jung, Cheolkon
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 315 - 333
  • [6] SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion
    Jian, Lihua
    Yang, Xiaomin
    Liu, Zheng
    Jeon, Gwanggil
    Gao, Mingliang
    Chisholm, David
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [7] Thermal wave image deblurring based on depth residual network
    Jiang, Haijun
    Chen, Fei
    Liu, Xining
    Chen, Jesse
    Zhang, Kai
    Li Chen
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2021, 117
  • [8] Lightweight Dual-Stream Residual Network for Single Image Super-Resolution
    Jiang Y.
    Liu Y.
    Zhan W.
    Zhu D.
    [J]. IEEE Access, 2021, 9 : 129890 - 129901
  • [9] Multi-stream Architecture and Multi-scale Convolutional Neural Network for Remote Sensing Image Fusion
    Lei Dajiang
    Du Jiahao
    Zhang Liping
    Li Weisheng
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (01) : 237 - 244
  • [10] DenseFuse: A Fusion Approach to Infrared and Visible Images
    Li, Hui
    Wu, Xiao-Jun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2614 - 2623