Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition

被引:21
|
作者
Ren, Long [1 ,2 ,3 ]
Pan, Zhibin [2 ]
Cao, Jianzhong [1 ]
Zhang, Hui [1 ,3 ]
Wang, Hao [1 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China
[2] Xi An Jiao Tong Univ, Fac Elect & Commun, Xian 710049, Peoples R China
[3] Univ Chinese Acad Sci, 19 A Yuquan Rd, Beijing 100049, Peoples R China
来源
SIGNAL PROCESSING | 2021年 / 186卷
基金
中国科学院西部之光基金;
关键词
Image fusion; Edge-preserving guided filter; Feature decomposition; ADMM image optimization; MULTISCALE-DECOMPOSITION; PERFORMANCE; TRANSFORM; ALGORITHM; SCHEMES;
D O I
10.1016/j.sigpro.2021.108108
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared (IR) images can distinguish salient targets from their backgrounds based on the radiation difference in all-weather conditions. By contrast, visible (VIS) images can contain high-resolution texture and details information, which is more suitable for human observation. Therefore, it is quite necessary to combine both imaging advantages of these two kinds of images. Compared with the existing methods, we believe that scale decomposition based methods are the most active and efficient image fusion methods, which also have the best fusion effects. Inspired by the present scale decomposition methods, we propose a new feature decomposition method. Firstly, we propose an improved guided filter called edgepreserving guided filter (EPGF), which adopts the image gradient map for further improving the filtering effect. Subsequently, by using the EPGF, we decompose the IR and VIS images into three kinds of layers, including salient feature layers, luminance layers and detail layers. At the same time, we combine all the layers together to get an initial fusion result. Finally, we optimize the initial fusion image according to a new image fusion optimization model and ADMM, and the final fusion result will be obtained after several iterations. Compared with other scale decomposition methods, our proposed feature decomposition based method takes the IR salient targets, IR and VIS background illumination, as well as VIS details into consideration which is more in line with human visual observation, besides the computational efficiency is also superior. Experimental results indicate that this method has better subjective and objective evaluation results compared with other state-of-the-art methods. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Infrared and visible image fusion with the use of multi-scale edge-preserving decomposition and guided image filter
    Gan, Wei
    Wu, Xiaohong
    Wu, Wei
    Yang, Xiaomin
    Ren, Chao
    He, Xiaohai
    Liu, Kai
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2015, 72 : 37 - 51
  • [2] Infrared and visible image fusion based on contrast enhancement guided filter and infrared feature decomposition
    Zhang, Bozhi
    Gao, Meijing
    Chen, Pan
    Shang, Yucheng
    Li, Shiyu
    Bai, Yang
    Liao, Hongping
    Liu, Zehao
    Li, Zhilong
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2022, 127
  • [3] Infrared and Visible Image Fusion Based on Contrast Enhancement and Multi-scale Edge-preserving Decomposition
    Zhu Haoran
    Liu Yunqing
    Zhang Wenying
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (06) : 1294 - 1300
  • [4] Infrared and visible image fusion based on edge-preserving and attention generative adversarial network
    Zhu Wen-Qing
    Tang Xin-Yi
    Zhang Rui
    Chen Xiao
    Miao Zhuang
    [J]. JOURNAL OF INFRARED AND MILLIMETER WAVES, 2021, 40 (05) : 696 - 708
  • [5] Infrared and visible image fusion via saliency analysis and local edge-preserving multi-scale decomposition
    Zhang, Xiaoye
    Ma, Yong
    Fan, Fan
    Zhang, Ying
    Huang, Jun
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2017, 34 (08) : 1400 - 1410
  • [6] Infrared and visible image fusion using multi-scale edge-preserving decomposition and multiple saliency features
    Duan, Chaowei
    Wang, Zhisheng
    Xing, Changda
    Lu, Shanshan
    [J]. OPTIK, 2021, 228
  • [7] Fusion of Infrared and Visible Images based on Multi-scale Edge-preserving Decomposition and Sparse Representation
    Rong, Chuanzhen
    Jia, Yongxing
    Yang, Yu
    Zhu, Ying
    Wang, Yuan
    [J]. 2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [8] Infrared and visible image fusion based on QNSCT and Guided Filter
    Yang, Chenxuan
    He, Yunan
    Sun, Ce
    Jiang, Sheng
    Li, Ye
    Zhao, Peng
    [J]. OPTIK, 2022, 253
  • [9] Classification of visible and infrared hyperspectral images based on image segmentation and edge-preserving filtering
    Cui, Binge
    Ma, Xiudan
    Xie, Xiaoyun
    Ren, Guangbo
    Ma, Yi
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2017, 81 : 79 - 88
  • [10] Infrared and Visible Image Fusion Based on Innovation Feature Simultaneous Decomposition
    He, Guiqing
    Dong, Dandan
    Xing, Siyuan
    Zhao, Ximei
    [J]. 2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1174 - 1177