Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition

被引:21
|
作者
Ren, Long [1 ,2 ,3 ]
Pan, Zhibin [2 ]
Cao, Jianzhong [1 ]
Zhang, Hui [1 ,3 ]
Wang, Hao [1 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China
[2] Xi An Jiao Tong Univ, Fac Elect & Commun, Xian 710049, Peoples R China
[3] Univ Chinese Acad Sci, 19 A Yuquan Rd, Beijing 100049, Peoples R China
来源
SIGNAL PROCESSING | 2021年 / 186卷
基金
中国科学院西部之光基金;
关键词
Image fusion; Edge-preserving guided filter; Feature decomposition; ADMM image optimization; MULTISCALE-DECOMPOSITION; PERFORMANCE; TRANSFORM; ALGORITHM; SCHEMES;
D O I
10.1016/j.sigpro.2021.108108
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared (IR) images can distinguish salient targets from their backgrounds based on the radiation difference in all-weather conditions. By contrast, visible (VIS) images can contain high-resolution texture and details information, which is more suitable for human observation. Therefore, it is quite necessary to combine both imaging advantages of these two kinds of images. Compared with the existing methods, we believe that scale decomposition based methods are the most active and efficient image fusion methods, which also have the best fusion effects. Inspired by the present scale decomposition methods, we propose a new feature decomposition method. Firstly, we propose an improved guided filter called edgepreserving guided filter (EPGF), which adopts the image gradient map for further improving the filtering effect. Subsequently, by using the EPGF, we decompose the IR and VIS images into three kinds of layers, including salient feature layers, luminance layers and detail layers. At the same time, we combine all the layers together to get an initial fusion result. Finally, we optimize the initial fusion image according to a new image fusion optimization model and ADMM, and the final fusion result will be obtained after several iterations. Compared with other scale decomposition methods, our proposed feature decomposition based method takes the IR salient targets, IR and VIS background illumination, as well as VIS details into consideration which is more in line with human visual observation, besides the computational efficiency is also superior. Experimental results indicate that this method has better subjective and objective evaluation results compared with other state-of-the-art methods. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Fusion of multi-resolution visible image and infrared images based on guided filter
    Fan, Zhongpeng
    Yan, Liping
    Xia, Yuanqing
    Fu, Mengyin
    Xiao, Bo
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 4449 - 4454
  • [22] Infrared and Visible Image Fusion in a Multilevel Low-Rank Decomposition Framework Based on Guided Filtering and Feature Extraction
    Fang, Chao
    Feng, Xin
    Gong, Haifeng
    Lou, Xicheng
    [J]. JOURNAL OF SENSORS, 2022, 2022
  • [23] Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition
    Zhao, Jufeng
    Zhou, Qiang
    Chen, Yueting
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2013, 56 : 93 - 99
  • [24] Edge-preserving Image Decomposition based on Saliency Map
    Feng, Ce
    Dai, Shuling
    Zhao, Yongjia
    Liu, Shutian
    [J]. 2014 7TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP 2014), 2014, : 159 - 163
  • [25] Semantic Guided Infrared and Visible Image Fusion
    Wu, Wei
    Zhang, Dazhi
    Hou, Jilei
    Wang, Yu
    Lu, Tao
    Zhou, Huabing
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2021, E104A (12) : 1733 - 1738
  • [26] Infrared and visible image fusion in a rolling guided filtering framework based on deep feature extraction
    Cheng, Wei
    Lin, Bing
    Cheng, Liming
    Cui, Yong
    [J]. WIRELESS NETWORKS, 2024,
  • [27] Infrared-Visible Image Fusion through Feature-Based Decomposition and Domain Normalization
    Chen, Weiyi
    Miao, Lingjuan
    Wang, Yuhao
    Zhou, Zhiqiang
    Qiao, Yajun
    [J]. REMOTE SENSING, 2024, 16 (06)
  • [28] Infrared and visible image fusion for ship targets based on scale-aware feature decomposition
    Zheng, Xin
    Kang, Di
    Si, Pengbo
    Wu, Qiang
    [J]. IET IMAGE PROCESSING, 2022, 16 (14) : 3977 - 3987
  • [29] Infrared and visible image fusion using guided filter and convolutional sparse representation
    结合引导滤波和卷积稀疏表示的红外与可见光图像融合
    [J]. Chen, Zhi-Bin (shangxinboy@163.com), 2018, Chinese Academy of Sciences (26):
  • [30] Infrared image and visible image fusion algorithm based on secondary image decomposition
    Ma, Xin
    Yu, Chunyu
    Tong, Yixin
    Zhang, Jun
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (10): : 1567 - 1581