Intelligent Fusion of Infrared and Visible Image Data Based on Convolutional Sparse Representation and Improved Pulse-Coupled Neural Network

被引:4
|
作者
Xia, Jingming [1 ]
Lu, Yi [1 ]
Tan, Ling [2 ]
Jiang, Ping [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[3] Western Univ, London, ON N6A 3K7, Canada
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2021年 / 67卷 / 01期
基金
中国国家自然科学基金;
关键词
Image fusion; infrared image; visible light image; non-downsampling shear wave transform; improved PCNN; convolutional sparse representation;
D O I
10.32604/cmc.2021.013457
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-source information can be obtained through the fusion of infrared images and visible light images, which have the characteristics of complementary information. However, the existing acquisition methods of fusion images have disadvantages such as blurred edges, low contrast, and loss of details. Based on convolution sparse representation and improved pulse-coupled neural network this paper proposes an image fusion algorithm that decompose the source images into high-frequency and low-frequency subbands by non-subsampled Shearlet Transform (NSST). Furthermore, the low-frequency subbands were fused by convolutional sparse representation (CSR), and the high-frequency subbands were fused by an improved pulse coupled neural network (IPCNN) algorithm, which can effectively solve the problem of difficulty in setting parameters of the traditional PCNN algorithm, improving the performance of sparse representation with details injection. The result reveals that the proposed method in this paper has more advantages than the existing mainstream fusion algorithms in terms of visual effects and objective indicators.
引用
收藏
页码:613 / 624
页数:12
相关论文
共 50 条
  • [21] An infrared and visible image fusion method based on fuzzy pulse coupled neural network and salience detection
    Xu, Jing
    Liu, Jing
    Li, Kangxin
    DYNA, 2022, 97 (05): : 535 - 542
  • [22] An improved approach for medical image fusion using sparse representation and Siamese convolutional neural network
    Yousif, Ahmed Sabeeh
    Omar, Zaid
    Sheikh, Usman Ullah
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 72
  • [23] An Overview of Image Segmentation Based on Pulse-Coupled Neural Network
    Jing Lian
    Zhen Yang
    Jizhao Liu
    Wenhao Sun
    Li Zheng
    Xiaogang Du
    Zetong Yi
    Bin Shi
    Yide Ma
    Archives of Computational Methods in Engineering, 2021, 28 : 387 - 403
  • [24] An Overview of Image Segmentation Based on Pulse-Coupled Neural Network
    Lian, Jing
    Yang, Zhen
    Liu, Jizhao
    Sun, Wenhao
    Zheng, Li
    Du, Xiaogang
    Yi, Zetong
    Shi, Bin
    Ma, Yide
    ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2021, 28 (02) : 387 - 403
  • [25] Image Fusion Using Self-constraint Pulse-coupled Neural Network
    Jiao, Zhuqing
    Xiong, Weili
    Xu, Baoguo
    LIFE SYSTEM MODELING AND INTELLIGENT COMPUTING, 2010, 6330 : 626 - 634
  • [26] Shearlet Based Medical Image Fusion Using Pulse-Coupled Neural Network with Fuzzy Memberships
    Mishra, Niladri Shekhar
    Das, Sudeb
    Chakrabarti, Amlan
    COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING, ICVGIP 2016, 2017, 10481 : 337 - 344
  • [27] Fusion of visible and infrared image via compressive sensing using convolutional sparse representation
    Nirmalraj, S.
    Nagarajan, G.
    ICT EXPRESS, 2021, 7 (03): : 350 - 354
  • [28] Infrared and visible image fusion via rolling guidance filter and convolutional sparse representation
    Liu, Feiqiang
    Chen, Lihui
    Lu, Lu
    Jeon, Gwanggil
    Yang, Xiaomin
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (06) : 10603 - 10616
  • [29] Insulator Image Segmentation Based on Improved Unit-Linking Pulse-Coupled Neural Network
    Du Xiaoyan
    Zhong Jun
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (15)
  • [30] Infrared and visible image fusion based on multi-channel convolutional neural network
    Wang, Hongmei
    An, Wenbo
    Li, Lin
    Li, Chenkai
    Zhou, Daming
    IET IMAGE PROCESSING, 2022, 16 (06) : 1575 - 1584