Recent advances via convolutional sparse representation model for pixel-level image fusion

被引:0
|
作者
Yue Pan
Tianye Lan
Chongyang Xu
Chengfang Zhang
Ziliang Feng
机构
[1] Sichuan University,College of Computer Science
[2] Sichuan Police College,Intelligent Policing Key Laboratory of Sichuan Province
来源
关键词
Image fusion; Convolutional sparse representation; Convolutional dictionary learning; Online convolutional sparse coding; Online convolutional dictionary learning;
D O I
暂无
中图分类号
学科分类号
摘要
Image fusion aims to integrate complementary information from different source images into the final output image. This plays a significant role in high-level vision tasks. However, image fusion methods based on sparse representation (SR) or conventional multiscale transform (MST) have some drawbacks that are difficult to overcome. As an alternative form of SR, convolutional sparse representation (CSR) has the advantages of detail preservation and shift-invariance, which can overcome the shortcomings of SR- and MST-based fusion methods. Since CSR has been widely used in the field of image fusion and has advanced this field to a great extent, it is necessary to conduct a comprehensive investigation of image fusion based on CSR. To the best of our knowledge, there are no previous papers reviewing and evaluating CSR-based fusion methods, and this study is the first retrospective. In this paper, we focus on CSR-based image fusion methods and review the recent advances in pixel-level image fusion based on CSR. In the experimental part of the paper, multifocal images, infrared-visible images, and multimodal medical images are used as test images to compare and evaluate the performance of different image fusion methods. In addition, the future trend of CSR-based image fusion is discussed. This paper is expected to serve as a resource of reference for both researchers and general learners seeking an overview of CSR-based image fusion.
引用
收藏
页码:52899 / 52930
页数:31
相关论文
共 50 条
  • [1] Recent advances via convolutional sparse representation model for pixel-level image fusion
    Pan, Yue
    Lan, Tianye
    Xu, Chongyang
    Zhang, Chengfang
    Feng, Ziliang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 52899 - 52930
  • [2] Multimodel fusion method via sparse representation at pixel-level and feature-level
    Zhang, Shuai
    Liu, Bingqi
    Huang, Fuyu
    [J]. OPTICAL ENGINEERING, 2019, 58 (06)
  • [3] Deep learning for pixel-level image fusion: Recent advances and future prospects
    Liu, Yu
    Chen, Xun
    Wang, Zengfu
    Wang, Z. Jane
    Ward, Rabab K.
    Wang, Xuesong
    [J]. INFORMATION FUSION, 2018, 42 : 158 - 173
  • [4] Review of Pixel-Level Image Fusion
    杨波
    敬忠良
    赵海涛
    [J]. Journal of Shanghai Jiaotong University(Science), 2010, 15 (01) : 6 - 12
  • [5] Review of pixel-level image fusion
    Yang B.
    Jing Z.-L.
    Zhao H.-T.
    [J]. Journal of Shanghai Jiaotong University (Science), 2010, 15 (1) : 6 - 12
  • [6] Pixel-level image fusion: The case of image sequences
    Rockinger, O
    Fechner, T
    [J]. SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION VII, 1998, 3374 : 378 - 388
  • [7] Optimising multiresolution pixel-level image fusion
    Petrovic, V
    Xydeas, C
    [J]. SENSOR FUSION: ARCHITECTURES, ALGORITHMS AND APPLICATIONS V, 2001, 4385 : 96 - 107
  • [8] Recent Advances in Sparse Representation Based Medical Image Fusion
    Liu, Yu
    Chen, Xun
    Liu, Aiping
    Ward, Rabab K.
    Wang, Z. Jane
    [J]. IEEE INSTRUMENTATION & MEASUREMENT MAGAZINE, 2021, 24 (02) : 45 - 53
  • [9] A multiscale approach to pixel-level image fusion
    Ben Hamza, A
    He, Y
    Krim, H
    Willsky, A
    [J]. INTEGRATED COMPUTER-AIDED ENGINEERING, 2005, 12 (02) : 135 - 146
  • [10] Review on Technology of Pixel-level Image Fusion
    Li, Mingjing
    Dong, Yubing
    [J]. PROCEEDINGS OF 2013 2ND INTERNATIONAL CONFERENCE ON MEASUREMENT, INFORMATION AND CONTROL (ICMIC 2013), VOLS 1 & 2, 2013, : 341 - 344