Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:16
|
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Pixel Level jointed Sparse Representation with RPCA Image Fusion Algorithm
    Ibrahim, Rasha
    Alirczaic, Javad
    Babyn, Paul
    2015 38TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2015, : 592 - 595
  • [42] Medical image fusion based on sparse representation of classified image patches
    Zong, Jing-Jing
    Qiu, Tian-Shuang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2017, 34 : 195 - 205
  • [43] Image Denoising by Deep Convolution Based on Sparse Representation
    Bian, Shengqin
    He, Xinyu
    Xu, Zhengguang
    Zhang, Lixin
    COMPUTERS, 2023, 12 (06)
  • [44] Change detection based on unsupervised sparse representation for fundus image pair
    Yinghua Fu
    Xing Zhao
    Yong Liang
    Tiejun Zhao
    Chaoli Wang
    Dawei Zhang
    Scientific Reports, 12
  • [45] Change detection based on unsupervised sparse representation for fundus image pair
    Fu, Yinghua
    Zhao, Xing
    Liang, Yong
    Zhao, Tiejun
    Wang, Chaoli
    Zhang, Dawei
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [46] An improved image sparse representation algorithm based on column sparse averaging
    School of Information Engineering, Wuhan University of Technology, Wuhan, China
    不详
    不详
    J. Comput. Inf. Syst., 8 (2937-2944):
  • [47] Image fusion algorithm for traffic accident rescue based on deep learning
    Jiang S.
    Wang P.-L.
    Deng Z.-J.
    Bie Y.-M.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (12): : 3472 - 3480
  • [48] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    WANG Jian
    QIN Chunxia
    ZHANG Xiufei
    YANG Ke
    REN Ping
    Journal of Systems Engineering and Electronics, 2020, 31 (03) : 447 - 459
  • [49] A multi-source image fusion algorithm based on gradient regularized convolution sparse representation
    Wang Jian
    Qin Chunxia
    Zhang Xiufei
    Yang Ke
    Ren Ping
    JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2020, 31 (03) : 447 - 459
  • [50] Improved Fusion Algorithm for Infrared and Visible Images Based on Image Enhancement and Convolutional Sparse Representation
    Zhu, Rong
    Zheng, Wan-bo
    Wang, Yao
    Tan, Chun-lin
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2025, 45 (02) : 558 - 568