Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:16
|
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Unsupervised Infrared Image and Visible Image Fusion Algorithm Based on Deep Learning
    Chen Guoyang
    Wu Xiaojun
    Xu Tianyang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [2] Image classification algorithm based on stacked sparse coding deep learning model-optimized kernel function nonnegative sparse representation
    An, Fengping
    SOFT COMPUTING, 2020, 24 (22) : 16967 - 16981
  • [3] Image classification algorithm based on stacked sparse coding deep learning model-optimized kernel function nonnegative sparse representation
    Fengping An
    Soft Computing, 2020, 24 : 16967 - 16981
  • [4] Optimized Projections for Generalized Joint Sparse Representation based Image Fusion
    Zhang, Qiheng
    Yun, Hongquan
    Ju, Wen
    Xu, Li
    Lu, Zhengkun
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4934 - 4938
  • [5] An image fusion method with sparse representation based on genetic algorithm optimization
    Zhao X.-J.
    Li Y.-Z.
    Lei S.-Y.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2016, 39 (02): : 73 - 76and87
  • [6] SAR and Multispectral Image Fusion Algorithm Based on Sparse Representation and NSST
    Liu, Kaixuan
    Li, Yufeng
    2ND INTERNATIONAL CONFERENCE ON GREEN ENERGY AND SUSTAINABLE DEVELOPMENT (GESD 2019), 2019, 2122
  • [7] Sparse Representation of Robot Image Based on Dictionary Learning Algorithm
    Guo J.-F.
    Li Y.-L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (04): : 820 - 830
  • [8] A feature representation of sketch based on fusion of sparse coding and deep learning
    Zhao P.
    Gao J.-C.
    Feng C.-C.
    Han L.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (03): : 699 - 704
  • [9] Remote Sensing Image Fusion Based on Dictionary Learning and Sparse Representation
    Yin, Fei
    Cao, Shuhua
    Xu, Xiaojie
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [10] Unsupervised learning trajectory anomaly detection algorithm based on deep representation
    Wang, Zhongqiu
    Yuan, Guan
    Pei, Haoran
    Zhang, Yanmei
    Liu, Xiao
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2020, 16 (12):