Image fusion algorithm based on unsupervised deep learning-optimized sparse representation

被引:16
|
作者
An, Feng-Ping [1 ,2 ]
Ma, Xing-min [3 ]
Bai, Lei [4 ]
机构
[1] Huaiyin Normal Univ, Sch Phys & Elect Elect Engn, Huaian 223300, JS, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, BJ, Peoples R China
[3] China Elect Technol Grp Corp, 15th Res Inst, Beijing 100083, BJ, Peoples R China
[4] North China Inst Sci & Technol, Sch Comp, Beijing 100081, BJ, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Image fusion; Unsupervised; Deep learning; Optimized sparse representation; Over-complete dictionary learning; CONVOLUTIONAL NEURAL-NETWORK; CNN;
D O I
10.1016/j.bspc.2021.103140
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The image fusion method based on deep learning has problems such as the supervised learning of the model, the edge and noise of the fused image, and the setting of the image fusion weight map. To solve these problems, this paper proposes an end-to-end unsupervised deep learning model that performs one-to-many focus image fusion. It solves the training problem encountered by supervised deep learning models while avoiding the unreasonable image fusion weight maps. In addition, this paper proposes an optimized sparse representation method that divides an image into a target area and a background area. Then, it uses super complete dictionary learning to obtain a sparse representation of the image background area. This approach makes the proposed unsupervised deep learning image fusion method robust to noise. Finally, using this method to carry out image fusion experiments, the results show that the quality evaluation indicators of the fused image obtained by this method substantially outperform those of both mainstream machine learning and deep learning image fusion methods.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Joint loan risk prediction based on deep learning-optimized stacking model
    Wang, Yansong
    Wang, Meng
    Pan, Yong
    Chen, Jian
    ENGINEERING REPORTS, 2024, 6 (04)
  • [22] Image Fusion with Sparse Representation
    Li, Hong
    Zhang, Jinping
    Wu, Fenxia
    Tan, Conge
    ADVANCES IN APPLIED SCIENCE AND INDUSTRIAL TECHNOLOGY, PTS 1 AND 2, 2013, 798-799 : 737 - +
  • [23] Image Defogging Algorithm Based on Sparse Representation
    Fan, Di
    Guo, Xinyun
    Lu, Xiao
    Liu, Xiaoxin
    Sun, Bo
    COMPLEXITY, 2020, 2020 (2020)
  • [24] AN UNSUPERVISED HYPERSPECTRAL IMAGE FUSION METHOD BASED ON SPECTRAL UNMIXING AND DEEP LEARNING
    Zheng, Kexin
    Khader, Abdolraheem
    Xiao, Liang
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 2398 - 2401
  • [25] Image Reconstruction for Magnetic Particle Imaging Based on Sparse Representation and Deep Learning
    Sun, Shijie
    Chen, Yaoyao
    Zhao, Mingyang
    Xu, Lijun
    Zhong, Jing
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 9
  • [26] Image super-resolution reconstruction based on sparse representation and deep learning
    Zhang, Jing
    Shao, Minhao
    Yu, Lulu
    Li, Yunsong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87
  • [27] Image Super-resolution Reconstruction based on Deep Learning and Sparse Representation
    Lei, Qian
    Zhang, Zhao-hui
    Hao, Cun-ming
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS AND COMMUNICATION TECHNOLOGY (CNCT 2016), 2016, 54 : 546 - 555
  • [28] MS and PAN Image Fusion Algorithm Based on PST Phase Constraint and Sparse Representation
    Wang X.
    Bai S.
    Li Z.
    Song R.
    Tao J.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2019, 32 (05): : 398 - 408
  • [29] A Sparse Target Matrix Generation Based Unsupervised Feature Learning Algorithm for Image Classification
    Zhao, Dan
    Guo, Baolong
    Yan, Yunyi
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (06): : 2806 - 2825
  • [30] Medical Image Fusion Based on NSCT and Sparse Representation
    Shen, Chao
    Gao, Wei
    Ma, Caiwen
    Song, Zongxi
    Yin, Fei
    Dan, Lijun
    Wang, Fengtao
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806