Image super-resolution reconstruction based on sparse representation and deep learning

被引:27
|
作者
Zhang, Jing [1 ]
Shao, Minhao [1 ]
Yu, Lulu [1 ]
Li, Yunsong [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse representation; Deep learning; Super-resolution; Feature fusion;
D O I
10.1016/j.image.2020.115925
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Super-resolution reconstruction technology has important scientific significance and application value in the field of image processing by performing image restoration processing on one or more low-resolution images to improve image spatial resolution. Based on the SCSR algorithm and VDSR network, in order to further improve the image reconstruction quality, an image super-resolution reconstruction algorithm combined with multi-residual network and multi-feature SCSR(MRMFSCSR) is proposed. Firstly, at the sparse reconstruction stage, according to the characteristics of image blocks, our algorithm extracts the contour features of non-flat blocks by NSCT transform, extracts the texture features of flat blocks by Gabor transform, then obtains the reconstructed high-resolution (HR) images by using sparse models. Secondly, according to improve the VDSR deep network and introduce the feature fusion idea, the multi-residual network structure (MR) is designed. The reconstructed HR image obtained by the sparse reconstruction stage is used as the input of the MR network structure to optimize the high-frequency detail residual information. Finally, we can obtain a higher quality super-resolution image compared with the SCSR algorithm and the VDSR algorithm.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Image Super-resolution Reconstruction based on Deep Learning and Sparse Representation
    Lei, Qian
    Zhang, Zhao-hui
    Hao, Cun-ming
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS AND COMMUNICATION TECHNOLOGY (CNCT 2016), 2016, 54 : 546 - 555
  • [2] Super-resolution CT Image Reconstruction Based on Dictionary Learning and Sparse Representation
    Changhui Jiang
    Qiyang Zhang
    Rui Fan
    Zhanli Hu
    [J]. Scientific Reports, 8
  • [3] Super-resolution CT Image Reconstruction Based on Dictionary Learning and Sparse Representation
    Jiang, Changhui
    Zhang, Qiyang
    Fan, Rui
    Hu, Zhanli
    [J]. SCIENTIFIC REPORTS, 2018, 8
  • [4] Research on Image Super-resolution Reconstruction based on Sparse Representation
    Jia Tong
    Meng HaiXiu
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2015, : 317 - 320
  • [5] Image super-resolution reconstruction based on adaptive sparse representation
    Xu, Mengxi
    Yang, Yun
    Sun, Quansen
    Wu, Xiaobin
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (24):
  • [6] Color Image Super-Resolution Reconstruction Based on Sparse Representation
    Shen, Minfen
    Zhang, Longshan
    Fu, Huaizheng
    [J]. ADVANCES IN MECHATRONICS AND CONTROL ENGINEERING, PTS 1-3, 2013, 278-280 : 1221 - +
  • [7] Super-resolution PET image reconstruction with sparse representation
    Hu, Zhanli
    Li, Tao
    Yang, Yongfeng
    Liu, Xin
    Zheng, Hairong
    Liang, Dong
    [J]. 2017 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2017,
  • [8] Image super-resolution reconstruction based on sparse representation and residual compensation
    史郡
    王晓华
    [J]. Journal of Beijing Institute of Technology, 2013, 22 (03) : 394 - 399
  • [9] Modified sparse representation based image super-resolution reconstruction method
    Shang, Li
    Liu, Shu-fen
    Zhou, Yan
    Sun, Zhan-li
    [J]. NEUROCOMPUTING, 2017, 228 : 37 - 52
  • [10] A Novel MRI Image Super-Resolution Reconstruction Algorithm based on Image Representation and Sparse Dictionary Learning
    Zhang, Wenyuan
    [J]. 2016 INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT), VOL 3, 2015, : 265 - 269