Gradient information distillation network for real-time single-image super-resolution

被引:1
|
作者
Bin Meng
Lining Wang
Zheng He
Gwanggil Jeon
Qingyu Dou
Xiaomin Yang
机构
[1] Sichuan University,College of Electronics and Information Engineering
[2] Sichuan University,School of Aeronautics & Astronautics
[3] Incheon National University,Department of Embedded Systems Engineering
[4] Sichuan University,The Center of Gerontology and Geriatrics, West China Hospital
来源
关键词
Gradient information distillation; Super-resolution; Real-time; Deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, deep convolutional neural networks have played an increasingly important role in single-image super-resolution (SR). However, with the increase of the depth and width of networks, the super-resolution methods based on convolution neural networks are facing training difficulties, memory consumption, running slowness and other problems. Furthermore, most of the methods do not make full use of the image gradient information which leads to the loss of geometric structure information of the image. To solve these problems, we propose a gradient information distillation network in this paper. On the one hand, the advantages of fast and lightweight are maintained through information distillation. On the other hand, the SR performance is improved by gradient information. Our network has two branches named gradient information distillation branch (GIDB) and image information distillation branch. To combine features in both branches, we also introduce a residual feature transfer mechanism (RFT). Under the function of GIDB and RFT, our network can retain the rich geometric structure information which can make the edge details of the reconstructed image sharper. The experimental results show that our method is superior to the existing methods while well limits the parameters, computation and running time of the model. It provides the possibility for real-time image processing and mobile applications.
引用
收藏
页码:333 / 344
页数:11
相关论文
共 50 条
  • [1] Gradient information distillation network for real-time single-image super-resolution
    Meng, Bin
    Wang, Lining
    He, Zheng
    Jeon, Gwanggil
    Dou, Qingyu
    Yang, Xiaomin
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (02) : 333 - 344
  • [2] Residual Dense Information Distillation Network for Single Image Super-Resolution
    Chen, Qiaosong
    Li, Jinxin
    Duan, Bolin
    Pu, Liu
    Deng, Xin
    Wang, Jin
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 500 - 505
  • [3] Single Image Super-Resolution via Laplacian Information Distillation Network
    Cheng, Mengcheng
    Shu, Zhan
    Hu, Jiapeng
    Zhang, Ying
    Su, Zhuo
    2018 7TH INTERNATIONAL CONFERENCE ON DIGITAL HOME (ICDH 2018), 2018, : 24 - 30
  • [4] Multilevel and Multiscale Network for Single-Image Super-Resolution
    Yang, Yong
    Zhang, Dongyang
    Huang, Shuying
    Wu, Jiajun
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (12) : 1877 - 1881
  • [5] Rectified Binary Network for Single-Image Super-Resolution
    Xin, Jingwei
    Wang, Nannan
    Jiang, Xinrui
    Li, Jie
    Wang, Xiaoyu
    Gao, Xinbo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [6] Modeling Deformable Gradient Compositions for Single-Image Super-resolution
    Zhu, Yu
    Zhang, Yanning
    Bonev, Boyan
    Yuille, Alan L.
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 5417 - 5425
  • [7] Single-Image Super-Resolution: A Survey
    Yao, Tingting
    Luo, Yu
    Chen, Yantong
    Yang, Dongqiao
    Zhao, Lei
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING, 2020, 516 : 119 - 125
  • [8] Single-Image Super-Resolution: A Benchmark
    Yang, Chih-Yuan
    Ma, Chao
    Yang, Ming-Hsuan
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 372 - 386
  • [9] Fast and Accurate Single Image Super-Resolution via Information Distillation Network
    Hui, Zheng
    Wang, Xiumei
    Gao, Xinbo
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 723 - 731
  • [10] Single-image super-resolution with multilevel residual attention network
    Qin, Ding
    Gu, Xiaodong
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (19): : 15615 - 15628