Video Super-Resolution via Residual Learning

被引:25
|
作者
Wang, Wenjun [1 ]
Ren, Chao [1 ]
He, Xiaohai [1 ]
Chen, Honggang [1 ]
Qing, Linbo [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Sichuan, Peoples R China
来源
IEEE ACCESS | 2018年 / 6卷
基金
中国国家自然科学基金;
关键词
Video super-resolution; convolutional neural network; implicit motion compensation; residual block; skip-connection; SINGLE IMAGE SUPERRESOLUTION; MOTION COMPENSATION; INTERPOLATION;
D O I
10.1109/ACCESS.2018.2829908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Convolutional neural networks have been widely applied in many low level vision tasks. In this paper, we propose a video super-resolution (SR) method named enhanced video SR network with residual blocks (EVSR). The proposed EVSR fully exploits spatio-temporal information and can implicitly capture motion relations between consecutive frames. Therefore, unlike conventional methods to video SR, EVSR does not require an explicit motion compensation process. In addition, residual learning framework exhibits excellence in convergence rate and performance improvement. Based on this, residual blocks and long skip-connection with dimension adjustment layer are proposed to predict high-frequency details. Extensive experiments validate the superiority of our approach over state-of-the-art algorithms.
引用
收藏
页码:23767 / 23777
页数:11
相关论文
共 50 条
  • [41] Hyperspectral Image Super-Resolution via Deep Progressive Zero-Centric Residual Learning
    Zhu, Zhiyu
    Hou, Junhui
    Chen, Jie
    Zeng, Huanqiang
    Zhou, Jiantao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1423 - 1438
  • [42] Learning Trajectory-Aware Transformer for Video Super-Resolution
    Liu, Chengxu
    Yang, Huan
    Fu, Jianlong
    Qian, Xueming
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5677 - 5686
  • [43] Learning a Deep Dual Attention Network for Video Super-Resolution
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4474 - 4488
  • [44] Computing Residual Diffusivity by Adaptive Basis Learning via Super-Resolution Deep Neural Networks
    Lyu, Jiancheng
    Xin, Jack
    Yu, Yifeng
    ADVANCED COMPUTATIONAL METHODS FOR KNOWLEDGE ENGINEERING (ICCSAMA 2019), 2020, 1121 : 279 - 290
  • [45] Multimedia super-resolution via deep learning: A survey
    Hayat, Khizar
    DIGITAL SIGNAL PROCESSING, 2018, 81 : 198 - 217
  • [46] Lightweight Video Super-Resolution for Compressed Video
    Kwon, Ilhwan
    Li, Jun
    Prasad, Mukesh
    ELECTRONICS, 2023, 12 (03)
  • [47] Deep Learning Based Video Super-Resolution and its Application in Video Conferences
    Lin, Yinyan
    Zou, Chaoyang
    Feng, Ying
    Liang, Mingwei
    2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 288 - 293
  • [48] VIDEO SUPER-RESOLUTION FOR MIXED RESOLUTION STEREO
    Jain, Ankit K.
    Nguyen, Truong Q.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 962 - 966
  • [49] Adapting Image Super-Resolution State-of-the-arts and Learning Multi-model Ensemble for Video Super-Resolution
    Li, Chao
    He, Dongliang
    Liu, Xiao
    Ding, Yukang
    Wen, Shilei
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2033 - 2040
  • [50] Densely Residual Laplacian Super-Resolution
    Anwar, Saeed
    Barnes, Nick
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1192 - 1204