Video Super-Resolution via Residual Learning

被引:25
|
作者
Wang, Wenjun [1 ]
Ren, Chao [1 ]
He, Xiaohai [1 ]
Chen, Honggang [1 ]
Qing, Linbo [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Sichuan, Peoples R China
来源
IEEE ACCESS | 2018年 / 6卷
基金
中国国家自然科学基金;
关键词
Video super-resolution; convolutional neural network; implicit motion compensation; residual block; skip-connection; SINGLE IMAGE SUPERRESOLUTION; MOTION COMPENSATION; INTERPOLATION;
D O I
10.1109/ACCESS.2018.2829908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Convolutional neural networks have been widely applied in many low level vision tasks. In this paper, we propose a video super-resolution (SR) method named enhanced video SR network with residual blocks (EVSR). The proposed EVSR fully exploits spatio-temporal information and can implicitly capture motion relations between consecutive frames. Therefore, unlike conventional methods to video SR, EVSR does not require an explicit motion compensation process. In addition, residual learning framework exhibits excellence in convergence rate and performance improvement. Based on this, residual blocks and long skip-connection with dimension adjustment layer are proposed to predict high-frequency details. Extensive experiments validate the superiority of our approach over state-of-the-art algorithms.
引用
收藏
页码:23767 / 23777
页数:11
相关论文
共 50 条
  • [1] Multiframe Video Satellite Image Super-Resolution via Attention-Based Residual Learning
    He, Zhi
    Li, Jun
    Liu, Lin
    He, Dan
    Xiao, Man
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] VIDEO SATELLITE IMAGERY SUPER-RESOLUTION VIA A DEEP RESIDUAL NETWORK
    Wu, Jiemin
    He, Zhi
    Zhuo, Li
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2762 - 2765
  • [3] Efficient Video Super-Resolution via Hierarchical Temporal Residual Networks
    Liu, Zhi-Song
    Siu, Wan-Chi
    Chan, Yui-Lam
    IEEE ACCESS, 2021, 9 : 106049 - 106064
  • [4] Learning Via Decision Trees Approach for Video Super-Resolution
    Zhang, Yu-Zhu
    Siu, Wan-Chi
    Liu, Zhi-Song
    Law, Ngai-Fong
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2017, : 558 - 562
  • [5] Video Super-Resolution Using a Grouped Residual in Residual Network
    Ashoori, MohammadHossein
    Amini, Arash
    arXiv, 2023,
  • [6] A Framework for Super-Resolution of Scalable Video via Sparse Reconstruction of Residual Frames
    Moghaddam, Mohammad Hossein
    Azizipour, Mohammad Javad
    Vahidian, Saeed
    Smida, Besma
    MILCOM 2017 - 2017 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2017, : 164 - 168
  • [7] Video Super-Resolution via Deep Draft-Ensemble Learning
    Liao, Renjie
    Tao, Xin
    Li, Ruiyu
    Ma, Ziyang
    Jia, Jiaya
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 531 - 539
  • [8] FAST VIDEO SUPER-RESOLUTION VIA CLASSIFICATION
    Simonyan, K.
    Grishin, S.
    Vatolin, D.
    Popov, D.
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 349 - 352
  • [9] A Survey of Deep Learning Video Super-Resolution
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 2655 - 2676
  • [10] DENSE-CONNECTED RESIDUAL NETWORK FOR VIDEO SUPER-RESOLUTION
    Du, Xiaoting
    Zhou, Yuan
    Chen, Yanfang
    Zhang, Yeda
    Yang, Jianxing
    Jin, Dou
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 592 - 597