Blurry Video Frame Interpolation

被引:65
|
作者
Shen, Wang [1 ]
Bao, Wenbo [1 ]
Zhai, Guangtao [1 ]
Chen, Li [1 ]
Min, Xiongkuo [1 ]
Gao, Zhiyong [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2020年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR42600.2020.00516
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing high-frame-rate clear results from low-frame-rate blurry inputs. In this paper, we propose a blurry video frame interpolation method to reduce motion blur and up-convert frame rate simultaneously. Specifically, we develop a pyramid module to cyclically synthesize clear intermediate frames. The pyramid module features adjustable spatial receptive field and temporal scope, thus contributing to controllable computational complexity and restoration ability. Besides, we propose an inter-pyramid recurrent module to connect sequential models to exploit the temporal relationship. The pyramid module integrates a recurrent module, thus can iteratively synthesize temporally smooth results without significantly increasing the model size. Extensive experimental results demonstrate that our method performs favorably against state-of-the-art methods. The source code and pre-trained model are available at https://github.com/1aomao0/BIN.
引用
收藏
页码:5113 / 5122
页数:10
相关论文
共 50 条
  • [31] Hybrid Warping Fusion for Video Frame Interpolation
    Yu Li
    Ye Zhu
    Ruoteng Li
    Xintao Wang
    Yue Luo
    Ying Shan
    International Journal of Computer Vision, 2022, 130 : 2980 - 2993
  • [32] Video Frame Interpolation without Temporal Priors
    Zhang, Youjian
    Wang, Chaoyue
    Tao, Dacheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [33] A Motion Distillation Framework for Video Frame Interpolation
    Zhou, Shili
    Tan, Weimin
    Yan, Bo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3728 - 3740
  • [34] Luminance Compensation MEMC for Video Frame Interpolation
    Xu, Zixuan
    Ying, Wenjing
    He, Hao
    Zhu, Qingmeng
    Liang, Jian
    Wang, Haihui
    IEEE ACCESS, 2022, 10 : 120752 - 120764
  • [35] A Perceptual Quality Metric for Video Frame Interpolation
    Hou, Qiqi
    Ghildyal, Abhijay
    Liu, Feng
    COMPUTER VISION - ECCV 2022, PT XV, 2022, 13675 : 234 - 253
  • [36] LAP-BASED VIDEO FRAME INTERPOLATION
    Jayashankar, Tejas
    Moulin, Pierre
    Blu, Thierry
    Gilliam, Chris
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4195 - 4199
  • [37] Variational approach for capsule video frame interpolation
    Ahmed Mohammed
    Ivar Farup
    Sule Yildirim
    Marius Pedersen
    Øistein Hovde
    EURASIP Journal on Image and Video Processing, 2018
  • [38] MOTION FEEDBACK DESIGN FOR VIDEO FRAME INTERPOLATION
    Hu, Mengshun
    Liao, Liang
    Xiao, Jing
    Gu, Lin
    Satoh, Shin'ichi
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4347 - 4351
  • [39] VIDEO FRAME INTERPOLATION VIA RESIDUE REFINEMENT
    Li, Haopeng
    Yuan, Yuan
    Wang, Qi
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2613 - 2617
  • [40] Texture-aware Video Frame Interpolation
    Danier, Duolikun
    Bull, David
    2021 PICTURE CODING SYMPOSIUM (PCS), 2021, : 226 - 230