Blurry Video Frame Interpolation

被引:56
|
作者
Shen, Wang [1 ]
Bao, Wenbo [1 ]
Zhai, Guangtao [1 ]
Chen, Li [1 ]
Min, Xiongkuo [1 ]
Gao, Zhiyong [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR42600.2020.00516
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing high-frame-rate clear results from low-frame-rate blurry inputs. In this paper, we propose a blurry video frame interpolation method to reduce motion blur and up-convert frame rate simultaneously. Specifically, we develop a pyramid module to cyclically synthesize clear intermediate frames. The pyramid module features adjustable spatial receptive field and temporal scope, thus contributing to controllable computational complexity and restoration ability. Besides, we propose an inter-pyramid recurrent module to connect sequential models to exploit the temporal relationship. The pyramid module integrates a recurrent module, thus can iteratively synthesize temporally smooth results without significantly increasing the model size. Extensive experimental results demonstrate that our method performs favorably against state-of-the-art methods. The source code and pre-trained model are available at https://github.com/1aomao0/BIN.
引用
收藏
页码:5113 / 5122
页数:10
相关论文
共 50 条
  • [31] LAP-BASED VIDEO FRAME INTERPOLATION
    Jayashankar, Tejas
    Moulin, Pierre
    Blu, Thierry
    Gilliam, Chris
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4195 - 4199
  • [32] MOTION FEEDBACK DESIGN FOR VIDEO FRAME INTERPOLATION
    Hu, Mengshun
    Liao, Liang
    Xiao, Jing
    Gu, Lin
    Satoh, Shin'ichi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4347 - 4351
  • [33] A Motion Distillation Framework for Video Frame Interpolation
    Zhou, Shili
    Tan, Weimin
    Yan, Bo
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3728 - 3740
  • [34] Video Frame Interpolation without Temporal Priors
    Zhang, Youjian
    Wang, Chaoyue
    Tao, Dacheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [35] Hybrid Warping Fusion for Video Frame Interpolation
    Yu Li
    Ye Zhu
    Ruoteng Li
    Xintao Wang
    Yue Luo
    Ying Shan
    [J]. International Journal of Computer Vision, 2022, 130 : 2980 - 2993
  • [36] VIDEO FRAME INTERPOLATION VIA RESIDUE REFINEMENT
    Li, Haopeng
    Yuan, Yuan
    Wang, Qi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2613 - 2617
  • [37] Texture-aware Video Frame Interpolation
    Danier, Duolikun
    Bull, David
    [J]. 2021 PICTURE CODING SYMPOSIUM (PCS), 2021, : 226 - 230
  • [38] Self-Reproducing Video Frame Interpolation
    Deng, Jiajun
    Yu, Haichao
    Wang, Zhangyang
    Wang, Xinchao
    Huang, Thomas
    [J]. 2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 193 - 198
  • [39] Variational approach for capsule video frame interpolation
    Mohammed, Ahmed
    Farup, Ivar
    Yildirim, Sule
    Pedersen, Marius
    Hovde, Oistein
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2018,
  • [40] A comprehensive survey on video frame interpolation techniques
    Anil Singh Parihar
    Disha Varshney
    Kshitija Pandya
    Ashray Aggarwal
    [J]. The Visual Computer, 2022, 38 : 295 - 319