Blurry Video Frame Interpolation

被引:65
|
作者
Shen, Wang [1 ]
Bao, Wenbo [1 ]
Zhai, Guangtao [1 ]
Chen, Li [1 ]
Min, Xiongkuo [1 ]
Gao, Zhiyong [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2020年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR42600.2020.00516
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing high-frame-rate clear results from low-frame-rate blurry inputs. In this paper, we propose a blurry video frame interpolation method to reduce motion blur and up-convert frame rate simultaneously. Specifically, we develop a pyramid module to cyclically synthesize clear intermediate frames. The pyramid module features adjustable spatial receptive field and temporal scope, thus contributing to controllable computational complexity and restoration ability. Besides, we propose an inter-pyramid recurrent module to connect sequential models to exploit the temporal relationship. The pyramid module integrates a recurrent module, thus can iteratively synthesize temporally smooth results without significantly increasing the model size. Extensive experimental results demonstrate that our method performs favorably against state-of-the-art methods. The source code and pre-trained model are available at https://github.com/1aomao0/BIN.
引用
收藏
页码:5113 / 5122
页数:10
相关论文
共 50 条
  • [21] Revisiting Adaptive Convolutions for Video Frame Interpolation
    Niklaus, Simon
    Mai, Long
    Wang, Oliver
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1098 - 1108
  • [22] Progressive Motion Boosting for Video Frame Interpolation
    Xiao, Jing
    Xu, Kangmin
    Hu, Mengshun
    Liao, Liang
    Wang, Zheng
    Lin, Chia-Wen
    Wang, Mi
    Satoh, Shin'ichi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8076 - 8090
  • [23] Directional Frame Interpolation for MPEG Compressed Video
    Zhao, Chang
    Gao, Xinwei
    Fan, Xiaopeng
    Zhao, Debin
    VISUAL INFORMATION PROCESSING AND COMMUNICATION III, 2012, 8305
  • [24] Motion-Aware Video Frame Interpolation
    Han, Pengfei
    Zhang, Fuhua
    Zhao, Bin
    Li, Xuelong
    NEURAL NETWORKS, 2024, 178
  • [25] Depth-Aware Video Frame Interpolation
    Bao, Wenbo
    Lai, Wei-Sheng
    Ma, Chao
    Zhang, Xiaoyun
    Gao, Zhiyong
    Yang, Ming-Hsuan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3698 - 3707
  • [26] Video Frame Interpolation With Learnable Uncertainty and Decomposition
    Yu, Zhiyang
    Chen, Xijun
    Ren, Shunqing
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2642 - 2646
  • [27] A SUBJECTIVE QUALITY STUDY FOR VIDEO FRAME INTERPOLATION
    Danier, Duolikun
    Zhang, Fan
    Bull, David
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1361 - 1365
  • [28] Variational approach for capsule video frame interpolation
    Mohammed, Ahmed
    Farup, Ivar
    Yildirim, Sule
    Pedersen, Marius
    Hovde, Oistein
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2018,
  • [29] A comprehensive survey on video frame interpolation techniques
    Anil Singh Parihar
    Disha Varshney
    Kshitija Pandya
    Ashray Aggarwal
    The Visual Computer, 2022, 38 : 295 - 319
  • [30] Self-Reproducing Video Frame Interpolation
    Deng, Jiajun
    Yu, Haichao
    Wang, Zhangyang
    Wang, Xinchao
    Huang, Thomas
    2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 193 - 198