Blurry Video Frame Interpolation

被引:65
|
作者
Shen, Wang [1 ]
Bao, Wenbo [1 ]
Zhai, Guangtao [1 ]
Chen, Li [1 ]
Min, Xiongkuo [1 ]
Gao, Zhiyong [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai, Peoples R China
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2020年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR42600.2020.00516
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely synthesizing high-frame-rate clear results from low-frame-rate blurry inputs. In this paper, we propose a blurry video frame interpolation method to reduce motion blur and up-convert frame rate simultaneously. Specifically, we develop a pyramid module to cyclically synthesize clear intermediate frames. The pyramid module features adjustable spatial receptive field and temporal scope, thus contributing to controllable computational complexity and restoration ability. Besides, we propose an inter-pyramid recurrent module to connect sequential models to exploit the temporal relationship. The pyramid module integrates a recurrent module, thus can iteratively synthesize temporally smooth results without significantly increasing the model size. Extensive experimental results demonstrate that our method performs favorably against state-of-the-art methods. The source code and pre-trained model are available at https://github.com/1aomao0/BIN.
引用
收藏
页码:5113 / 5122
页数:10
相关论文
共 50 条
  • [41] Cloud Desktop Frame Rate Enhancement Based on Video Frame Interpolation
    He, Weihong
    Li, Yakang
    Yuan, Huaqiang
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 859 - 864
  • [42] Multi-Frame Pyramid Refinement Network for Video Frame Interpolation
    Zhang, Haoxian
    Wang, Ronggang
    Zhao, Yang
    IEEE ACCESS, 2019, 7 : 130610 - 130621
  • [43] Deep Iterative Frame Interpolation for Full-frame Video Stabilization
    Choi, Jinsoo
    Kweon, In So
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (01):
  • [44] BVI-VFI: A Video Quality Database for Video Frame Interpolation
    Danier, Duolikun
    Zhang, Fan
    Bull, David R.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6004 - 6019
  • [45] BVI-VFI: A Video Quality Database for Video Frame Interpolation
    Danier, Duolikun
    Zhang, Fan
    Bull, David R.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6004 - 6019
  • [46] Splatting-based Synthesis for Video Frame Interpolation
    Niklaus, Simon
    Hu, Ping
    Chen, Jiawen
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 713 - 723
  • [47] Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
    Park, Junheum
    Lee, Chul
    Kim, Chang-Su
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14519 - 14528
  • [48] A Unified Pyramid Recurrent Network for Video Frame Interpolation
    Jin, Xin
    Wu, Longhai
    Chen, Jie
    Chen, Youxin
    Koo, Jayoon
    Hahm, Cheul-hee
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1578 - 1587
  • [49] LDMVFI: Video Frame Interpolation with Latent Diffusion Models
    Danier, Duolikun
    Zhang, Fan
    Bull, David
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1472 - 1480
  • [50] Video Frame Interpolation via Generalized Deformable Convolution
    Shi, Zhihao
    Liu, Xiaohong
    Shi, Kangdi
    Dai, Linhui
    Chen, Jun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 426 - 439