MFNet:Real-Time Motion Focus Network for Video Frame Interpolation

被引:3
|
作者
Zhu, Guosong [1 ]
Qin, Zhen [1 ]
Ding, Yi [1 ]
Liu, Yao [1 ]
Qin, Zhiguang [1 ]
机构
[1] Univ Elect Sci & Technol China, Network & Data Secur Key Lab Sichuan Prov, Chengdu 610056, Peoples R China
基金
中国国家自然科学基金;
关键词
Interpolation; Optical imaging; Task analysis; Optical distortion; Memory management; Streaming media; Dynamics; Memory consumption reduction; motion focus; time efficiency improvement; video frame interpolation;
D O I
10.1109/TMM.2023.3308442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a popular research topic in computer vision, video frame interpolation is widely used in video processing tasks. However, this task is often limited by slow processing speed or high memory consumption in practical applications. To address these drawbacks, a frame interpolation network focusing on motion regions named MFNet is proposed, which consists of a sampler for adaptive and efficient separation of motion regions from the background, a fine-grained module for direct approximation of intermediate streams, and a lightweight module for bi-directional optical stream fusion. Extensive experiments show that our MFNet achieves optimal accuracy on some frame interpolation tasks and is much faster than other state-of-the-art methods. In addition, transplantation of the core components of MFNet to other frame interpolation networks can significantly improve the performance.
引用
收藏
页码:3251 / 3262
页数:12
相关论文
共 50 条
  • [31] Histograms of Motion Gradients for Real-time Video Classification
    Duta, Ionut C.
    Uijlings, Jasper R. R.
    Nguyen, Tuan A.
    Aizawa, Kiyoharu
    Hauptmann, Alexander G.
    Ionescu, Bogdan
    Sebe, Nicu
    2016 14TH INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2016,
  • [32] A Real-Time Motion Detection for Video Surveillance System
    Kurylyak, Yuriy
    2009 IEEE INTERNATIONAL WORKSHOP ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS, 2009, : 386 - 389
  • [33] Real-time Abnormal Motion Detection in Surveillance Video
    Kiryati, Nahum
    Raviv, Tammy Riklin
    Ivanchenko, Yan
    Rochel, Shay
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 3015 - 3018
  • [34] Discriminative Focus of Attention for Real-Time Object Detection in Video
    Saptharishi, Mahesh
    Lipchin, Aleksey
    Lisin, Dimitri
    2012 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2012, : 85 - 90
  • [35] Real-Time Video Stitching Method Based on Dense Viewpoint Interpolation
    Heng Wei
    Yu Jian
    Da Feipeng
    ACTA OPTICA SINICA, 2023, 43 (14)
  • [36] High-quality and Real-time Frame Interpolation on Heterogeneous Computing System
    Bao, Wenbo
    Zhang, Xiaoyun
    Chen, Li
    Gao, Zhiyong
    2017 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2017, : 482 - 485
  • [37] Tropospheric Bias Interpolation for Network Real-Time Kinematic GPS
    Grgich, P. M.
    Kealy, A.
    Gordini, C.
    Hale, M.
    PROCEEDINGS OF THE 19TH INTERNATIONAL TECHNICAL MEETING OF THE SATELLITE DIVISION OF THE INSTITUTE OF NAVIGATION (ION GNSS 2006), 2006, : 1186 - 1195
  • [38] Multi-Frame Pyramid Refinement Network for Video Frame Interpolation
    Zhang, Haoxian
    Wang, Ronggang
    Zhao, Yang
    IEEE ACCESS, 2019, 7 : 130610 - 130621
  • [39] A Unified Pyramid Recurrent Network for Video Frame Interpolation
    Jin, Xin
    Wu, Longhai
    Chen, Jie
    Chen, Youxin
    Koo, Jayoon
    Hahm, Cheul-hee
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1578 - 1587
  • [40] Real-Time Video Quality Control For Multimedia Network
    Jiang, Biao
    Saadawi, Tarek
    2013 INTERNATIONAL CONFERENCE ON MOBILE WIRELESS MIDDLEWARE, OPERATING SYSTEMS AND APPLICATIONS (MOBILWARE 2013), 2013, : 138 - 147