MFNet:Real-Time Motion Focus Network for Video Frame Interpolation

被引:3
|
作者
Zhu, Guosong [1 ]
Qin, Zhen [1 ]
Ding, Yi [1 ]
Liu, Yao [1 ]
Qin, Zhiguang [1 ]
机构
[1] Univ Elect Sci & Technol China, Network & Data Secur Key Lab Sichuan Prov, Chengdu 610056, Peoples R China
基金
中国国家自然科学基金;
关键词
Interpolation; Optical imaging; Task analysis; Optical distortion; Memory management; Streaming media; Dynamics; Memory consumption reduction; motion focus; time efficiency improvement; video frame interpolation;
D O I
10.1109/TMM.2023.3308442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a popular research topic in computer vision, video frame interpolation is widely used in video processing tasks. However, this task is often limited by slow processing speed or high memory consumption in practical applications. To address these drawbacks, a frame interpolation network focusing on motion regions named MFNet is proposed, which consists of a sampler for adaptive and efficient separation of motion regions from the background, a fine-grained module for direct approximation of intermediate streams, and a lightweight module for bi-directional optical stream fusion. Extensive experiments show that our MFNet achieves optimal accuracy on some frame interpolation tasks and is much faster than other state-of-the-art methods. In addition, transplantation of the core components of MFNet to other frame interpolation networks can significantly improve the performance.
引用
收藏
页码:3251 / 3262
页数:12
相关论文
共 50 条
  • [41] Informative frame classification method for real-time analysis of colonoscopy video
    Rungseekajee, Nicharee
    Lohvithee, Manasavee
    Nilkhamhang, Itthisek
    ECTI-CON: 2009 6TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2009, : 1042 - 1045
  • [42] Real-time frame-dependent video watermarking in VLC domain
    Lu, CS
    Chen, JR
    Fan, KC
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2005, 20 (07) : 624 - 642
  • [43] Textural Detail Preservation Network for Video Frame Interpolation
    Yoon, Kihwan
    Huh, Jingang
    Kim, Yong Han
    Kim, Sungjei
    Jeong, Jinwoo
    IEEE ACCESS, 2023, 11 : 71994 - 72006
  • [44] Quality improvement of real-time video in mobile network
    Sun, Qindong
    Qi, Wenjing
    Zhang, Jingpeng
    IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 1039 - 1042
  • [45] Real-Time Optimization of Video Transmission in a Network of AAVs
    Abdel-Hadi, Ahmed
    Michel, Jonas
    Gerstlauer, Andreas
    Vishwanath, Sriram
    2011 IEEE VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2011,
  • [46] Real-time smoothing for network adaptive video streaming
    Gao, K
    Gao, W
    He, SM
    Zhang, YA
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2005, 16 (4-5) : 512 - 526
  • [47] Sparse Global Matching for Video Frame Interpolation with Large Motion
    Liu, Chunxu
    Zhang, Guozhen
    Zhao, Rui
    Wang, Limin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 19125 - 19134
  • [48] Fast Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
    Kim, Jintae
    Park, Junheum
    Kim, Chang-Su
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 1030 - 1034
  • [49] Reconfigurable architectures and processors for real-time video motion estimation
    Tiago Dias
    Nuno Roma
    Leonel Sousa
    Miguel Ribeiro
    Journal of Real-Time Image Processing, 2007, 2 : 191 - 205
  • [50] Fine-Grained Motion Estimation for Video Frame Interpolation
    Yan, Bo
    Tan, Weimin
    Lin, Chuming
    Shen, Liquan
    IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (01) : 174 - 184