Multi-Frame Motion Compensation using Extrapolated Frame by Optical Flow for Lossless Video Coding

被引:0
|
作者
Kameda, Yusuke [1 ]
Kishi, Hiroyuki [1 ]
Ishikawa, Tomokazu [1 ]
Matsuda, Ichiro [1 ]
Itoh, Susumu [1 ]
机构
[1] Tokyo Univ Sci, Fac Sci & Technol, 2641 Yamazaki, Noda, Chiba 2788510, Japan
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an efficient motion compensation method based on a temporally extrapolated frame by using a pel-wise motion (optical flow) estimation. In traditional motion compensation methods, motion vectors are generally detected on a block-by-block basis and sent to the decoder as side information. However, such block-wise motions are not always suitable for motions such as local scaling, rotation, and deformation. On the other hand, pel-wise motion can be estimated on both the side of the encoder and decoder from two successive frames that were previously encoded without side information. The use of pel-wise motion enables the extrapolated frame to be generated under the assumption of linear uniform motions within a short time period. This frame is an approximation of the frame to be encoded. The proposed bi-prediction method uses the extrapolated frame as one of the reference frames. The experimental results indicate that the prediction performance of the proposed method is higher than that of the traditional method.
引用
收藏
页码:300 / 304
页数:5
相关论文
共 50 条
  • [11] Multi-Frame Video Enhancement Using Virtual Frame Synthesized in Time Domain
    Ding D.
    Wu X.
    Tong J.
    Yao Z.
    Pan Z.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (05): : 780 - 786
  • [12] A Fusion Approach for Multi-Frame Optical Flow Estimation
    Ren, Zhile
    Gallo, Orazio
    Sun, Deqing
    Yang, Ming-Hsuan
    Sudderth, Erik B.
    Kautz, Jan
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 2077 - 2086
  • [13] Estimating Optical Flow by Integrating Multi-Frame Information
    Wang, Chia-Ming
    Fan, Kuo-Chin
    Wang, Cheng-Tzu
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2008, 24 (06) : 1719 - 1731
  • [14] Multi-Frame motion deblurring of video using the natural oscillatory motion of dexterous legged robots
    Gultekin, Gokhan Koray
    Saranli, Afsar
    IET IMAGE PROCESSING, 2019, 13 (09) : 1502 - 1508
  • [15] Unsupervised Learning of Multi-Frame Optical Flow with Occlusions
    Janai, Joel
    Guney, Fatma
    Ranjan, Anurag
    Black, Michael
    Geiger, Andreas
    COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 713 - 731
  • [16] Multi-Frame Pyramid Refinement Network for Video Frame Interpolation
    Zhang, Haoxian
    Wang, Ronggang
    Zhao, Yang
    IEEE ACCESS, 2019, 7 : 130610 - 130621
  • [17] Multi-frame estimation of planar motion
    Zelnik-Manor, L
    Irani, M
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (10) : 1105 - 1116
  • [18] MFCFlow : A Motion Feature Compensated Multi-Frame Recurrent Network for Optical Flow Estimation
    Chen, Yonghu
    Zhu, Dongchen
    Shi, Wenjun
    Zhang, Guanghui
    Zhang, Tianyu
    Zhang, Xiaolin
    Li, Jiamao
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5057 - 5066
  • [19] Fast Multi-frame Stereo Scene Flow with Motion Segmentation
    Taniai, Tatsunori
    Sinha, Sudipta N.
    Sato, Yoichi
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6891 - 6900
  • [20] SplatFlow: Learning Multi-frame Optical Flow via Splatting
    Wang, Bo
    Zhang, Yifan
    Li, Jian
    Yu, Yang
    Sun, Zhenping
    Liu, Li
    Hu, Dewen
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (08) : 3023 - 3045