Multi-Frame Motion Compensation using Extrapolated Frame by Optical Flow for Lossless Video Coding

被引:0
|
作者
Kameda, Yusuke [1 ]
Kishi, Hiroyuki [1 ]
Ishikawa, Tomokazu [1 ]
Matsuda, Ichiro [1 ]
Itoh, Susumu [1 ]
机构
[1] Tokyo Univ Sci, Fac Sci & Technol, 2641 Yamazaki, Noda, Chiba 2788510, Japan
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an efficient motion compensation method based on a temporally extrapolated frame by using a pel-wise motion (optical flow) estimation. In traditional motion compensation methods, motion vectors are generally detected on a block-by-block basis and sent to the decoder as side information. However, such block-wise motions are not always suitable for motions such as local scaling, rotation, and deformation. On the other hand, pel-wise motion can be estimated on both the side of the encoder and decoder from two successive frames that were previously encoded without side information. The use of pel-wise motion enables the extrapolated frame to be generated under the assumption of linear uniform motions within a short time period. This frame is an approximation of the frame to be encoded. The proposed bi-prediction method uses the extrapolated frame as one of the reference frames. The experimental results indicate that the prediction performance of the proposed method is higher than that of the traditional method.
引用
收藏
页码:300 / 304
页数:5
相关论文
共 50 条
  • [1] Lossless Video Coding Based on Multi-Frame Example Search and Probability Model Optimization
    Nemoto, Koji
    Kameda, Yusuke
    Matsuda, Ichiro
    Itoh, Susumu
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049
  • [2] Multi-frame structure from motion using optical flow probability distributions
    Lee, Dah-Jye
    Merrell, Paul C.
    Nelson, Brent E.
    Wei, Zhaoyi
    NEUROCOMPUTING, 2009, 72 (4-6) : 1032 - 1041
  • [3] Fast Multi-Frame Motion Estimation for Video Processing
    Wang, Demin
    Zhang, Liang
    Vincent, Andre
    BMSB: 2009 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING, VOLS 1 AND 2, 2009, : 361 - 368
  • [4] Multi-frame optical flow estimation with oriented smoothness in the direction of motion
    Feghali, R
    ISPA 2003: PROCEEDINGS OF THE 3RD INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, PTS 1 AND 2, 2003, : 1147 - 1152
  • [5] MULTI-FRAME VIDEO PREDICTION WITH LEARNABLE MOTION ENCODINGS
    Jasti, Rakesh
    Jampani, Varun
    Sun, Deqing
    Yang, Ming-Hsuan
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4198 - 4202
  • [6] Combined frame memory motion compensation for video coding
    Chang, Nelson Yen-Chung
    Chang, Tian-Sheuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (10) : 1280 - 1285
  • [7] Multi-frame interpolation of Bayer images using optical flow
    Sato, Toshiki
    Fukushima, Norishige
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2020, 2020, 11515
  • [8] Video Deflickering Using Multi-Frame Optimization
    Li, Chao
    Chen, Zhihua
    Sheng, Bin
    Li, Ping
    He, Gaoqi
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [9] Multi-Frame Optimized Quantization for High Efficiency Video Coding
    Winken, Martin
    Roth, Andre
    Schwarz, Heiko
    Wiegand, Thomas
    2015 PICTURE CODING SYMPOSIUM (PCS) WITH 2015 PACKET VIDEO WORKSHOP (PV), 2015, : 159 - 163
  • [10] Short/long-term motion vector prediction in multi-frame video coding system
    Hsiao, YH
    Lee, TH
    Chang, PC
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 1449 - 1452