Decoder-Side Motion Vector Refinement in VVC: Algorithm and Hardware Implementation Considerations

被引:17
|
作者
Gao, Han [1 ,2 ]
Chen, Xu [3 ]
Esenlik, Semih [1 ]
Chen, Jianle [4 ,5 ]
Steinbach, Eckehard [2 ]
机构
[1] Huawei Technol, D-80992 Munich, Germany
[2] Tech Univ Munich, Dept Elect & Comp Engn, D-80333 Munich 80333, Germany
[3] Huawei Technol, Shenzhen 518129, Peoples R China
[4] Futurewei Technol, Santa Clara, CA 95050 USA
[5] Qualcomm Inc, San Diego, CA 92121 USA
关键词
Encoding; Decoding; Prediction algorithms; Video coding; Hardware; Standards; Bandwidth; Decoder-side motion vector refinement (DMVR); inter-picture prediction; merge mode; motion compensation; versatile video coding (VVC); video compression; VIDEO; PREDICTION; DERIVATION;
D O I
10.1109/TCSVT.2020.3037024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents an overview of the decoder-side motion vector refinement (DMVR) algorithm in the Versatile Video Coding (VVC) standard. The proposed DMVR algorithm aims to increase the prediction accuracy of the blocks coded in merge mode using the bilateral matching-based refinement method. Compared with previous decoder-side motion vector derivation approaches, the proposed method significantly increases the coding efficiency without signaling additional side information. Furthermore, the hardware implementation considerations of the DMVR design are particularly focused in this study. This paper details and analyzes the novel features of DMVR contributing to the increase in coding efficiency and the reduction in computational complexity and implementation difficulty. Experimental results based on the VVC test model version 8.0 demonstrate that average Bjontegaard Delta rate savings of 0.80 % and 2.81 % are achieved for the "tool-off" and "tool-on" test configurations, respectively. Moreover, 4 % additional decoding time and negligible additional external memory bandwidth requirements of DMVR based on the common test conditions for VVC are reported.
引用
收藏
页码:3197 / 3211
页数:15
相关论文
共 50 条
  • [11] Decoder Side Motion Vector Refinement for Versatile Video Coding
    Gao, Han
    Esenlik, Semih
    Zhao, Zhijie
    Steinbach, Eckehard
    Chen, Jianle
    2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [12] DECODER-SIDE INTRA MODE DERIVATION WITH TEXTURE ANALYSIS IN VVC TEST MODEL
    Nasrallah, Anthony
    Abdoli, Mohsen
    Mora, Elie Gabriel
    Guionnet, Thomas
    Raulet, Mickael
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3153 - 3157
  • [13] DECODER-SIDE MOTION ESTIMATION AND WIENER FILTER FOR HEVC
    Chiu, Yi-jen
    Xu, Lidong
    Zhang, Wenhao
    Jiang, Hong
    2013 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP 2013), 2013,
  • [14] MESH-BASED DECODER-SIDE MOTION ESTIMATION
    Munderloh, Marco
    Klomp, Sven
    Ostermann, Joern
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2049 - 2052
  • [15] LIGHTWEIGHT HARDWARE IMPLEMENTATION OF VVC TRANSFORM BLOCK FOR ASIC DECODER
    Farhat, I
    Hamidouche, W.
    Grill, A.
    Menard, D.
    Deforges, O.
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1663 - 1667
  • [16] An Interpolation-Free Fractional Motion Estimation Algorithm and Hardware Implementation for VVC
    Chen, Shushi
    Huang, Leilei
    Zan, Zhao
    Zeng, Xiaoyang
    Fan, Yibo
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2025, 33 (02) : 395 - 407
  • [17] An Error-Surface-Based Fractional Motion Estimation Algorithm and Hardware Implementation for VVC
    Chen, Shushi
    Huang, Leilei
    Liu, Jiahao
    Liu, Chao
    Fan, Yibo
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [18] Hardware Implementation of Multiple Vector Quantization Decoder
    Shigei, Noritaka
    Miyajima, Hiromi
    Hashiguchi, Shingo
    Maeda, Michiharu
    Ma, Lixin
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (11): : 54 - 61
  • [19] IMPROVED VIEW SYNTHESIS PREDICTION USING DECODER-SIDE MOTION DERIVATION FOR MULTIVIEW VIDEO CODING
    Shimizu, Shinya
    Kimata, Hideaki
    2010 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON 2010), 2010,
  • [20] MOTION ESTIMATION ALGORITHM FOR SCALABLE HARDWARE IMPLEMENTATION
    Konieczny, Jacek
    Luczak, Adam
    PCS: 2009 PICTURE CODING SYMPOSIUM, 2009, : 253 - 256