Decoder-Side Motion Vector Refinement in VVC: Algorithm and Hardware Implementation Considerations

被引:16
|
作者
Gao, Han [1 ,2 ]
Chen, Xu [3 ]
Esenlik, Semih [1 ]
Chen, Jianle [4 ,5 ]
Steinbach, Eckehard [2 ]
机构
[1] Huawei Technol, D-80992 Munich, Germany
[2] Tech Univ Munich, Dept Elect & Comp Engn, D-80333 Munich 80333, Germany
[3] Huawei Technol, Shenzhen 518129, Peoples R China
[4] Futurewei Technol, Santa Clara, CA 95050 USA
[5] Qualcomm Inc, San Diego, CA 92121 USA
关键词
Encoding; Decoding; Prediction algorithms; Video coding; Hardware; Standards; Bandwidth; Decoder-side motion vector refinement (DMVR); inter-picture prediction; merge mode; motion compensation; versatile video coding (VVC); video compression; VIDEO; PREDICTION; DERIVATION;
D O I
10.1109/TCSVT.2020.3037024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents an overview of the decoder-side motion vector refinement (DMVR) algorithm in the Versatile Video Coding (VVC) standard. The proposed DMVR algorithm aims to increase the prediction accuracy of the blocks coded in merge mode using the bilateral matching-based refinement method. Compared with previous decoder-side motion vector derivation approaches, the proposed method significantly increases the coding efficiency without signaling additional side information. Furthermore, the hardware implementation considerations of the DMVR design are particularly focused in this study. This paper details and analyzes the novel features of DMVR contributing to the increase in coding efficiency and the reduction in computational complexity and implementation difficulty. Experimental results based on the VVC test model version 8.0 demonstrate that average Bjontegaard Delta rate savings of 0.80 % and 2.81 % are achieved for the "tool-off" and "tool-on" test configurations, respectively. Moreover, 4 % additional decoding time and negligible additional external memory bandwidth requirements of DMVR based on the common test conditions for VVC are reported.
引用
收藏
页码:3197 / 3211
页数:15
相关论文
共 50 条
  • [1] An 8K@120fps Hardware Implementation for Decoder-Side Motion Vector Refinement in VVC
    Liu, Jiahao
    Huang, Leilei
    Chen, Shushi
    Li, Wei
    Fan, Yibo
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [2] Low Complexity Decoder Side Motion Vector Refinement for VVC
    Gao, Han
    Esenlik, Semih
    Zhao, Zhijie
    Steinbach, Eckehard
    Chen, Jianle
    2019 PICTURE CODING SYMPOSIUM (PCS), 2019,
  • [3] Adaptive direct motion vector estimation with simple decoder-side refinement
    Information Technology R and D Center, Mitsubishi Electric Corporation, 5-1-1, Ofuna, Kamakura, Kanagawa 247-8501, Japan
    Kyokai Joho Imeji Zasshi, 7 (J233-J235):
  • [4] Decoder-side Affine Model Refinement for Video Coding beyond VVC
    Chen, Jie
    Liao, Ru-Ling
    Ye, Yan
    Li, Xinwei
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 248 - 257
  • [5] Adaptive bilateral matching for decoder-side motion vector refinement in video coding
    Huang, Han
    Zhang, Zhi
    Seregin, Vadim
    Chien, Wei-Jung
    Chen, Chun-Chi
    Karczewicz, Marta
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 342 - 348
  • [6] Motion Vector Coding using Decoder-side Estimation of Motion Vector
    Won, Kwanghyun
    Yang, Jungyoup
    Jeon, Byeungwoo
    BMSB: 2009 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING, VOLS 1 AND 2, 2009, : 841 - 844
  • [7] DECODER-SIDE MOTION VECTOR DERIVATION FOR HYBRID VIDEO INTER CODING
    Kamp, Steffen
    Wien, Mathias
    2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010), 2010, : 1277 - 1280
  • [8] Probability-based decoder-side intra mode derivation for VVC
    Wang, Yang
    Zhang, Li
    Zhang, Kai
    He, Yuwen
    Liu, Hongbin
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [9] Decoder-Side Motion Vector Derivation for Block-Based Video Coding
    Kamp, Steffen
    Wien, Mathias
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (12) : 1732 - 1745
  • [10] Region-based Template Matching for Decoder-Side Motion Vector Derivation
    Venugopal, Gayathri
    Marpe, Detlev
    Wiegand, Thomas
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,