Three-Zone Segmentation-Based Motion Compensation for Video Compression

被引:10
|
作者
Wang, Zhao [1 ]
Wang, Shiqi [2 ]
Zhang, Xinfeng [4 ]
Wang, Shanshe [1 ,3 ]
Ma, Siwei [1 ,3 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Inst Digital Media, Beijing 100871, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Peng Cheng Labarotory, Shenzhen 518055, Peoples R China
[4] Univ Chinese Acad Sci, Dept Comp Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Block segmentation; block partitioning; motion compensation; inter prediction; video compression; PREDICTION; PARTITION; ALGORITHM;
D O I
10.1109/TIP.2019.2910382
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Motion compensation has been widely employed for removing temporal redundancies in typical hybrid video coding framework. The popular video compression standards, such as H.264/AVC and HEVC, adopt the block-based partitioning model to describe the motion field due to its high-compression efficiency and relatively low-computational complexity. However, block-based motion compensation may not align with the actual object motion boundaries, potentially limiting the compression efficiency. In view of this, we propose a three-zone segmentation-based motion compensation scheme to improve the description accuracy of motion field as well as the coding efficiency. In particular, the segmentation information is implied in the reference frame instead of being explicitly signalled. Based on the segmentation information, three motion compensation zones can be identified, including one edge, one foreground, and one background zone. The foreground zone is motion compensated by the signalled motion vector of the block, and the background zone is motion compensated by the motion information implicitly derived from the local motion field. Regarding the edge zone, it is viewed as an overlapped area and the weighted compensation strategy is adopted. The proposed algorithm is implemented into the reference software VTM-1.0 of versatile video coding (VVC), and the simulation results show that the algorithm can achieve 1.14% and 1.06% bitrate savings for random access and lowdelay configurations, respectively.
引用
收藏
页码:5091 / 5104
页数:14
相关论文
共 50 条
  • [1] SEGMENTATION-BASED MOTION COMPENSATION FOR ENHANCED VIDEO CODING
    Milani, S.
    Calvagno, G.
    [J]. 2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 1649 - 1652
  • [2] Segmentation-based coding of motion fields for video compression
    Baker, M
    Maeder, A
    [J]. DIGITAL VIDEO COMPRESSION: ALGORITHMS AND TECHNOLOGIES 1996, 1996, 2668 : 345 - 354
  • [3] Segmentation-based motion compensation
    Ferrandiere, ED
    [J]. MATHEMATICAL MORPHOLOGY AND ITS APPLICATIONS TO IMAGE AND SIGNAL PROCESSING, 1998, 12 : 315 - 322
  • [4] Segmentation-Based Video Compression Using Texture and Motion Models
    Bosch, Marc
    Zhu, Fengqing
    Delp, Edward J.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2011, 5 (07) : 1366 - 1377
  • [5] Efficient segmentation-based motion compensation for low bit rate video coding
    Sipitca, M
    Madisetti, V
    [J]. VISUAL COMMUNICATIONS AND IMAGE PROCESSING '96, 1996, 2727 : 806 - 810
  • [6] Motion segmentation-based surveillance video compression using adaptive particle swarm optimization
    Sandeep Singh Sengar
    Susanta Mukhopadhyay
    [J]. Neural Computing and Applications, 2020, 32 : 11443 - 11457
  • [7] Motion segmentation-based surveillance video compression using adaptive particle swarm optimization
    Sengar, Sandeep Singh
    Mukhopadhyay, Susanta
    [J]. NEURAL COMPUTING & APPLICATIONS, 2020, 32 (15): : 11443 - 11457
  • [8] Segmentation-based Partitioning for Motion Compensated Prediction in Video Coding
    Blaeser, Max
    Heithausen, Cordula
    Wien, Mathias
    [J]. 2016 PICTURE CODING SYMPOSIUM (PCS), 2016,
  • [9] SEGMENTATION-BASED IMAGE COMPRESSION
    KWON, OJ
    CHELLAPPA, R
    [J]. OPTICAL ENGINEERING, 1993, 32 (07) : 1581 - 1581
  • [10] Segmentation-Based Image Compression
    Basak, Ratan Kumar
    Mukhopadhyay, Bipasha
    Chatterjee, Souvik
    Goswami, Sukalyan
    Zaman, Amrin
    Ray, Ronit
    Roy, Abhriya
    Guha, Shalini
    De, Saptarshi
    Dutta, Riddhi
    [J]. 2016 IEEE 7TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS MOBILE COMMUNICATION CONFERENCE (UEMCON), 2016,