Advanced Patch-Based Affine Motion Estimation for Dynamic Point Cloud Geometry Compression

被引:0
|
作者
Shao, Yiting [1 ,2 ]
Gao, Wei [1 ]
Liu, Shan [3 ]
Li, Ge [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] Tencent, Media Lab, Palo Alto, CA 94306 USA
基金
中国国家自然科学基金;
关键词
dynamic point cloud geometry compression; affine motion estimation; patch generation;
D O I
10.3390/s24103142
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The substantial data volume within dynamic point clouds representing three-dimensional moving entities necessitates advancements in compression techniques. Motion estimation (ME) is crucial for reducing point cloud temporal redundancy. Standard block-based ME schemes, which typically utilize the previously decoded point clouds as inter-reference frames, often yield inaccurate and translation-only estimates for dynamic point clouds. To overcome this limitation, we propose an advanced patch-based affine ME scheme for dynamic point cloud geometry compression. Our approach employs a forward-backward jointing ME strategy, generating affine motion-compensated frames for improved inter-geometry references. Before the forward ME process, point cloud motion analysis is conducted on previous frames to perceive motion characteristics. Then, a point cloud is segmented into deformable patches based on geometry correlation and motion coherence. During the forward ME process, affine motion models are introduced to depict the deformable patch motions from the reference to the current frame. Later, affine motion-compensated frames are exploited in the backward ME process to obtain refined motions for better coding performance. Experimental results demonstrate the superiority of our proposed scheme, achieving an average 6.28% geometry bitrate gain over the inter codec anchor. Additional results also validate the effectiveness of key modules within the proposed ME scheme.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] MOTION ESTIMATION AND FILTERED PREDICTION FOR DYNAMIC POINT CLOUD ATTRIBUTE COMPRESSION
    Hong, Haoran
    Pavez, Eduardo
    Ortega, Antonio
    Watanabe, Ryosuke
    Nonaka, Keisuke
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 139 - 143
  • [2] Dynamic Point Cloud Geometry Compression via Patch-wise Polynomial Fitting
    Xu, Yingzhan
    Zhu, Wenjie
    Xu, Yiling
    Li, Zhu
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 2287 - 2291
  • [3] Skeleton-based motion estimation for Point Cloud Compression
    Cao, Chao
    Tulvan, Christian
    Preda, Marius
    Zaharia, Titus
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [4] Advanced Point Cloud Estimation based on Multiple View Geometry
    Hlubik, Jan
    Kamencay, Patrik
    Hudec, Robert
    Benco, Miroslav
    Sykora, Peter
    2018 28TH INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2018,
  • [5] Fractional Motion Estimation for Point Cloud Compression
    Hong, Haoran
    Pavez, Eduardo
    Ortega, Antonio
    Watanabe, Ryosuke
    Nonaka, Keisuke
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 369 - 378
  • [6] Advanced 3D Motion Prediction for Video-Based Dynamic Point Cloud Compression
    Li, Li
    Li, Zhu
    Zakharchenko, Vladyslav
    Chen, Jianle
    Li, Houqiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 289 - 302
  • [7] GRAPH-BASED MOTION ESTIMATION AND COMPENSATION FOR DYNAMIC 3D POINT CLOUD COMPRESSION
    Thanou, Dorina
    Chou, Philip A.
    Frossard, Pascal
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3235 - 3239
  • [8] AN IMPROVED COARSE-TO-FINE MOTION ESTIMATION SCHEME FOR LIDAR POINT CLOUD GEOMETRY COMPRESSION
    Jin, Jiamin
    Li, Ge
    Shao, Yiting
    Song, Fei
    Zhang, Ruonan
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [9] PLGP: point cloud inpainting by patch-based local geometric propagating
    Huang, Yan
    Yang, Chuanchuan
    Shi, Yu
    Chen, Hao
    Yan, Weizhen
    Chen, Zhangyuan
    VISUAL COMPUTER, 2023, 39 (02): : 723 - 732
  • [10] PLGP: point cloud inpainting by patch-based local geometric propagating
    Yan Huang
    Chuanchuan Yang
    Yu Shi
    Hao Chen
    Weizhen Yan
    Zhangyuan Chen
    The Visual Computer, 2023, 39 : 723 - 732