Advanced Patch-Based Affine Motion Estimation for Dynamic Point Cloud Geometry Compression

被引:0
|
作者
Shao, Yiting [1 ,2 ]
Gao, Wei [1 ]
Liu, Shan [3 ]
Li, Ge [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[3] Tencent, Media Lab, Palo Alto, CA 94306 USA
基金
中国国家自然科学基金;
关键词
dynamic point cloud geometry compression; affine motion estimation; patch generation;
D O I
10.3390/s24103142
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The substantial data volume within dynamic point clouds representing three-dimensional moving entities necessitates advancements in compression techniques. Motion estimation (ME) is crucial for reducing point cloud temporal redundancy. Standard block-based ME schemes, which typically utilize the previously decoded point clouds as inter-reference frames, often yield inaccurate and translation-only estimates for dynamic point clouds. To overcome this limitation, we propose an advanced patch-based affine ME scheme for dynamic point cloud geometry compression. Our approach employs a forward-backward jointing ME strategy, generating affine motion-compensated frames for improved inter-geometry references. Before the forward ME process, point cloud motion analysis is conducted on previous frames to perceive motion characteristics. Then, a point cloud is segmented into deformable patches based on geometry correlation and motion coherence. During the forward ME process, affine motion models are introduced to depict the deformable patch motions from the reference to the current frame. Later, affine motion-compensated frames are exploited in the backward ME process to obtain refined motions for better coding performance. Experimental results demonstrate the superiority of our proposed scheme, achieving an average 6.28% geometry bitrate gain over the inter codec anchor. Additional results also validate the effectiveness of key modules within the proposed ME scheme.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] MULTIRESOLUTION PATCH-BASED DENSE RECONSTRUCTION INTEGRATING MULTIVIEW IMAGES AND LASER POINT CLOUD
    Zhang, Rongchun
    Yi, Xuefeng
    Li, Hao
    Liu, Lanfa
    Lu, Guanming
    Chen, Yuanyuan
    Guo, Xiantao
    XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 43-B2 : 153 - 159
  • [22] Advanced 3D Motion Prediction for Video Based Point Cloud Attributes Compression
    Li, Li
    Li, Zhu
    Zakharchenko, Vladyslav
    Chen, Emile
    2019 DATA COMPRESSION CONFERENCE (DCC), 2019, : 498 - 507
  • [23] A SYNDROME-BASED AUTOENCODER FOR POINT CLOUD GEOMETRY COMPRESSION
    Milani, Simone
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2686 - 2690
  • [24] DYNAMIC POINT CLOUD COMPRESSION USING A CUBOID ORIENTED DISCRETE COSINE BASED MOTION MODEL
    Ahmmed, Ashek
    Paul, Manoranjan
    Murshed, Manzur
    Taubman, David
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1935 - 1939
  • [25] Dynamic Compression of Curve-Based Point Cloud
    Daribo, Ismael
    Furukawa, Ryo
    Sagawa, Ryusuke
    Kawasaki, Hiroshi
    Hiura, Shinsaku
    Asada, Naoki
    ADVANCES IN IMAGE AND VIDEO TECHNOLOGY, PT II, 2011, 7088 : 323 - +
  • [26] Patch-based stereo in a general binocular viewing geometry
    Super, BJ
    Klarquist, WN
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (03) : 247 - 253
  • [27] An end-to-end dynamic point cloud geometry compression in latent space
    Jiang, Zhaoyi
    Wang, Guoliang
    Tam, Gary K. L.
    Song, Chao
    Li, Frederick W. B.
    Yang, Bailin
    DISPLAYS, 2023, 80
  • [28] Patch-based stereo in a general binocular viewing geometry
    Univ of Illinois, Chicago, United States
    IEEE Trans Pattern Anal Mach Intell, 3 (247-253):
  • [29] Motion Estimation/Compensated Compressed Sensing using Patch-Based Low Rank Penalty
    Yoon, Huisu
    Ye, Jong Chul
    WAVELETS AND SPARSITY XV, 2013, 8858
  • [30] ADAPTIVE PIXEL/PATCH-BASED SYNTHESIS FOR TEXTURE COMPRESSION
    Racape, Fabien
    Lefort, Simon
    Francois, Edouard
    Babel, Marie
    Deforges, Olivier
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 609 - 612