Learning-based Intra-Prediction For Point Cloud Attribute Transform Coding

被引:2
|
作者
Hou, Lizhi [1 ]
Gao, Linyao [1 ]
Xu, Yiling [1 ]
Li, Zhu [2 ]
Xu, Xiaozhong [3 ]
Liu, Shan [3 ]
机构
[1] Shanghai Jiao Tong Univ, Cooperat MediaNet Innovat Ctr, Shanghai, Peoples R China
[2] Univ Missouri Kansas, Dept CSEE, Kansas City, KS USA
[3] Tencent, Media Lab, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud attribute compression; region adaptive hierarchical transform; intra-prediction; MLP-based neural network; REGION; COMPRESSION;
D O I
10.1109/MMSP55362.2022.9949997
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The attached attributes of each point in point cloud are fairly valuable but aggravate the burden for storage and transmission. In this paper, we propose a learning-based introprediction method for region adaptive hierarchical transform (RAHT) to compress point cloud attributes efficiently. First, we design an adaptive neighbor selection (ANS) module to produce the most correlated neighbors for child nodes. Then, the correlated neighbors obtained by ANS, the corresponding distance weights, and some additional auxiliary information are concatenated and fed to a multi-layer perception (MLP) based network to estimate the child node attributes precisely. Besides, residual learning is introduced to accelerate the network convergence. The predicted child node attributes are finally transformed by RAHT, and the residual of transform coefficients are then quantized and entropy coded. Experimental results demonstrate that our proposed methods can significantly improve attribute coding efficiency with average 10.2% BD-Rate gains compared with MPEG G-PCC reference software TMC13v14.0 on MPEG PCC dataset.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Intra-Prediction and Generalized Graph Fourier Transform for Image Coding
    Hu, Wei
    Cheung, Gene
    Ortega, Antonio
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (11) : 1913 - 1917
  • [2] LEARNING-BASED RATE CONTROL FOR LEARNING-BASED POINT CLOUD GEOMETRY CODING
    Ruivo, Manuel
    Guarda, Andre F. R.
    Pereira, Fernando
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 251 - 255
  • [3] Deep Learning based Angular Intra-Prediction for Lossless HEVC Video Coding
    Huang, Hongyue
    Schiopu, Ionut
    Munteanu, Adrian
    2019 DATA COMPRESSION CONFERENCE (DCC), 2019, : 579 - 579
  • [4] Multiple modes intra-prediction in intra coding
    Zhang, P
    Zhao, DB
    Ma, SW
    Lu, Y
    Gao, W
    2004 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXP (ICME), VOLS 1-3, 2004, : 419 - 422
  • [5] Deep Learning-Based Nonlinear Transform for HEVC Intra Coding
    Yang, Kun
    Liu, Dong
    Wu, Feng
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 387 - 390
  • [6] Progressive Coding for Deep Learning based Point Cloud Attribute Compression
    Rudolph, Michael
    Riemenschneider, Aron
    Rizk, Amr
    PROCEEDINGS OF THE 2024 16TH INTERNATIONAL WORKSHOP ON IMMERSIVE MIXED AND VIRTUAL ENVIRONMENT SYSTEMS, MMVE 2024, 2024, : 78 - 84
  • [7] ON BLOCK PREDICTION FOR LEARNING-BASED POINT CLOUD COMPRESSION
    Lazzarotto, Davi
    Alexiou, Evangelos
    Ebrahimi, Touradj
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3378 - 3382
  • [8] Learning-based Point Cloud Geometry Coding Rate Control
    Ruivo, Manuel
    Guarda, Andre F. R.
    Pereira, Fernando
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 359 - 359
  • [9] Adaptive Deep Learning-Based Point Cloud Geometry Coding
    Guarda, Andre F. R.
    Rodrigues, Nuno M. M.
    Pereira, Fernando
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) : 415 - 430
  • [10] Deep Learning-based Point Cloud Coding for Immersive Experiences
    Pereira, Fernando
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7368 - 7370