GQE-Net: A Graph-Based Quality Enhancement Network for Point Cloud Color Attribute

被引:27
|
作者
Xing, Jinrui [1 ]
Yuan, Hui [1 ]
Hamzaoui, Raouf [2 ]
Liu, Hao [3 ]
Hou, Junhui [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] De Montfort Univ, Sch Engn & Sustainable Dev, Leicester LE1 9BH, England
[3] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; quality enhancement; graph neural network; G-PCC; GEOMETRY;
D O I
10.1109/TIP.2023.3330086
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, point clouds have become increasingly popular for representing three-dimensional (3D) visual objects and scenes. To efficiently store and transmit point clouds, compression methods have been developed, but they often result in a degradation of quality. To reduce color distortion in point clouds, we propose a graph-based quality enhancement network (GQE-Net) that uses geometry information as an auxiliary input and graph convolution blocks to extract local features efficiently. Specifically, we use a parallel-serial graph attention module with a multi-head graph attention mechanism to focus on important points or features and help them fuse together. Additionally, we design a feature refinement module that takes into account the normals and geometry distance between points. To work within the limitations of GPU memory capacity, the distorted point cloud is divided into overlap-allowed 3D patches, which are sent to GQE-Net for quality enhancement. To account for differences in data distribution among different color components, three models are trained for the three color components. Experimental results show that our method achieves state-of-the-art performance. For example, when implementing GQE-Net on a recent test model of the geometry-based point cloud compression (G-PCC) standard, 0.43 dB, 0.25 dB and 0.36 dB Bj phi ntegaard delta (BD)-peak signal-to-noise ratio (PSNR), corresponding to 14.0%, 9.3% and 14.5% BD-rate savings were achieved on dense point clouds for the Y, Cb, and Cr components, respectively.
引用
收藏
页码:6303 / 6317
页数:15
相关论文
共 50 条
  • [1] Attribute-aware Partitioning for Graph-based Point Cloud Attribute Coding
    Meyer, Thibaut
    Meyer, Maria
    Mehlem, Dominik
    Rohlfing, Christian
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 121 - 125
  • [2] Graph-based Network for Dynamic Point Cloud Prediction
    Gomes, Pedro
    MMSYS '21: PROCEEDINGS OF THE 2021 MULTIMEDIA SYSTEMS CONFERENCE, 2021, : 393 - 397
  • [3] Graph-Based Depth Denoising & Dequantization for Point Cloud Enhancement
    Zhang, Xue
    Cheung, Gene
    Pang, Jiahao
    Sanghvi, Yash
    Gnanasambandam, Abhiram
    Chan, Stanley H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6863 - 6878
  • [4] GRAB-Net: Graph-Based Boundary-Aware Network for Medical Point Cloud Segmentation
    Liu, Yifan
    Li, Wuyang
    Liu, Jie
    Chen, Hui
    Yuan, Yixuan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (09) : 2776 - 2786
  • [5] Graph-based Point Cloud Denoising
    Gao, Xiang
    Hu, Wei
    Guo, Zongming
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [6] Wiener Filter-based Color Attribute Quality Enhancement for Geometry-based Point Cloud Compression
    Xing, Jinrui
    Yuan, Hui
    Chen, Chen
    Gao, Wei
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 1208 - 1212
  • [7] Exploiting color for graph-based 3D point cloud denoising*
    Irfan, Muhammad Abeer
    Magli, Enrico
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
  • [8] Research on Graph-Based Point Cloud: A Survey
    Liang, Xun
    Li, Zhiying
    Jiang, Hongxun
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (11): : 2870 - 2896
  • [9] Graph-PBN: Graph-based parallel branch network for efficient point cloud learning
    Zhang, Cheng
    Chen, Hao
    Wan, Haocheng
    Yang, Ping
    Wu, Zizhao
    GRAPHICAL MODELS, 2022, 119
  • [10] A Small-Scale Image U-Net-Based Color Quality Enhancement for Dense Point Cloud
    Xing, Jinrui
    Yuan, Hui
    Zhang, Wei
    Guo, Tian
    Chen, Chen
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 669 - 683