Wave-PCT: Wavelet point cloud transformer for point cloud quality assessment

被引:0
|
作者
Guo, Ziyou [1 ]
Huang, Zhen [2 ]
Gong, Wenyong [2 ]
Wu, Tieru [1 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Changchun, Peoples R China
[2] Jinan Univ, Dept Math, Guangzhou, Peoples R China
关键词
No-reference quality assessment; Wavelets; Transformer; Point cloud;
D O I
10.1016/j.eswa.2024.125039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud representation for real-world objects has seen a surge in interest recently, finding widespread applications in augmented reality, virtual reality, and autonomous driving. However, the process of acquiring, compressing, transmitting, and processing point cloud data often introduces unwanted distortions, highlighting the need for effective no-reference quality assessment methods for distorted point clouds. In this paper, we propose a Wavelet Point Cloud Transformer (Wave-PCT) method to assess the quality of point clouds without reference data. We start by performing patch sampling on a source point cloud, generating an extensive set of patches from the point cloud. These point cloud patches and their 2D projection images are processed using wavelets to produce multiscale local spectral features; moreover, we also extract global features of these patches using Pointnet++. Finally, a self-attention module is performed to fuse these local and global features, resulting in a distortion-sensitive quality score metric. We evaluate the Wave-PCT method on several point cloud quality assessment datasets using various metrics, and the experimental results indicate that the proposed framework exhibits outstanding and reliable performance when compared to various point cloud quality assessment methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Low-Overlap Point Cloud Registration With Transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1469 - 1473
  • [32] RST: Rough Set Transformer for Point Cloud Learning
    Sun, Xinwei
    Zeng, Kai
    SENSORS, 2023, 23 (22)
  • [33] MPCT: Multiscale Point Cloud Transformer With a Residual Network
    Wu, Yue
    Liu, Jiaming
    Gong, Maoguo
    Liu, Zhixiao
    Miao, Qiguang
    Ma, Wenping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3505 - 3516
  • [34] SparseFormer: Sparse transformer network for point cloud classification
    Wang, Yong
    Liu, Yangyang
    Zhou, Pengbo
    Geng, Guohua
    Zhang, Qi
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 24 - 32
  • [35] Adaptive Channel Encoding Transformer for Point Cloud Analysis
    Xu, Guoquan
    Cao, Hezhi
    Zhang, Yifan
    Ma, Yanxin
    Wan, Jianwei
    Xu, Ke
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT III, 2022, 13531 : 1 - 13
  • [36] A reversible transformer for LiDAR point cloud semantic segmentation
    Akwensi, Perpertual Hope
    Wang, Ruisheng
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 19 - 28
  • [37] Transformer-based Point Cloud Generation Network
    Xu, Rui
    Hui, Le
    Han, Yuehui
    Qian, Jianjun
    Xie, Jin
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4169 - 4177
  • [38] HiTPR: Hierarchical Transformer for Place Recognition in Point Cloud
    Hou, Zhixing
    Yan, Yan
    Xu, Chengzhong
    Kong, Hui
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 2612 - 2618
  • [39] GETr: A Geometric Equivariant Transformer for Point Cloud Registration
    Yu, Chang
    Zhang, Sanguo
    Shen, Li-Yong
    COMPUTER GRAPHICS FORUM, 2024, 43 (07)
  • [40] Geometric Transformer for Fast and Robust Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Guo, Yulan
    Peng, Yuxing
    Xu, Kai
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11133 - 11142