Wave-PCT: Wavelet point cloud transformer for point cloud quality assessment

被引:0
|
作者
Guo, Ziyou [1 ]
Huang, Zhen [2 ]
Gong, Wenyong [2 ]
Wu, Tieru [1 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Changchun, Peoples R China
[2] Jinan Univ, Dept Math, Guangzhou, Peoples R China
关键词
No-reference quality assessment; Wavelets; Transformer; Point cloud;
D O I
10.1016/j.eswa.2024.125039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud representation for real-world objects has seen a surge in interest recently, finding widespread applications in augmented reality, virtual reality, and autonomous driving. However, the process of acquiring, compressing, transmitting, and processing point cloud data often introduces unwanted distortions, highlighting the need for effective no-reference quality assessment methods for distorted point clouds. In this paper, we propose a Wavelet Point Cloud Transformer (Wave-PCT) method to assess the quality of point clouds without reference data. We start by performing patch sampling on a source point cloud, generating an extensive set of patches from the point cloud. These point cloud patches and their 2D projection images are processed using wavelets to produce multiscale local spectral features; moreover, we also extract global features of these patches using Pointnet++. Finally, a self-attention module is performed to fuse these local and global features, resulting in a distortion-sensitive quality score metric. We evaluate the Wave-PCT method on several point cloud quality assessment datasets using various metrics, and the experimental results indicate that the proposed framework exhibits outstanding and reliable performance when compared to various point cloud quality assessment methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Dynamic clustering transformer network for point cloud segmentation
    Lu, Dening
    Zhou, Jun
    Gao, Kyle
    Du, Jing
    Xu, Linlin
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 128
  • [42] Rotation-Invariant Transformer for Point Cloud Matching
    Yu, Hao
    Qin, Zheng
    Hou, Ji
    Saleh, Mahdi
    Li, Dongsheng
    Busam, Benjamin
    Ilic, Slobodan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5384 - 5393
  • [43] Point Cloud Transformer for Elementary Particle Signals Segmentation
    Nikolskaiia, A.
    Goncharov, P.
    Ososkov, G.
    Rusov, D.
    Starikov, D.
    PHYSICS OF PARTICLES AND NUCLEI, 2024, 55 (03) : 458 - 460
  • [44] Object Detection of Occlusion Point Cloud based on Transformer
    Zhou, Jing
    Zhou, Jian
    Lin, Teng Xing
    Gong, Zi Xin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [45] Lossy point cloud geometry compression based on Transformer
    Liu G.
    Zhang J.
    Ding D.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (02): : 634 - 642
  • [46] End-to-end point cloud registration with transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 58 (01)
  • [47] Self-positioning Point-based Transformer for Point Cloud Understanding
    Park, Jinyoung
    Lee, Sanghyeok
    Kim, Sihyeon
    Xiong, Yunyang
    Kim, Hyunwoo J.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21814 - 21823
  • [48] Point Spatio-Temporal Transformer Networks for Point Cloud Video Modeling
    Fan, Hehe
    Yang, Yi
    Kankanhalli, Mohan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2181 - 2192
  • [49] Snowflake Point Deconvolution for Point Cloud Completion and Generation With Skip-Transformer
    Xiang, Peng
    Wen, Xin
    Liu, Yu-Shen
    Cao, Yan-Pei
    Wan, Pengfei
    Zheng, Wen
    Han, Zhizhong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6320 - 6338
  • [50] SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer
    Xiang, Peng
    Wen, Xin
    Liu, Yu-Shen
    Cao, Yan-Pei
    Wan, Pengfei
    Zheng, Wen
    Han, Zhizhong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5479 - 5489