URINet: Unsupervised point cloud rotation invariant representation learning via semantic and structural reasoning

被引:0
|
作者
Wu, Qiuxia [1 ]
Su, Kunming [1 ]
机构
[1] South China Univ Technol, Guangzhou Higher Educ Mega Ctr, Guangzhou 510006, Peoples R China
关键词
Unsupervised learning; Point cloud analysis; Rotation invariance;
D O I
10.1016/j.cviu.2024.104136
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many rotation-invariant networks have been proposed to alleviate the interference caused by point cloud arbitrary rotations. These networks have demonstrated powerful representation learning capabilities. However, most of those methods rely on costly manually annotated supervision for model training. Moreover, they fail to reason the structural relations and lose global information. To address these issues, we present an unsupervised method for achieving comprehensive rotation invariant representations without human annotation. Specifically, we propose a novel encoder-decoder architecture named URINet, which learns a point cloud representation by combining local semantic and global structural information, and then reconstructs the input without rotation perturbation. In detail, the encoder is a two-branch network where the graph convolution based structural branch models the relationships among local regions to learn global structural knowledge and the semantic branch learns rotation invariant local semantic features. The two branches derive complementary information and explore the point clouds comprehensively. Furthermore, to avoid the self- reconstruction ambiguity brought by uncertain poses, a bidirectional alignment is proposed to measure the quality of reconstruction results without orientation knowledge. Extensive experiments on downstream tasks show that the proposed method significantly surpasses existing state-of-the-art methods on both synthetic and real-world datasets.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Active Learning for Point Cloud Semantic Segmentation via Spatial-Structural Diversity Reasoning
    Shao, Feifei
    Luo, Yawei
    Liu, Ping
    Chen, Jie
    Yang, Yi
    Lu, Yulei
    Xiao, Jun
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2575 - 2585
  • [2] Enhanced Local and Global Learning for Rotation-Invariant Point Cloud Representation
    Gu, Ruibin
    Wu, Qiuxia
    Li, Yuqiong
    Kang, Wenxiong
    Ng, Wing W. Y.
    Wang, Zhiyong
    [J]. IEEE MULTIMEDIA, 2022, 29 (04) : 24 - 37
  • [3] Rethinking local-to-global representation learning for rotation-invariant point cloud analysis
    Wang, Zhaoxuan
    Yu, Yunlong
    Li, Xianzhi
    [J]. PATTERN RECOGNITION, 2024, 154
  • [4] Unsupervised Point Cloud Representation Learning by Clustering and Neural Rendering
    Mei, Guofeng
    Saltori, Cristiano
    Ricci, Elisa
    Sebe, Nicu
    Wu, Qiang
    Zhang, Jian
    Poiesi, Fabio
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (08) : 3251 - 3269
  • [5] Rotation-Invariant Local-to-Global Representation Learning for 3D Point Cloud
    Kim, Seohyun
    Park, Jaeyoo
    Han, Bohyung
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] SGMNet: Learning Rotation-Invariant Point Cloud Representations via Sorted Gram Matrix
    Xu, Jianyun
    Tang, Xin
    Zhu, Yushi
    Sun, Jie
    Pu, Shiliang
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10448 - 10457
  • [7] Unsupervised Point Cloud Representation Learning With Deep Neural Networks: A Survey
    Xiao, Aoran
    Huang, Jiaxing
    Guan, Dayan
    Zhang, Xiaoqin
    Lu, Shijian
    Shao, Ling
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 11321 - 11339
  • [8] Geometric Invariant Representation Learning for 3D Point Cloud
    Li, Zongmin
    Zhang, Yupeng
    Bai, Yun
    [J]. 2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 1480 - 1485
  • [9] Unsupervised Domain Adaptation for Point Cloud Semantic Segmentation via Graph Matching
    Bian, Yikai
    Hui, Le
    Qian, Jianjun
    Xie, Jin
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 9899 - 9904
  • [10] Rotation-Invariant Point Cloud Representation for 3-D Model Recognition
    Wang, Yan
    Zhao, Yining
    Ying, Shihui
    Du, Shaoyi
    Gao, Yue
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10948 - 10956