Self-supervised rigid transformation equivariance for accurate 3D point cloud registration

被引:17
|
作者
Zhang, Zhiyuan [1 ]
Sun, Jiadai [1 ]
Dai, Yuchao [1 ]
Zhou, Dingfu [2 ]
Song, Xibin [2 ]
He, Mingyi [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian, Peoples R China
[2] Baidu Res & Natl Engn Lab Deep Learning Technol &, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Rigid transformation equivariance; Learned cost volume;
D O I
10.1016/j.patcog.2022.108784
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformation equivariance has been widely investigated in 3D point cloud representation learning for more informative descriptors, which formulates the change of the representation with respect to the transformation of the input point clouds explicitly. In this paper, we extend this property to the task of 3D point cloud registration and propose a r igid t ransformation e quivariance ( RTE ) for accurate 3D point cloud registration. Specifically, RTE formulates the change of the relative pose explicitly with respect to the rigid transformation of the input point clouds. To exploit RTE , we adopt a Siamese structure network with two shared registration branches. One focuses on the input pair of point clouds, and the other one focuses on the new pair achieved by applying two random rigid transformations to the input point clouds respectively. Since the change of the two output relative poses has been predicted according to RTE , a new additional self-supervised loss is obtained to supervise the training. This general network structure can be integrated with most learning-based point cloud registration frameworks easily to improve the performance. Our method adopts the state-of-the-art virtual point-based pipelines as our shared branches, in which we propose a data-driven matching based on l earned c ost v olume (LCV) rather than traditional hand-crafted matching strategies. Experimental evaluations on both synthetic datasets and real datasets validate the effectiveness of our proposed framework. The source code will be made public.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] HumanReg: Self-supervised Non-rigid Registration of Human Point Cloud
    Chen, Yifan
    Pan, Zhiyu
    Zhong, Zhicheng
    Guo, Wenxuan
    Feng, Jianjiang
    Zhou, Jie
    [J]. 2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 954 - 964
  • [2] Self-Supervised Pretraining of 3D Features on any Point-Cloud
    Zhang, Zaiwei
    Girdhar, Rohit
    Joulin, Armand
    Misra, Ishan
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10232 - 10243
  • [3] Self-supervised Wide Baseline Visual Servoing via 3D Equivariance
    Huh, Jinwook
    Hong, Jungseok
    Garg, Suveer
    Park, Hyun Soo
    Isler, Volkan
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 2227 - 2233
  • [4] Self-Supervised Point Set Local Descriptors for Point Cloud Registration
    Yuan, Yijun
    Borrmann, Dorit
    Hou, Jiawei
    Ma, Yuexin
    Nuechter, Andreas
    Schwertfeger, Soren
    [J]. SENSORS, 2021, 21 (02) : 1 - 18
  • [5] Rigid pairwise 3D point cloud registration: A survey
    Lyu, Mengjin
    Yang, Jie
    Qi, Zhiquan
    Xu, Ruijie
    Liu, Jiabin
    [J]. PATTERN RECOGNITION, 2024, 151
  • [6] Point Cloud Registration with Self-supervised Feature Learning and Beam Search
    Mei, Guofeng
    [J]. 2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 82 - 89
  • [7] Exploiting Transformation Invariance and Equivariance for Self-supervised Sound Localisation
    Liu, Jinxiang
    Ju, Chen
    Xie, Weidi
    Zhang, Ya
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3742 - 3753
  • [8] Rigid 3D Point Cloud Registration Based on Point Feature Histograms
    Wang, Xi
    Zhang, Xutang
    [J]. PROCEEDINGS OF THE 2017 2ND INTERNATIONAL CONFERENCE ON MACHINERY, ELECTRONICS AND CONTROL SIMULATION (MECS 2017), 2017, 138 : 543 - 550
  • [9] Self-Supervised Rigid Registration for Small Images
    Ma, Ruoxin
    Zhao, Shengjie
    Cheng, Samuel
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (01): : 180 - 194
  • [10] Self-supervised Learning with Multi-view Rendering for 3D Point Cloud Analysis
    Tran, Bach
    Hua, Binh-Son
    Tran, Anh Tuan
    Hoai, Minh
    [J]. COMPUTER VISION - ACCV 2022, PT I, 2023, 13841 : 413 - 431