Self-supervised rigid transformation equivariance for accurate 3D point cloud registration

被引:17
|
作者
Zhang, Zhiyuan [1 ]
Sun, Jiadai [1 ]
Dai, Yuchao [1 ]
Zhou, Dingfu [2 ]
Song, Xibin [2 ]
He, Mingyi [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian, Peoples R China
[2] Baidu Res & Natl Engn Lab Deep Learning Technol &, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Rigid transformation equivariance; Learned cost volume;
D O I
10.1016/j.patcog.2022.108784
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transformation equivariance has been widely investigated in 3D point cloud representation learning for more informative descriptors, which formulates the change of the representation with respect to the transformation of the input point clouds explicitly. In this paper, we extend this property to the task of 3D point cloud registration and propose a r igid t ransformation e quivariance ( RTE ) for accurate 3D point cloud registration. Specifically, RTE formulates the change of the relative pose explicitly with respect to the rigid transformation of the input point clouds. To exploit RTE , we adopt a Siamese structure network with two shared registration branches. One focuses on the input pair of point clouds, and the other one focuses on the new pair achieved by applying two random rigid transformations to the input point clouds respectively. Since the change of the two output relative poses has been predicted according to RTE , a new additional self-supervised loss is obtained to supervise the training. This general network structure can be integrated with most learning-based point cloud registration frameworks easily to improve the performance. Our method adopts the state-of-the-art virtual point-based pipelines as our shared branches, in which we propose a data-driven matching based on l earned c ost v olume (LCV) rather than traditional hand-crafted matching strategies. Experimental evaluations on both synthetic datasets and real datasets validate the effectiveness of our proposed framework. The source code will be made public.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Self-Supervised 2D/3D Registration for X-Ray to CT Image Fusion
    Jaganathan, Srikrishna
    Kukla, Maximilian
    Wang, Jian
    Shetty, Karthik
    Maier, Andreas
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2787 - 2797
  • [42] Learning multiview 3D point cloud registration
    Gojcic, Zan
    Zhou, Caifa
    Wegner, Jan D.
    Guibas, Leonidas J.
    Birdal, Tolga
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1756 - 1766
  • [43] 3D POINT CLOUD REGISTRATION WITH SHAPE CONSTRAINT
    Agarwal, Swapna
    Bhowmick, Brojeshwar
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2199 - 2203
  • [44] Hierarchical Optimization of 3D Point Cloud Registration
    Liu, Huikai
    Zhang, Yue
    Lei, Linjian
    Xie, Hui
    Li, Yan
    Sun, Shengli
    [J]. SENSORS, 2020, 20 (23) : 1 - 20
  • [45] A Framework for an Accurate Point Cloud Based Registration of Full 3D Human Body Scans
    Golyanik, Vladislav
    Reis, Gerd
    Taetz, Bertram
    Stricker, Didier
    [J]. PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 67 - 72
  • [46] Sampling locally, hypothesis globally: accurate 3D point cloud registration with a RANSAC variant
    Yuxin Cheng
    Zhiqiang Huang
    Siwen Quan
    Xinyue Cao
    Shikun Zhang
    Jiaqi Yang
    [J]. Visual Intelligence, 1 (1):
  • [47] 3D Rigid Registration of CAD Point-Clouds
    Hattab, Ammar
    Taubin, Gabriel
    [J]. PROCEEDINGS 2018 INTERNATIONAL CONFERENCE ON COMPUTING SCIENCES AND ENGINEERING (ICCSE), 2018,
  • [48] SC3K: Self-supervised and Coherent 3D Keypoints Estimation from Rotated, Noisy, and Decimated Point Cloud Data
    Zohaib, Mohammad
    Del Bue, Alessio
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22452 - 22462
  • [49] Joint Supervised and Self-Supervised Learning for 3D Real World Challenges
    Alliegro, Antonio
    Boscaini, Davide
    Tommasi, Tatiana
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6718 - 6725
  • [50] Improved Feature Point Algorithm for 3D Point Cloud Registration
    Kamencay, Patrik
    Sinko, Martin
    Hudec, Robert
    Benco, Miroslav
    Radil, Roman
    [J]. 2019 42ND INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2019, : 517 - 520