Robust Point Cloud Registration Framework Based on Deep Graph Matching

被引:0
|
作者
Fu, Kexue [1 ]
Liu, Shaolei [1 ]
Luo, Xiaoyuan [1 ]
Wang, Manning [1 ]
机构
[1] Fudan Univ, Digital Med Res Ctr, Sch Basic Med Sci, Shanghai Key Lab Med Image Comp & Comp Assisted I, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
HISTOGRAMS;
D O I
10.1109/CVPR46437.2021.00878
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point cloud registration is a fundamental problem in computer vision and robotics. Recently, learning-based point cloud registration methods have made great progress. However, these methods are sensitive to outliers, which lead to more incorrect correspondences. In this paper, we propose a novel deep graph matching-based framework for point cloud registration. Specifically, we first transform point clouds into graphs and extract deep features for each point. Then, we develop a module based on deep graph matching to calculate a soft correspondence matrix. By using graph matching, not only the local geometry of each point but also its structure and topology in a larger range are considered in establishing correspondences, so that more correct correspondences are found. We train the network with a loss directly defined on the correspondences, and in the test stage the soft correspondences are transformed into hard one-to-one correspondences so that registration can be performed by singular value decomposition. Furthermore, we introduce a transformer-based method to generate edges for graph construction, which further improves the quality of the correspondences. Extensive experiments on registering clean, noisy, partial-to-partial and unseen category point clouds show that the proposed method achieves state-of-the-art performance. The code will be made publicly available at hups://github.com/fukexue/RGM.
引用
收藏
页码:8889 / 8898
页数:10
相关论文
共 50 条
  • [1] Robust Point Cloud Registration Framework Based on Deep Graph Matching
    Fu, Kexue
    Luo, Jiazheng
    Luo, Xiaoyuan
    Liu, Shaolei
    Zhang, Chenxi
    Wang, Manning
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 6183 - 6195
  • [2] Deep Correspondence Matching Based Robust Point Cloud Registration of Profiled Parts
    Peng, Weixing
    Wang, Yaonan
    Zhang, Hui
    Cao, Yihong
    Zhao, Jiawen
    Jiang, Yiming
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (02) : 2129 - 2143
  • [3] A Weakly Supervised Graph Deep Learning Framework for Point Cloud Registration
    Sun, Lan
    Zhang, Zhenxin
    Zhong, Ruofei
    Chen, Dong
    Zhang, Liqiang
    Zhu, Lin
    Wang, Qiang
    Wang, Guo
    Zou, Jianjun
    Wang, Yu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Graph Matching Optimization Network for Point Cloud Registration
    Wu, Qianliang
    Shen, Yaqi
    Jiang, Haobo
    Mei, Guofeng
    Ding, Yaqing
    Luo, Lei
    Xie, Jin
    Yang, Jian
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5320 - 5325
  • [5] Deep Semantic Graph Matching for Large-Scale Outdoor Point Cloud Registration
    Liu, Shaocong
    Wang, Tao
    Zhang, Yan
    Zhou, Ruqin
    Li, Li
    Dai, Chenguang
    Zhang, Yongsheng
    Wang, Longguang
    Wang, Hanyun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 12
  • [6] Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Peng, Yuxing
    Xu, Kai
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5394 - 5403
  • [7] Full Transformer Framework for Robust Point Cloud Registration With Deep Information Interaction
    Chen, Guangyan
    Wang, Meiling
    Zhang, Qingxiang
    Yuan, Li
    Yue, Yufeng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [8] Robust point-cloud registration based on dense point matching and probabilistic modeling
    Netto, Gustavo Marques
    Oliveira, Manuel M.
    [J]. VISUAL COMPUTER, 2022, 38 (9-10): : 3217 - 3230
  • [9] Robust point-cloud registration based on dense point matching and probabilistic modeling
    Gustavo Marques Netto
    Manuel M. Oliveira
    [J]. The Visual Computer, 2022, 38 : 3217 - 3230
  • [10] Graph-matching-based correspondence search for nonrigid point cloud registration
    Chang, Seunggyu
    Ahn, Chanho
    Lee, Minsik
    Oh, Songhwai
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 192