PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer

被引:4
|
作者
She, Rui [1 ]
Kang, Qiyu [1 ]
Wang, Sijie [1 ]
Tay, Wee Peng [1 ]
Zhao, Kai [1 ]
Song, Yang [1 ]
Geng, Tianyu [1 ]
Xu, Yi [1 ]
Navarro, Diego Navarro [2 ]
Hartmannsgruber, Andreas [2 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Continental Automot Singapore Pte Ltd, Singapore 339780, Singapore
关键词
Point cloud compression; Three-dimensional displays; Feature extraction; Kernel; Heating systems; Iterative methods; Neural networks; Graph neural network (GNN); heat kernel signature; neural diffusion; point cloud registration; CONSENSUS;
D O I
10.1109/TGRS.2024.3351286
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Point cloud registration is a fundamental technique in 3-D computer vision with applications in graphics, autonomous driving, and robotics. However, registration tasks under challenging conditions, under which noise or perturbations are prevalent, can be difficult. We propose a robust point cloud registration approach that leverages graph neural partial differential equations (PDEs) and heat kernel signatures. Our method first uses graph neural PDE modules to extract high-dimensional features from point clouds by aggregating information from the 3-D point neighborhood, thereby enhancing the robustness of the feature representations. Then, we incorporate heat kernel signatures into an attention mechanism to efficiently obtain corresponding keypoints. Finally, a singular value decomposition (SVD) module with learnable weights is used to predict the transformation between two point clouds. Empirical experiments on a 3-D point cloud dataset demonstrate that our approach not only achieves state-of-the-art performance for point cloud registration but also exhibits better robustness to additive noise or 3-D shape perturbations.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] Geometric Transformer for Fast and Robust Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Guo, Yulan
    Peng, Yuxing
    Xu, Kai
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11133 - 11142
  • [2] GeoTransformer: Fast and Robust Point Cloud Registration With Geometric Transformer
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Guo, Yulan
    Peng, Yuxing
    Ilic, Slobodan
    Hu, Dewen
    Xu, Kai
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9806 - 9821
  • [3] Diffusion Transformer for point cloud registration: digital modeling of cultural heritage
    An, Li
    Zhou, Pengbo
    Zhou, Mingquan
    Wang, Yong
    Geng, Guohua
    [J]. HERITAGE SCIENCE, 2024, 12 (01):
  • [4] Full Transformer Framework for Robust Point Cloud Registration With Deep Information Interaction
    Chen, Guangyan
    Wang, Meiling
    Zhang, Qingxiang
    Yuan, Li
    Yue, Yufeng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (10) : 1 - 15
  • [5] GTGMM: geometry transformer and Gaussian Mixture Models for robust point cloud registration
    Zhang, Haibo
    Hai, Linqi
    Sun, Haoran
    Wang, Xu
    Li, Ruoxue
    Geng, Guohua
    Zhou, Mingquan
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024,
  • [6] A Robust Loss for Point Cloud Registration
    Deng, Zhi
    Yao, Yuxin
    Deng, Bailin
    Zhang, Juyong
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6118 - 6127
  • [7] OAAFormer: Robust and Efficient Point Cloud Registration Through Overlapping-Aware Attention in Transformer
    Gao, Jun-Jie
    Dong, Qiu-Jie
    Wang, Rui-An
    Chen, Shuang-Min
    Xin, Shi-Qing
    Tu, Chang-He
    Wang, Wenping
    [J]. Journal of Computer Science and Technology, 2024, 39 (04) : 755 - 770
  • [8] Low-Overlap Point Cloud Registration With Transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1469 - 1473
  • [9] MATR: Multicompound Adaptive Transformer for Point Cloud Registration
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhou, Mingquan
    Li, Kang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, : 12903 - 12912
  • [10] End-to-end point cloud registration with transformer
    Wang, Yong
    Zhou, Pengbo
    Geng, Guohua
    An, Li
    Zhang, Qi
    [J]. Artificial Intelligence Review, 2025, 58 (01)