Slice Transformer and Self-supervised Learning for 6DoF Localization in 3D Point Cloud Maps

被引:0
|
作者
Ibrahim, Muhammad [1 ]
Akhtar, Naveed [1 ]
Anwar, Saeed [2 ]
Wise, Michael [1 ]
Mian, Ajmal [1 ]
机构
[1] Univ Western Australia, Dept Comp Sci, Perth, WA, Australia
[2] King Fahad Univ Petr & Minerals KFUPM, Dhahran, Saudi Arabia
基金
澳大利亚研究理事会;
关键词
D O I
10.1109/ICRA48891.2023.10161128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Precise localization is critical for autonomous vehicles. We present a self-supervised learning method that employs transformers for the first time for the task of outdoor localization using LiDAR data. We propose a pre-text task that reorganizes the slices of a 360. LiDAR scan to leverage its axial properties. Our model, called Slice Transformer, employs multi-head attention while systematically processing the slices. To the best of our knowledge, this is the first instance of leveraging multi-head attention for outdoor point clouds. We additionally introduce the Perth-WA dataset, which provides a large-scale LiDAR map of Perth city in Western Australia, covering similar to 4km(2) area. Localization annotations are provided for Perth-WA. The proposed localization method is thoroughly evaluated on Perth-WA and Appollo-SouthBay datasets. We also establish the efficacy of our self-supervised learning approach for the common downstream task of object classification using ModelNet40 and ScanNN datasets. The code and Perth-WA data will be publicly released.
引用
收藏
页码:11763 / 11770
页数:8
相关论文
共 50 条
  • [1] Self-Supervised Domain Adaptation for 6DoF Pose Estimation
    Jin, Juseong
    Jeong, Eunju
    Cho, Joonmyun
    Kim, Young-Gon
    [J]. IEEE ACCESS, 2024, 12 : 101528 - 101535
  • [2] Self-supervised Learning with Multi-view Rendering for 3D Point Cloud Analysis
    Tran, Bach
    Hua, Binh-Son
    Tran, Anh Tuan
    Hoai, Minh
    [J]. COMPUTER VISION - ACCV 2022, PT I, 2023, 13841 : 413 - 431
  • [3] Self-Supervised Point Cloud Understanding via Mask Transformer and Contrastive Learning
    Wang, Di
    Yang, Zhi-Xin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (01): : 184 - 191
  • [4] Self-Supervised Pretraining of 3D Features on any Point-Cloud
    Zhang, Zaiwei
    Girdhar, Rohit
    Joulin, Armand
    Misra, Ishan
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10232 - 10243
  • [5] Self-Supervised Learning of Local Features in 3D Point Clouds
    Thabet, Ali
    Alwassel, Humam
    Ghanem, Bernard
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4048 - 4052
  • [6] SegContrast: 3D Point Cloud Feature Representation Learning Through Self-Supervised Segment Discrimination
    Nunes, Lucas
    Marcuzzi, Rodrigo
    Chen, Xieyuanli
    Behley, Jens
    Stachniss, Cyrill
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 2116 - 2123
  • [7] CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding
    Afham, Mohamed
    Dissanayake, Isuru
    Dissanayake, Dinithi
    Dharmasiri, Amaya
    Thilakarathna, Kanchana
    Rodrigo, Ranga
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9892 - 9902
  • [8] Self-Supervised 3D Action Representation Learning With Skeleton Cloud Colorization
    Yang, Siyuan
    Liu, Jun
    Lu, Shijian
    Hwa, Er Meng
    Hu, Yongjian
    Kot, Alex C.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (01) : 509 - 524
  • [9] Self-Supervised Learning on 3D Point Clouds by Learning Discrete Generative Models
    Eckart, Benjamin
    Yuan, Wentao
    Liu, Chao
    Kautz, Jan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8244 - 8253
  • [10] Self-supervised rigid transformation equivariance for accurate 3D point cloud registration
    Zhang, Zhiyuan
    Sun, Jiadai
    Dai, Yuchao
    Zhou, Dingfu
    Song, Xibin
    He, Mingyi
    [J]. PATTERN RECOGNITION, 2022, 130