Slice Transformer and Self-supervised Learning for 6DoF Localization in 3D Point Cloud Maps

被引:0
|
作者
Ibrahim, Muhammad [1 ]
Akhtar, Naveed [1 ]
Anwar, Saeed [2 ]
Wise, Michael [1 ]
Mian, Ajmal [1 ]
机构
[1] Univ Western Australia, Dept Comp Sci, Perth, WA, Australia
[2] King Fahad Univ Petr & Minerals KFUPM, Dhahran, Saudi Arabia
基金
澳大利亚研究理事会;
关键词
D O I
10.1109/ICRA48891.2023.10161128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Precise localization is critical for autonomous vehicles. We present a self-supervised learning method that employs transformers for the first time for the task of outdoor localization using LiDAR data. We propose a pre-text task that reorganizes the slices of a 360. LiDAR scan to leverage its axial properties. Our model, called Slice Transformer, employs multi-head attention while systematically processing the slices. To the best of our knowledge, this is the first instance of leveraging multi-head attention for outdoor point clouds. We additionally introduce the Perth-WA dataset, which provides a large-scale LiDAR map of Perth city in Western Australia, covering similar to 4km(2) area. Localization annotations are provided for Perth-WA. The proposed localization method is thoroughly evaluated on Perth-WA and Appollo-SouthBay datasets. We also establish the efficacy of our self-supervised learning approach for the common downstream task of object classification using ModelNet40 and ScanNN datasets. The code and Perth-WA data will be publicly released.
引用
收藏
页码:11763 / 11770
页数:8
相关论文
共 50 条
  • [21] 3D Human Pose Machines with Self-Supervised Learning
    Wang, Keze
    Lin, Liang
    Jiang, Chenhan
    Qian, Chen
    Wei, Pengxu
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) : 1069 - 1082
  • [22] Self-Supervised Learning of Detailed 3D Face Reconstruction
    Chen, Yajing
    Wu, Fanzi
    Wang, Zeyu
    Song, Yibing
    Ling, Yonggen
    Bao, Linchao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8696 - 8705
  • [23] Self-Supervised Deep Learning for 3D Gravity Inversion
    Li, Yinshuo
    Jia, Zhuo
    Lu, Wenkai
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [24] Self-Supervised Online Learning of Appearance for 3D Tracking
    Lee, Bhoram
    Lee, Daniel D.
    [J]. 2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 4930 - 4937
  • [25] Self-Supervised Deep Learning for 3D Gravity Inversion
    Li, Yinshuo
    Jia, Zhuo
    Lu, Wenkai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] Joint Supervised and Self-Supervised Learning for 3D Real World Challenges
    Alliegro, Antonio
    Boscaini, Davide
    Tommasi, Tatiana
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6718 - 6725
  • [27] Self-supervised single-view 3D point cloud reconstruction through GAN inversion
    Li, Ying
    Guo, HaoYu
    Sheng, Huankun
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (14): : 21365 - 21393
  • [28] Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-supervised Learning
    Yeung, Pak-Hei
    Namburete, Ana I. L.
    Xie, Weidi
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 69 - 79
  • [29] Robust Mapping and Localization in Offline 3D Point Cloud Maps
    He, Guo
    Zhang, Fei
    Li, Xiang
    Shang, Weiwei
    [J]. 2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 765 - 770
  • [30] Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning
    Sheng, Xiaoxiao
    Shen, Zhiqiang
    Xiao, Gang
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9802 - 9810