GPA-3D: Geometry-aware Prototype Alignment for Unsupervised Domain Adaptive 3D Object Detection from Point Clouds

被引:1
|
作者
Li, Ziyu [1 ,2 ]
Guo, Jingming [2 ]
Cao, Tongtong [2 ]
Bingbing, Liu [2 ]
Yang, Wankou [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing, Peoples R China
[2] Huawei Noahs Ark Lab, Montreal, PQ, Canada
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCV51070.2023.00588
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
LiDAR-based 3D detection has made great progress in recent years. However, the performance of 3D detectors is considerably limited when deployed in unseen environments, owing to the severe domain gap problem. Existing domain adaptive 3D detection methods do not adequately consider the problem of the distributional discrepancy in feature space, thereby hindering generalization of detectors across domains. In this work, we propose a novel unsupervised domain adaptive 3D detection framework, namely Geometry-aware Prototype Alignment (GPA-3D), which explicitly leverages the intrinsic geometric relationship from point cloud objects to reduce the feature discrepancy, thus facilitating cross-domain transferring. Specifically, GPA- 3D assigns a series of tailored and learnable prototypes to point cloud objects with distinct geometric structures. Each prototype aligns BEV (bird's-eye-view) features derived from corresponding point cloud objects on source and target domains, reducing the distributional discrepancy and achieving better adaptation. The evaluation results obtained on various benchmarks, including Waymo, nuScenes and KITTI, demonstrate the superiority of our GPA-3D over the state-of-the-art approaches for different adaptation scenarios. The MindSpore version code will be publicly available at https://github.com/ Liz66666/GPA3D.
引用
收藏
页码:6371 / 6380
页数:10
相关论文
共 50 条
  • [31] Enhanced Vote Network for 3D Object Detection in Point Clouds
    Zhong, Min
    Zeng, Gang
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6624 - 6631
  • [32] A robust scheme for copy detection of 3D object point clouds
    Yang, Jiaqi
    Lu, Xuequan
    Chen, Wenzhi
    NEUROCOMPUTING, 2022, 510 : 181 - 192
  • [33] Relation Graph Network for 3D Object Detection in Point Clouds
    Feng, Mingtao
    Gilani, Syed Zulqarnain
    Wang, Yaonan
    Zhang, Liang
    Mian, Ajmal
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 92 - 107
  • [34] Boosting 3D Object Detection by Simulating Multimodality on Point Clouds
    Zheng, Wu
    Hong, Mingxuan
    Jiang, Li
    Fu, Chi-Wing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 13628 - 13637
  • [35] 3D Object Detection on Synthetic Point Clouds for Railway Applications
    Neri, Michael
    Battisti, Federica
    2022 10TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2022,
  • [36] Weakly Supervised Point Clouds Transformer for 3D Object Detection
    Tang, Zuojin
    Sun, Bo
    Ma, Tongwei
    Li, Daosheng
    Xu, Zhenhui
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3948 - 3955
  • [37] Learning Deformable Network for 3D Object Detection on Point Clouds
    Zhang, Wanyi
    Fu, Xiuhua
    Li, Wei
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [38] 3D Object Detection Algorithm Based on Raw Point Clouds
    Zhang, Dongdong
    Guo, Jie
    Chen, Yang
    Computer Engineering and Applications, 2024, 59 (03) : 209 - 217
  • [39] Optimisation of the PointPillars network for 3D object detection in point clouds
    Stanisz, Joanna
    Lis, Konrad
    Kryjak, Tomasz
    Gorgon, Marek
    2020 SIGNAL PROCESSING - ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS (SPA), 2020, : 122 - 127
  • [40] Point-Denoise: Unsupervised outlier detection for 3D point clouds enhancement
    Regaya, Yousra
    Fadli, Fodil
    Amira, Abbes
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (18) : 28161 - 28177