GPA-3D: Geometry-aware Prototype Alignment for Unsupervised Domain Adaptive 3D Object Detection from Point Clouds

被引:1
|
作者
Li, Ziyu [1 ,2 ]
Guo, Jingming [2 ]
Cao, Tongtong [2 ]
Bingbing, Liu [2 ]
Yang, Wankou [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing, Peoples R China
[2] Huawei Noahs Ark Lab, Montreal, PQ, Canada
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCV51070.2023.00588
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
LiDAR-based 3D detection has made great progress in recent years. However, the performance of 3D detectors is considerably limited when deployed in unseen environments, owing to the severe domain gap problem. Existing domain adaptive 3D detection methods do not adequately consider the problem of the distributional discrepancy in feature space, thereby hindering generalization of detectors across domains. In this work, we propose a novel unsupervised domain adaptive 3D detection framework, namely Geometry-aware Prototype Alignment (GPA-3D), which explicitly leverages the intrinsic geometric relationship from point cloud objects to reduce the feature discrepancy, thus facilitating cross-domain transferring. Specifically, GPA- 3D assigns a series of tailored and learnable prototypes to point cloud objects with distinct geometric structures. Each prototype aligns BEV (bird's-eye-view) features derived from corresponding point cloud objects on source and target domains, reducing the distributional discrepancy and achieving better adaptation. The evaluation results obtained on various benchmarks, including Waymo, nuScenes and KITTI, demonstrate the superiority of our GPA-3D over the state-of-the-art approaches for different adaptation scenarios. The MindSpore version code will be publicly available at https://github.com/ Liz66666/GPA3D.
引用
收藏
页码:6371 / 6380
页数:10
相关论文
共 50 条
  • [1] GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network
    Ruan, Hao
    Xu, Bingrong
    Gao, Junbin
    Liu, Lianguang
    Lv, Junting
    Sheng, Yin
    Zeng, Zhigang
    2022 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS, CBS, 2022, : 190 - 195
  • [2] Unsupervised 3D Object Segmentation of Point Clouds by Geometry Consistency
    Song Z.
    Yang B.
    IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46 (12) : 1 - 14
  • [3] Geometry-Aware Self-Training for Unsupervised Domain Adaptation on Object Point Clouds
    Zou, Longkun
    Tang, Hui
    Chen, Ke
    Jia, Kui
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6383 - 6392
  • [4] Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
    Rhodin, Helge
    Salzmann, Mathieu
    Fua, Pascal
    COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 765 - 782
  • [5] SEGANet: 3D object detection with shape-enhancement and geometry-aware network
    Zhou, Jing
    Hu, Yiyu
    Lai, Zhongyuan
    Wang, Tianjiang
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 110
  • [6] BADet: Boundary-Aware 3D Object Detection from Point Clouds
    Qian, Rui
    Lai, Xin
    Li, Xirong
    PATTERN RECOGNITION, 2022, 125
  • [7] CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Clouds
    Wang, Haiyang
    Ding, Lihe
    Dong, Shaocong
    Shi, Shaoshuai
    Li, Aoxue
    Li, Jianan
    Li, Zhenguo
    Wang, Liwei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [8] Unsupervised Subcategory Domain Adaptive Network for 3D Object Detection in LiDAR
    Wang, Zhiyu
    Wang, Li
    Xiao, Liang
    Dai, Bin
    ELECTRONICS, 2021, 10 (08)
  • [9] Geometry-Aware Scattering Compensation for 3D Printing
    Sumin, Denis
    Rittig, Tobias
    Babaei, Vahid
    Nindel, Thomas
    Wilkie, Alexander
    Didyk, Piotr
    Bickel, Bernd
    Krivanek, Jaroslav
    Myszkowski, Karol
    Weyrich, Tim
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04):
  • [10] 3D-VField: Adversarial Augmentation of Point Clouds for Domain Generalization in 3D Object Detection
    Lehner, Alexander
    Gasperini, Stefano
    Marcos-Ramiro, Alvaro
    Schmidt, Michael
    Mahani, Mohammad-Ali Nikouei
    Navab, Nassir
    Busam, Benjamin
    Tombari, Federico
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17274 - 17283