HGL: Hierarchical Geometry Learning for Test-Time Adaptation in 3D Point Cloud Segmentation

被引:0
|
作者
Zou, Tianpei [1 ]
Qui, Sanqing [1 ]
Li, Zhijun [1 ]
Knoll, Alois [2 ]
He, Lianghua [1 ]
Chen, Guang [1 ]
Jiang, Changjun [1 ]
机构
[1] Tongji Univ, Shanghai, Peoples R China
[2] Tech Univ Munich, Munich, Germany
来源
基金
中国国家自然科学基金;
关键词
Online domain adaptation; point cloud segmentation; hierarchical framework; geometric learning;
D O I
10.1007/978-3-031-73001-6_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point cloud segmentation has received significant interest for its growing applications. However, the generalization ability of models suffers in dynamic scenarios due to the distribution shift between test and training data. To promote robustness and adaptability across diverse scenarios, test-time adaptation (TTA) has recently been introduced. Nevertheless, most existing TTA methods are developed for images, and limited approaches applicable to point clouds ignore the inherent hierarchical geometric structures in point cloud streams, i.e., local (point-level), global (object-level), and temporal (frame-level) structures. In this paper, we delve into TTA in 3D point cloud segmentation and propose a novel Hierarchical Geometry Learning (HGL) framework. HGL comprises three complementary modules from local, global to temporal learning in a bottom-up manner. Technically, we first construct a local geometry learning module for pseudo-label generation. Next, we build prototypes from the global geometry perspective for pseudo-label fine-tuning. Furthermore, we introduce a temporal consistency regularization module to mitigate negative transfer. Extensive experiments on four datasets demonstrate the effectiveness and superiority of our HGL. Remarkably, on the SynLiDAR to SemanticKITTI task, HGL achieves an overall mIoU of 46.91%, improving GIPSO by 3.0% and significantly reducing the required adaptation time by 80%. The code is available at https://github.com/tpzou/HGL.
引用
收藏
页码:19 / 36
页数:18
相关论文
共 50 条
  • [21] Leaves Segmentation in 3D Point Cloud
    Gelard, William
    Herbulot, Ariane
    Devy, Michel
    Debaeke, Philippe
    McCormick, Ryan F.
    Truong, Sandra K.
    Mullet, John
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS (ACIVS 2017), 2017, 10617 : 664 - 674
  • [22] 3D Point Cloud Segmentation: A survey
    Anh Nguyen
    Le, Bac
    PROCEEDINGS OF THE 2013 6TH IEEE CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS (RAM), 2013, : 225 - 230
  • [23] FAST 3D POINT CLOUD SEGMENTATION USING SUPERVOXELS WITH GEOMETRY AND COLOR FOR 3D SCENE UNDERSTANDING
    Verdoja, Francesco
    Thomas, Diego
    Sugimoto, Akihiro
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 1285 - 1290
  • [24] Rotation-invariant Hierarchical Segmentation on Poincare Ball for 3D Point Cloud
    Onghena, Pierre
    Gigli, Leonardo
    Velasco-Forero, Santiago
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1757 - 1766
  • [25] On-the-Fly Test-time Adaptation for Medical Image Segmentation
    Valanarasu, Jeya Maria Jose
    Guo, Pengfei
    Vibashan, V. S.
    Patel, Vishal M.
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 586 - 598
  • [26] LEARNING-BASED LOSSLESS COMPRESSION OF 3D POINT CLOUD GEOMETRY
    Dat Thanh Nguyen
    Quach, Maurice
    Valenzise, Giuseppe
    Duhamel, Pierre
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4220 - 4224
  • [27] Improving Point Cloud Semantic Segmentation by Learning 3D Object Detection
    Unal, Ozan
    Van Gool, Luc
    Dai, Dengxin
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2949 - 2958
  • [28] 3D Tooth Instance Segmentation Learning Objectness and Affinity in Point Cloud
    Tian, Yan
    Zhang, Yujie
    Chen, Wei-Gang
    Liu, Dongsheng
    Wang, Huiyan
    Xu, Huayi
    Han, Jianfeng
    Ge, Yiwen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)
  • [29] Hierarchical Optimization of 3D Point Cloud Registration
    Liu, Huikai
    Zhang, Yue
    Lei, Linjian
    Xie, Hui
    Li, Yan
    Sun, Shengli
    SENSORS, 2020, 20 (23) : 1 - 20
  • [30] Stratified Transformer for 3D Point Cloud Segmentation
    Lai, Xin
    Liu, Jianhui
    Jiang, Li
    Wang, Liwei
    Zhao, Hengshuang
    Liu, Shu
    Qi, Xiaojuan
    Jia, Jiaya
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8490 - 8499