HGL: Hierarchical Geometry Learning for Test-Time Adaptation in 3D Point Cloud Segmentation

被引:0
|
作者
Zou, Tianpei [1 ]
Qui, Sanqing [1 ]
Li, Zhijun [1 ]
Knoll, Alois [2 ]
He, Lianghua [1 ]
Chen, Guang [1 ]
Jiang, Changjun [1 ]
机构
[1] Tongji Univ, Shanghai, Peoples R China
[2] Tech Univ Munich, Munich, Germany
来源
基金
中国国家自然科学基金;
关键词
Online domain adaptation; point cloud segmentation; hierarchical framework; geometric learning;
D O I
10.1007/978-3-031-73001-6_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point cloud segmentation has received significant interest for its growing applications. However, the generalization ability of models suffers in dynamic scenarios due to the distribution shift between test and training data. To promote robustness and adaptability across diverse scenarios, test-time adaptation (TTA) has recently been introduced. Nevertheless, most existing TTA methods are developed for images, and limited approaches applicable to point clouds ignore the inherent hierarchical geometric structures in point cloud streams, i.e., local (point-level), global (object-level), and temporal (frame-level) structures. In this paper, we delve into TTA in 3D point cloud segmentation and propose a novel Hierarchical Geometry Learning (HGL) framework. HGL comprises three complementary modules from local, global to temporal learning in a bottom-up manner. Technically, we first construct a local geometry learning module for pseudo-label generation. Next, we build prototypes from the global geometry perspective for pseudo-label fine-tuning. Furthermore, we introduce a temporal consistency regularization module to mitigate negative transfer. Extensive experiments on four datasets demonstrate the effectiveness and superiority of our HGL. Remarkably, on the SynLiDAR to SemanticKITTI task, HGL achieves an overall mIoU of 46.91%, improving GIPSO by 3.0% and significantly reducing the required adaptation time by 80%. The code is available at https://github.com/tpzou/HGL.
引用
收藏
页码:19 / 36
页数:18
相关论文
共 50 条
  • [31] 3D IMAGE SEGMENTATION SUPPORTED BY A POINT CLOUD
    Kosa, Balazs
    Mikula, Karol
    Uba, Markjoe Olunna
    Weberling, Antonia
    Christodoulou, Neophytos
    Zernicka-Goetz, Magdalena
    DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2021, 14 (03): : 971 - 985
  • [32] Test-time Personalizable Forecasting of 3D Human Poses
    Cui, Qiongjie
    Sun, Huaijiang
    Lu, Jianfeng
    Li, Weiqing
    Li, Bin
    Yi, Hongwei
    Wang, Haofan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 274 - 283
  • [33] Segmentation of 3D Point Cloud Data Representing Full Human Body Geometry: A Review
    Krawczyk, Damian
    Sitnik, Robert
    PATTERN RECOGNITION, 2023, 139
  • [34] Point cloud segmentation of 3D rabbit base 3D Voronoi
    Ying, Shen
    Mao, Zhengyuan
    Li, Lin
    Xu, Guang
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2013, 38 (03): : 358 - 361
  • [35] Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation
    Zhang, Lu
    Zhang, Siqi
    Yang, Xu
    Qiao, Hong
    Liu, Zhiyong
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4945 - 4952
  • [36] 3D Body Reconstruction Revisited: Exploring the Test-time 3D Body Mesh Refinement Strategy via Surrogate Adaptation
    Lumentut, Jonathan Samuel
    Park, In Kyu
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5923 - 5933
  • [37] GridNet: efficiently learning deep hierarchical representation for 3D point cloud understanding
    Huiqun Wang
    Di Huang
    Yunhong Wang
    Frontiers of Computer Science, 2022, 16
  • [38] GridNet: efficiently learning deep hierarchical representation for 3D point cloud understanding
    Wang, Huiqun
    Huang, Di
    Wang, Yunhong
    FRONTIERS OF COMPUTER SCIENCE, 2022, 16 (01)
  • [39] GridNet:efficiently learning deep hierarchical representation for 3D point cloud understanding
    Huiqun WANG
    Di HUANG
    Yunhong WANG
    Frontiers of Computer Science, 2022, 16 (01) : 6 - 14
  • [40] Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation
    Liu Y.
    Zhang W.
    Zhao G.
    Zhu J.
    Vasilakos A.V.
    Wang L.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (10): : 1 - 11