HGL: Hierarchical Geometry Learning for Test-Time Adaptation in 3D Point Cloud Segmentation

被引:0
|
作者
Zou, Tianpei [1 ]
Qui, Sanqing [1 ]
Li, Zhijun [1 ]
Knoll, Alois [2 ]
He, Lianghua [1 ]
Chen, Guang [1 ]
Jiang, Changjun [1 ]
机构
[1] Tongji Univ, Shanghai, Peoples R China
[2] Tech Univ Munich, Munich, Germany
来源
基金
中国国家自然科学基金;
关键词
Online domain adaptation; point cloud segmentation; hierarchical framework; geometric learning;
D O I
10.1007/978-3-031-73001-6_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point cloud segmentation has received significant interest for its growing applications. However, the generalization ability of models suffers in dynamic scenarios due to the distribution shift between test and training data. To promote robustness and adaptability across diverse scenarios, test-time adaptation (TTA) has recently been introduced. Nevertheless, most existing TTA methods are developed for images, and limited approaches applicable to point clouds ignore the inherent hierarchical geometric structures in point cloud streams, i.e., local (point-level), global (object-level), and temporal (frame-level) structures. In this paper, we delve into TTA in 3D point cloud segmentation and propose a novel Hierarchical Geometry Learning (HGL) framework. HGL comprises three complementary modules from local, global to temporal learning in a bottom-up manner. Technically, we first construct a local geometry learning module for pseudo-label generation. Next, we build prototypes from the global geometry perspective for pseudo-label fine-tuning. Furthermore, we introduce a temporal consistency regularization module to mitigate negative transfer. Extensive experiments on four datasets demonstrate the effectiveness and superiority of our HGL. Remarkably, on the SynLiDAR to SemanticKITTI task, HGL achieves an overall mIoU of 46.91%, improving GIPSO by 3.0% and significantly reducing the required adaptation time by 80%. The code is available at https://github.com/tpzou/HGL.
引用
收藏
页码:19 / 36
页数:18
相关论文
共 50 条
  • [41] Self-supervised Test-Time Adaptation for Medical Image Segmentation
    Li, Hao
    Liu, Han
    Hu, Dewei
    Wang, Jiacheng
    Johnson, Hans
    Sherbini, Omar
    Gavazzi, Francesco
    D'Aiello, Russell
    Vanderver, Adeline
    Long, Jeffrey
    Paulsen, Jane
    Oguz, Ipek
    MACHINE LEARNING IN CLINICAL NEUROIMAGING, MLCN 2022, 2022, 13596 : 32 - 41
  • [42] Research of Deep Learning-Based Semantic Segmentation for 3D Point Cloud
    Wang, Tao
    Wang, Wenju
    Cai, Yu
    Computer Engineering and Applications, 2024, 57 (23) : 18 - 26
  • [43] 3D Point Cloud Semantic Segmentation Network Based on Coding Feature Learning
    Tong, Guofeng
    Liu, Yongxu
    Peng, Hao
    Shao, Yuyuan
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (04): : 313 - 326
  • [44] CLOSED: A Dashboard for 3D Point Cloud Segmentation Analysis using Deep Learning
    Zoumpekas, Thanasis
    Molina, Guillem
    Puig, Anna
    Salamo, Maria
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 403 - 410
  • [45] Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation
    Ni, Jiayi
    Yang, Senqiao
    Xu, Ran
    Liu, Jiaming
    Li, Xiaoqi
    Jiao, Wenyu
    Chen, Zehui
    Liu, Yi
    Zhang, Shanghang
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 3044 - 3050
  • [46] Real-Time Semantic Segmentation of 3D Point Cloud for Autonomous Driving
    Kang, Dongwan
    Wong, Anthony
    Lee, Banghyon
    Kim, Jungha
    ELECTRONICS, 2021, 10 (16)
  • [47] Deep Hierarchical Learning for 3D Semantic Segmentation
    Li, Chongshou
    Liu, Yuheng
    Li, Xinke
    Zhang, Yuning
    Li, Tianrui
    Yuan, Junsong
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [48] Hierarchical 3D Feature Learning for Pancreas Segmentation
    Salanitri, Federica Proietto
    Bellitto, Giovanni
    Irmakci, Ismail
    Palazzo, Simone
    Bagci, Ulas
    Spampinato, Concetto
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 238 - 247
  • [49] Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation
    Yang, Yuwei
    Hayat, Munawar
    Jin, Zhao
    Ren, Chao
    Lei, Yinjie
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21759 - 21768
  • [50] MATE: Masked Autoencoders are Online 3D Test-Time Learners
    Mirza, M. Jehanzeb
    Shin, Inkyu
    Lin, Wei
    Schriebl, Andreas
    Sun, Kunyang
    Choe, Jaesung
    Kozinski, Mateusz
    Possegger, Horst
    Kweon, In So
    Yoon, Kuk-Jin
    Bischof, Horst
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16663 - 16672