HGL: Hierarchical Geometry Learning for Test-Time Adaptation in 3D Point Cloud Segmentation

被引:0
|
作者
Zou, Tianpei [1 ]
Qui, Sanqing [1 ]
Li, Zhijun [1 ]
Knoll, Alois [2 ]
He, Lianghua [1 ]
Chen, Guang [1 ]
Jiang, Changjun [1 ]
机构
[1] Tongji Univ, Shanghai, Peoples R China
[2] Tech Univ Munich, Munich, Germany
来源
基金
中国国家自然科学基金;
关键词
Online domain adaptation; point cloud segmentation; hierarchical framework; geometric learning;
D O I
10.1007/978-3-031-73001-6_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D point cloud segmentation has received significant interest for its growing applications. However, the generalization ability of models suffers in dynamic scenarios due to the distribution shift between test and training data. To promote robustness and adaptability across diverse scenarios, test-time adaptation (TTA) has recently been introduced. Nevertheless, most existing TTA methods are developed for images, and limited approaches applicable to point clouds ignore the inherent hierarchical geometric structures in point cloud streams, i.e., local (point-level), global (object-level), and temporal (frame-level) structures. In this paper, we delve into TTA in 3D point cloud segmentation and propose a novel Hierarchical Geometry Learning (HGL) framework. HGL comprises three complementary modules from local, global to temporal learning in a bottom-up manner. Technically, we first construct a local geometry learning module for pseudo-label generation. Next, we build prototypes from the global geometry perspective for pseudo-label fine-tuning. Furthermore, we introduce a temporal consistency regularization module to mitigate negative transfer. Extensive experiments on four datasets demonstrate the effectiveness and superiority of our HGL. Remarkably, on the SynLiDAR to SemanticKITTI task, HGL achieves an overall mIoU of 46.91%, improving GIPSO by 3.0% and significantly reducing the required adaptation time by 80%. The code is available at https://github.com/tpzou/HGL.
引用
收藏
页码:19 / 36
页数:18
相关论文
共 50 条
  • [1] Test-Time Augmentation for 3D Point Cloud Classification and Segmentation
    Tuan-Anh Vu
    Sarkar, Srinjay
    Zhang, Zhiyuan
    Binh-Son Hua
    Yeung, Sai-Kit
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 1543 - 1553
  • [2] Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning
    Hatem, Ahmed
    Qian, Yiming
    Wang, Yang
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 1284 - 1291
  • [3] Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation
    Cao, Haozhi
    Xu, Yuecong
    Yang, Jianfei
    Yin, Pengyu
    Yuan, Shenghai
    Xie, Lihua
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18763 - 18773
  • [4] Test-Time Adaptation for 3D Human Pose Estimation
    Amin, Sikandar
    Muller, Philipp
    Bulling, Andreas
    Andriluka, Mykhaylo
    PATTERN RECOGNITION, GCPR 2014, 2014, 8753 : 253 - 264
  • [5] MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentation
    Shin, Inkyu
    Tsai, Yi-Hsuan
    Zhuang, Bingbing
    Schulter, Samuel
    Liu, Buyu
    Garg, Sparsh
    Kweon, In So
    Yoon, Kuk-Jin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16907 - 16916
  • [6] Fully Test-Time Adaptation for Image Segmentation
    Hu, Minhao
    Song, Tao
    Gu, Yujun
    Luo, Xiangde
    Chen, Jieneng
    Chen, Yinan
    Zhang, Ya
    Zhang, Shaoting
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 251 - 260
  • [7] Geometry Sharing Network for 3D Point Cloud Classification and Segmentation
    Xu, Mingye
    Zhou, Zhipeng
    Qiao, Yu
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12500 - 12507
  • [8] Transformer Enhanced Hierarchical 3D Point Cloud Semantic Segmentation
    Liu, Yaohua
    Ma, Yue
    Xu, Min
    2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
  • [9] 3D Point Cloud Geometry Compression on Deep Learning
    Huang, Tianxin
    Liu, Yong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 890 - 898
  • [10] Hierarchical Edge Aware Learning for 3D Point Cloud
    Li, Lei
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 81 - 92