Cross-Class Bias Rectification for Point Cloud Few-Shot Segmentation

被引:4
|
作者
Zhu, Guanyu [1 ,2 ]
Zhou, Yong [1 ,2 ]
Yao, Rui [1 ,2 ]
Zhu, Hancheng [1 ,2 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Prototypes; Task analysis; Semantic segmentation; Three-dimensional displays; Shape; Semantics; Point cloud; few-shot; prototype; bias rectification;
D O I
10.1109/TMM.2023.3248150
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The point cloud is a densely distributed 3D (three-dimensional) data, and annotating the point cloud is a time-consuming and labor-intensive work. The existing semantics segmentation work adopts few-shot learning to reduce the dependence on labeling samples while improving the generalization of the model to new categories. Since point clouds are 3D structures with rich geometric features, even objects of the same category have feature differences that cannot be ignored. Therefore, a few samples (support set) used to train the model do not cover all the features of this category. There is a distribution difference between the support samples and the samples used to verify the model performance (query set). In this paper, we propose an efficient point cloud few-shot segmentation method based on prototypes for bias rectification. A prototype is a vector representation of a category in the metric space. To make the prototype representation of the support set closer to the query set features, we define a feature bias term and reduce the distribution distance between the two sets by fusing the support set features and the bias term. On this basis, we design a feature cross-reference module. By mining the co-occurring features of the support and query sets, it can generate a more representative prototype which captures the overall features of the point cloud. Extensive experiments on two challenging datasets demonstrate that our method outperforms the state-of-the-art method by an average of 3.31% in several N-way K-shot tasks, and achieves approximately 200 times faster reasoning speed.
引用
收藏
页码:9175 / 9188
页数:14
相关论文
共 50 条
  • [1] Two-stage feature distribution rectification for few-shot point cloud semantic segmentation
    Wang, Tichao
    Hao, Fusheng
    Cui, Guosheng
    Wu, Fuxiang
    Yang, Mengjie
    Zhang, Qieshi
    Cheng, Jun
    PATTERN RECOGNITION LETTERS, 2024, 177 : 142 - 149
  • [2] Information Gap Narrowing for Point Cloud Few-Shot Segmentation
    Zhu, Guanyu
    Zhou, Yong
    Yao, Rui
    Zhu, Hancheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4421 - 4433
  • [3] Tackling background ambiguities in multi-class few-shot point cloud semantic segmentation
    Lai, Lvlong
    Chen, Jian
    Zhang, Chi
    Zhang, Zehong
    Lin, Guosheng
    Wu, Qingyao
    KNOWLEDGE-BASED SYSTEMS, 2022, 253
  • [4] Generalized Few-Shot 3D Point Cloud Segmentation
    Yang, Shuqian
    Ding, Henhui
    Jiang, Xudong
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [5] Few-shot 3D Point Cloud Semantic Segmentation
    Zhao, Na
    Chua, Tat-Seng
    Lee, Gim Hee
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8869 - 8878
  • [6] Dynamic Prototype Adaptation with Distillation for Few-shot Point Cloud Segmentation
    Liu, Jie
    Yin, Wenzhe
    Wang, Haochen
    Chen, Yunlu
    Sonke, Jan-Jakob
    Gavves, Efstratios
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 810 - 819
  • [7] Generalized Few-Shot Point Cloud Segmentation Via Geometric Words
    Xu, Yating
    Hu, Conghui
    Zhao, Na
    Lee, Gim Hee
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21449 - 21458
  • [8] On the Texture Bias for Few-Shot CNN Segmentation
    Azad, Reza
    Fayjie, Abdur R.
    Kauffmann, Claude
    Ben Ayed, Ismail
    Pedersoli, Marco
    Dolz, Jose
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2673 - 2682
  • [9] Hyperbolic prototype rectification for few-shot 3D point cloud classification
    Feng, Yuan-Zhi
    Lin, Shing-Ho J.
    Tang, Xuan
    Wang, Mu-Yu
    Zheng, Jian-Zhang
    He, Zi-Yao
    Pang, Zi-Yi
    Yang, Jian
    Chen, Ming-Song
    Wei, Xian
    PATTERN RECOGNITION, 2025, 158
  • [10] Localization and Expansion: A Decoupled Framework for Point Cloud Few-Shot Semantic Segmentation
    Li, Zhaoyang
    Wang, Yuan
    Li, Wangkai
    Sun, Rui
    Zhang, Tianzhu
    COMPUTER VISION - ECCV 2024, PT LXXIII, 2025, 15131 : 18 - 34