Cross-Class Bias Rectification for Point Cloud Few-Shot Segmentation

被引:4
|
作者
Zhu, Guanyu [1 ,2 ]
Zhou, Yong [1 ,2 ]
Yao, Rui [1 ,2 ]
Zhu, Hancheng [1 ,2 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Prototypes; Task analysis; Semantic segmentation; Three-dimensional displays; Shape; Semantics; Point cloud; few-shot; prototype; bias rectification;
D O I
10.1109/TMM.2023.3248150
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The point cloud is a densely distributed 3D (three-dimensional) data, and annotating the point cloud is a time-consuming and labor-intensive work. The existing semantics segmentation work adopts few-shot learning to reduce the dependence on labeling samples while improving the generalization of the model to new categories. Since point clouds are 3D structures with rich geometric features, even objects of the same category have feature differences that cannot be ignored. Therefore, a few samples (support set) used to train the model do not cover all the features of this category. There is a distribution difference between the support samples and the samples used to verify the model performance (query set). In this paper, we propose an efficient point cloud few-shot segmentation method based on prototypes for bias rectification. A prototype is a vector representation of a category in the metric space. To make the prototype representation of the support set closer to the query set features, we define a feature bias term and reduce the distribution distance between the two sets by fusing the support set features and the bias term. On this basis, we design a feature cross-reference module. By mining the co-occurring features of the support and query sets, it can generate a more representative prototype which captures the overall features of the point cloud. Extensive experiments on two challenging datasets demonstrate that our method outperforms the state-of-the-art method by an average of 3.31% in several N-way K-shot tasks, and achieves approximately 200 times faster reasoning speed.
引用
收藏
页码:9175 / 9188
页数:14
相关论文
共 50 条
  • [41] Incremental Few-Shot Instance Segmentation
    Ganea, Dan Andrei
    Boom, Bas
    Poppe, Ronald
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1185 - 1194
  • [42] Learning Point Embeddings from Shape Repositories for Few-Shot Segmentation
    Sharma, Gopal
    Kalogerakis, Evangelos
    Maji, Subhransu
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 67 - 75
  • [43] Few-Shot 3D Point Cloud Semantic Segmentation via Stratified Class-Specific Attention Based Transformer Network
    Zhang, Canyu
    Wu, Zhenyao
    Wu, Xinyi
    Zhao, Ziyu
    Wang, Song
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3410 - 3417
  • [44] Gaussian Prototype Rectification For Few-shot Image Recognition
    Lin, Jinfu
    Shen, Junmin
    He, Xiaojian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [45] POEM: A prototype cross and emphasis network for few-shot semantic segmentation
    Cheng, Xu
    Li, Haoyuan
    Deng, Shuya
    Peng, Yonghong
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 234
  • [46] On filling the intra-class and inter-class gaps for few-shot segmentation
    Zhang, Yuxuan
    Wang, Shuchang
    Shi, Zhenbo
    Yang, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261
  • [47] Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement
    Ning, Zhenhua
    Tian, Zhuotao
    Lu, Guangming
    Pei, Wenjie
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1895 - 1904
  • [48] CPNet: Cross Prototype Network for Few-Shot Medical Image Segmentation
    Zhao, Zeyun
    Gao, Jianzhe
    Luo, Zhiming
    Li, Shaozi
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XV, 2025, 15045 : 135 - 149
  • [49] Enhancing Few-Shot 3D Point Cloud Semantic Segmentation through Bidirectional Prototype Learning
    Guo, Xuehang
    Hu, Hao
    Yang, Xiaoxi
    Deng, Yancong
    PROCEEDINGS OF 2023 9TH INTERNATIONAL CONFERENCE ON ROBOTICS AND ARTIFICIAL INTELLIGENCE, ICRAI 2023, 2023, : 7 - 16
  • [50] Self-Calibrated Cross Attention Network for Few-Shot Segmentation
    Xu, Qianxiong
    Zhao, Wenting
    Lin, Guosheng
    Long, Cheng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 655 - 665