Cross-Class Bias Rectification for Point Cloud Few-Shot Segmentation

被引:4
|
作者
Zhu, Guanyu [1 ,2 ]
Zhou, Yong [1 ,2 ]
Yao, Rui [1 ,2 ]
Zhu, Hancheng [1 ,2 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Prototypes; Task analysis; Semantic segmentation; Three-dimensional displays; Shape; Semantics; Point cloud; few-shot; prototype; bias rectification;
D O I
10.1109/TMM.2023.3248150
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The point cloud is a densely distributed 3D (three-dimensional) data, and annotating the point cloud is a time-consuming and labor-intensive work. The existing semantics segmentation work adopts few-shot learning to reduce the dependence on labeling samples while improving the generalization of the model to new categories. Since point clouds are 3D structures with rich geometric features, even objects of the same category have feature differences that cannot be ignored. Therefore, a few samples (support set) used to train the model do not cover all the features of this category. There is a distribution difference between the support samples and the samples used to verify the model performance (query set). In this paper, we propose an efficient point cloud few-shot segmentation method based on prototypes for bias rectification. A prototype is a vector representation of a category in the metric space. To make the prototype representation of the support set closer to the query set features, we define a feature bias term and reduce the distribution distance between the two sets by fusing the support set features and the bias term. On this basis, we design a feature cross-reference module. By mining the co-occurring features of the support and query sets, it can generate a more representative prototype which captures the overall features of the point cloud. Extensive experiments on two challenging datasets demonstrate that our method outperforms the state-of-the-art method by an average of 3.31% in several N-way K-shot tasks, and achieves approximately 200 times faster reasoning speed.
引用
收藏
页码:9175 / 9188
页数:14
相关论文
共 50 条
  • [21] Few-shot 3D Point Cloud Semantic Segmentation with Prototype Alignment
    Wei, Maolin
    PROCEEDINGS OF 2023 8TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING TECHNOLOGIES, ICMLT 2023, 2023, : 195 - 200
  • [22] ENRICH FEATURES FOR FEW-SHOT POINT CLOUD CLASSIFICATION
    Feng, Hengxin
    Liu, Weifeng
    Wang, Yanjiang
    Liu, Baodi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2285 - 2289
  • [23] Cross-Domain Few-Shot Semantic Segmentation
    Lei, Shuo
    Zhang, Xuchao
    He, Jianfeng
    Chen, Fanglan
    Du, Bowen
    Lu, Chang-Tien
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 73 - 90
  • [24] Few-Shot Point Cloud Semantic Segmentation via Support-Query Feature Interaction
    Zheng, Chao
    Liu, Li
    Meng, Yu
    Peng, Xiaorui
    Wang, Meijun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 10753 - 10763
  • [25] Prototype-Guided Prior Enhancement and Rectification in Few-shot Semantic Segmentation
    Tang, Yiming
    Yu, Yi
    Chen, Yan Qiu
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,
  • [26] Global Rectification and Decoupled Registration for Few-Shot Segmentation in Remote Sensing Imagery
    Lang, Chunbo
    Cheng, Gong
    Tu, Binfei
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [27] Prototype distribution correction for few-shot point cloud classification
    Feng, Yuanzhi
    Xia, Yu
    Guo, Jielong
    Shao, Dongheng
    Zhang, Jianfeng
    Wei, Xian
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (09) : 1243 - 1254
  • [28] Generalized Few-shot Semantic Segmentation for LiDAR Point Clouds
    Wu, Pengze
    Mei, Jilin
    Zhao, Xijun
    Hu, Yu
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7622 - 7628
  • [29] What Makes for Effective Few-shot Point Cloud Classification?
    Ye, Chuangguan
    Zhu, Hongyuan
    Liao, Yongbin
    Zhang, Yanggang
    Chen, Tao
    Fan, Jiayuan
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 267 - 276
  • [30] Few-Shot Class-Incremental Learning for 3D Point Cloud Objects
    Chowdhury, Townim
    Cheraghian, Ali
    Ramasinghe, Sameera
    Ahmadi, Sahar
    Saberi, Morteza
    Rahman, Shafin
    COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 204 - 220