Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation

被引:0
|
作者
Yao, Baochen [1 ,2 ]
Dong, Li [1 ,2 ]
Qiu, Xiaojie [3 ]
Song, Kangkang [4 ]
Yan, Diqun [1 ,2 ]
Peng, Chengbin [1 ,2 ]
机构
[1] Ningbo Univ, Coll Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Ningbo Univ, Key Lab Mobile Network Applicat Technol Zhejiang P, Ningbo 315211, Peoples R China
[3] Zhejiang Cowain Automation Technol Co Ltd, Ningbo 315201, Peoples R China
[4] Ningbo Inst Mat Technol & Engn, Chinese Acad Sci, Ningbo 315201, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Perturbation methods; Reliability; Prototypes; Training; Predictive models; Measurement; Contrastive learning; negative pseudo-label; point cloud segmentation; weakly supervised; SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3416219
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional point cloud data are widely used in many fields, as they can be easily obtained and contain rich semantic information. Recently, weakly supervised segmentation has attracted lots of attention, because it only requires very few labels, thus reducing time-consuming and expensive data annotation efforts for huge amounts of point cloud data. The existing approaches typically adopt softmax scores from the last layer as the confidence for selecting high-confident point predictions. However, such approaches can ignore the potential value of a large number of low-confidence point predictions under traditional metrics. In this work, we propose an uncertainty-guided contrastive learning (UCL) framework for weakly supervised point cloud segmentation. A novel uncertainty metric based on prototype entropy (PE) is presented to estimate the reliability of model predictions. With this metric, we propose a negative contrastive learning module exploiting negative pseudo-labels of predictions with low reliability and an active contrastive learning module enhancing feature learning of segmentation models by predictions with high reliability. We also propose a generic multiscale feature perturbation method to expand a wider perturbation space. Extensive experimental results on indoor and outdoor point cloud datasets demonstrate that the proposed method achieves competitive performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation
    Hua, Yu
    Shu, Xin
    Wang, Zizhou
    Zhang, Lei
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (04)
  • [2] Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
    Jiang, Li
    Shi, Shaoshuai
    Tian, Zhuotao
    Lai, Xin
    Liu, Shu
    Fu, Chi-Wing
    Jia, Jiaya
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6403 - 6412
  • [3] Weakly supervised semantic segmentation via saliency perception with uncertainty-guided noise suppression
    Liu, Xinyi
    Huang, Guoheng
    Yuan, Xiaochen
    Zheng, Zewen
    Zhong, Guo
    Chen, Xuhang
    Pun, Chi-Man
    VISUAL COMPUTER, 2024, : 2891 - 2906
  • [4] Uncertainty-guided mutual consistency learning for semi-supervised medical image segmentation
    Zhang, Yichi
    Jiao, Rushi
    Liao, Qingcheng
    Li, Dongyang
    Zhang, Jicong
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2023, 138
  • [5] Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling
    Yang, Yujie
    Hu, Lin
    Zu, Chen
    Zhou, Qizheng
    Wu, Xi
    Zhou, Jiliu
    Wang, Yan
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2023, 33 (06)
  • [6] Weakly Supervised Learning for Point Cloud Semantic Segmentation With Dual Teacher
    Yao, Baochen
    Xiao, Hui
    Zhuang, Jiayan
    Peng, Chengbin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6347 - 6354
  • [7] Weakly Supervised Temporal Sentence Grounding with Uncertainty-Guided Self-training
    Huang, Yifei
    Yang, Lijin
    Sato, Yoichi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18908 - 18918
  • [8] Uncertainty-Guided Self-learning Framework for Semi-supervised Multi-organ Segmentation
    Alves, Natalia
    de Wilde, Bram
    FAST AND LOW-RESOURCE SEMI-SUPERVISED ABDOMINAL ORGAN SEGMENTATION, FLARE 2022, 2022, 13816 : 116 - 127
  • [9] Contrastive Boundary Learning for Point Cloud Segmentation
    Tang, Liyao
    Zhan, Yibing
    Chen, Zhe
    Yu, Baosheng
    Tao, Dacheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8479 - 8489
  • [10] Semi-supervised Semantic Segmentation with Uncertainty-Guided Self Cross Supervision
    Zhang, Yunyang
    Gong, Zhiqiang
    Zhao, Xiaoyu
    Zheng, Xiaohu
    Yao, Wen
    COMPUTER VISION - ACCV 2022, PT VII, 2023, 13847 : 327 - 343