Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation

被引:0
|
作者
Yao, Baochen [1 ,2 ]
Dong, Li [1 ,2 ]
Qiu, Xiaojie [3 ]
Song, Kangkang [4 ]
Yan, Diqun [1 ,2 ]
Peng, Chengbin [1 ,2 ]
机构
[1] Ningbo Univ, Coll Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Ningbo Univ, Key Lab Mobile Network Applicat Technol Zhejiang P, Ningbo 315211, Peoples R China
[3] Zhejiang Cowain Automation Technol Co Ltd, Ningbo 315201, Peoples R China
[4] Ningbo Inst Mat Technol & Engn, Chinese Acad Sci, Ningbo 315201, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Perturbation methods; Reliability; Prototypes; Training; Predictive models; Measurement; Contrastive learning; negative pseudo-label; point cloud segmentation; weakly supervised; SEMANTIC SEGMENTATION;
D O I
10.1109/TGRS.2024.3416219
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional point cloud data are widely used in many fields, as they can be easily obtained and contain rich semantic information. Recently, weakly supervised segmentation has attracted lots of attention, because it only requires very few labels, thus reducing time-consuming and expensive data annotation efforts for huge amounts of point cloud data. The existing approaches typically adopt softmax scores from the last layer as the confidence for selecting high-confident point predictions. However, such approaches can ignore the potential value of a large number of low-confidence point predictions under traditional metrics. In this work, we propose an uncertainty-guided contrastive learning (UCL) framework for weakly supervised point cloud segmentation. A novel uncertainty metric based on prototype entropy (PE) is presented to estimate the reliability of model predictions. With this metric, we propose a negative contrastive learning module exploiting negative pseudo-labels of predictions with low reliability and an active contrastive learning module enhancing feature learning of segmentation models by predictions with high reliability. We also propose a generic multiscale feature perturbation method to expand a wider perturbation space. Extensive experimental results on indoor and outdoor point cloud datasets demonstrate that the proposed method achieves competitive performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] A multi-strategy contrastive learning framework for weakly supervised semantic segmentation
    Yuan, Kunhao
    Schaefer, Gerald
    Lai, Yu-Kun
    Wang, Yifan
    Liu, Xiyao
    Guan, Lin
    Fang, Hui
    PATTERN RECOGNITION, 2023, 137
  • [32] Contrastive and consistent feature learning for weakly supervised object localization and semantic segmentation
    Ki, Minsong
    Uh, Youngjung
    Lee, Wonyoung
    Byun, Hyeran
    NEUROCOMPUTING, 2021, 445 : 244 - 254
  • [33] Uncertainty-guided dual-views for semi-supervised volumetric medical image segmentation
    Himashi Peiris
    Munawar Hayat
    Zhaolin Chen
    Gary Egan
    Mehrtash Harandi
    Nature Machine Intelligence, 2023, 5 : 724 - 738
  • [34] Adaptive feature aggregation based multi-task learning for uncertainty-guided semi-supervised medical image segmentation
    Lyu, Jun
    Sui, Bin
    Wang, Chengyan
    Dou, Qi
    Qin, Jing
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 232
  • [35] Weakly-Supervised Point Cloud Segmentation Combining Pseudo Label Generation and Noise Label Learning
    Deng A.
    Zhang P.
    Lu Z.
    Li W.
    Su Z.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (02): : 273 - 283
  • [36] Dual uncertainty-guided multi-model pseudo-label learning for semi-supervised medical image segmentation
    Qiu Z.
    Gan W.
    Yang Z.
    Zhou R.
    Gan H.
    Mathematical Biosciences and Engineering, 2024, 21 (02) : 2212 - 2232
  • [37] Weakly Supervised 3D Point Cloud Segmentation via Multi-Prototype Learning
    Su, Yongyi
    Xu, Xun
    Jia, Kui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7723 - 7736
  • [38] Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss
    Guo, Dinghao
    Chen, Dali
    Lin, Xin
    Xue, Zheng
    Zheng, Wei
    Li, Xianling
    Visual Computer, 2025, 41 (05): : 3611 - 3626
  • [39] Contrastive Learning for Self-Supervised Pre-Training of Point Cloud Segmentation Networks With Image Data
    Janda, Andrej
    Wagstaff, Brandon
    Ng, Edwin G.
    Kelly, Jonathan
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 145 - 152
  • [40] Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning
    Huang, Shuowen
    Hu, Qingwu
    Ai, Mingyao
    Zhao, Pengcheng
    Li, Jian
    Cui, Hao
    Wang, Shaohua
    Automation in Construction, 2024, 168