Contrastive Boundary Learning for Point Cloud Segmentation

被引:61
|
作者
Tang, Liyao [1 ]
Zhan, Yibing [2 ]
Chen, Zhe [1 ]
Yu, Baosheng [1 ]
Tao, Dacheng [1 ,2 ]
机构
[1] Univ Sydney, Sydney, NSW, Australia
[2] JD Explore Acad, Beijing, Peoples R China
关键词
D O I
10.1109/CVPR52688.2022.00830
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud segmentation is fundamental in understanding 3D environments. However, current 3D point cloud segmentation methods usually perform poorly on scene boundaries, which degenerates the overall segmentation performance. In this paper, we focus on the segmentation of scene boundaries. Accordingly, we first explore metrics to evaluate the segmentation performance on scene boundaries. To address the unsatisfactory performance on boundaries, we then propose a novel contrastive boundary learning (CBL) framework for point cloud segmentation. Specifically, the proposed CBL enhances feature discrimination between points across boundaries by contrasting their representations with the assistance of scene contexts at multiple scales. By applying CBL on three different baseline methods, we experimentally show that CBL consistently improves different baselines and assists them to achieve compelling performance on boundaries, as well as the overall performance, e.g. in mIoU. The experimental results demonstrate the effectiveness of our method and the importance of boundaries for 3D point cloud segmentation. Code and model will be made publicly available at hups://github.com/LiyaoTang/contrastBoundary.
引用
收藏
页码:8479 / 8489
页数:11
相关论文
共 50 条
  • [1] Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
    Jiang, Li
    Shi, Shaoshuai
    Tian, Zhuotao
    Lai, Xin
    Liu, Shu
    Fu, Chi-Wing
    Jia, Jiaya
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6403 - 6412
  • [2] A point cloud self-learning network based on contrastive learning for classification and segmentation
    Zhou, Haoran
    Wang, Wenju
    Chen, Gang
    Wang, Xiaolin
    VISUAL COMPUTER, 2024, 40 (12): : 8455 - 8479
  • [3] Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation
    Yao, Baochen
    Dong, Li
    Qiu, Xiaojie
    Song, Kangkang
    Yan, Diqun
    Peng, Chengbin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] Prototype-Voxel Contrastive Learning for LiDAR Point Cloud Panoptic Segmentation
    Liu, Minzhe
    Zhou, Qiang
    Zhao, Hengshuang
    Li, Jianing
    Du, Yuan
    Keutzer, Kurt
    Du, Li
    Zhang, Shanghang
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 9243 - 9250
  • [5] Guided contrastive boundary learning for semantic segmentation
    Qiu, Shoumeng
    Chen, Jie
    Zhang, Haiqiang
    Wan, Ru
    Xue, Xiangyang
    Pu, Jian
    PATTERN RECOGNITION, 2024, 155
  • [6] Mixed Feature Prediction on Boundary Learning for Point Cloud Semantic Segmentation
    Hao, Fengda
    Li, Jiaojiao
    Song, Rui
    Li, Yunsong
    Cao, Kailang
    REMOTE SENSING, 2022, 14 (19)
  • [7] Boundary-Inner Disentanglement Enhanced Learning for Point Cloud Semantic Segmentation
    He, Lixia
    She, Jiangfeng
    Zhao, Qiang
    Wen, Xiang
    Guan, Yuzheng
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [8] Unsupervised Point Cloud Object Co-segmentation by Co-contrastive Learning and Mutual Attention Sampling
    Yang, Cheng-Kun
    Chuang, Yung-Yu
    Lin, Yen-Yu
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7315 - 7324
  • [9] Contrastive Learning for Self-Supervised Pre-Training of Point Cloud Segmentation Networks With Image Data
    Janda, Andrej
    Wagstaff, Brandon
    Ng, Edwin G.
    Kelly, Jonathan
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 145 - 152
  • [10] Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering
    Edirimuni, Dasith de Silva
    Lu, Xuequan
    Li, Gang
    Robles-Kelly, Antonio
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4527 - 4541