Contrastive Learning for 3D Point Clouds Classification and Shape Completion

被引:4
|
作者
Nazir, Danish [1 ,2 ]
Afzal, Muhammad Zeshan [1 ,2 ,3 ]
Pagani, Alain [3 ]
Liwicki, Marcus [4 ]
Stricker, Didier [1 ,3 ]
机构
[1] Tech Univ Kaiserslautern, Dept Comp Sci, D-67663 Kaiserslautern, Germany
[2] Tech Univ Kaiserslautern, Mindgarage, D-67663 Kaiserslautern, Germany
[3] German Res Inst Artificial Intelligence DFKI, D-67663 Kaiserslautern, Germany
[4] Lulea Univ Technol, Dept Comp Sci, S-97187 Lulea, Sweden
关键词
point cloud classification; point cloud shape completion; AutoEncoders; contrastive AutoEncoders; contrasitive learning for point clouds; self-supervised learning for point cloud shape completion; DISTANCE; SNE;
D O I
10.3390/s21217392
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this paper, we present the idea of Self Supervised learning on the shape completion and classification of point clouds. Most 3D shape completion pipelines utilize AutoEncoders to extract features from point clouds used in downstream tasks such as classification, segmentation, detection, and other related applications. Our idea is to add contrastive learning into AutoEncoders to encourage global feature learning of the point cloud classes. It is performed by optimizing triplet loss. Furthermore, local feature representations learning of point cloud is performed by adding the Chamfer distance function. To evaluate the performance of our approach, we utilize the PointNet classifier. We also extend the number of classes for evaluation from 4 to 10 to show the generalization ability of the learned features. Based on our results, embeddings generated from the contrastive AutoEncoder enhances shape completion and classification performance from 84.2% to 84.9% of point clouds achieving the state-of-the-art results with 10 classes.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] A Contrastive Learning Method for the Visual Representation of 3D Point Clouds
    Zhu, Feng
    Zhao, Jieyu
    Cai, Zhengyi
    [J]. ALGORITHMS, 2022, 15 (03)
  • [2] On Active Labeling 3D Point Clouds via Contrastive Learning
    Yang, Guoqing
    Lai, Wentao
    Huang, Hui
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (11): : 1664 - 1673
  • [3] Deep Learning Neural Networks for 3D Point Clouds Shape Classification: A Survey
    Lai, Bing Hui
    Sia, Chun Wan
    Lim, King Hann
    Phang, Jonathan Then Sien
    [J]. 2022 INTERNATIONAL CONFERENCE ON GREEN ENERGY, COMPUTING AND SUSTAINABLE TECHNOLOGY (GECOST), 2022, : 394 - 398
  • [4] Learning 3D Shape Latent for Point Cloud Completion
    Chen, Zhikai
    Long, Fuchen
    Qiu, Zhaofan
    Yao, Ting
    Zhou, Wengang
    Luo, Jiebo
    Mei, Tao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8717 - 8729
  • [5] ToThePoint: Efficient Contrastive Learning of 3D Point Clouds via Recycling
    Li, Xinglin
    Chen, Jiajing
    Ouyang, Jinhui
    Deng, Hanhui
    Velipasalar, Senem
    Wu, Di
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21781 - 21790
  • [6] Automatic Object Shape Completion from 3D Point Clouds for Object Manipulation
    Figueiredo, Rui
    Moreno, Plinio
    Bernardino, Alexandre
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 4, 2017, : 565 - 570
  • [7] 3D shape from unorganized 3D point clouds
    Kamberov, G
    Kamberova, G
    Jain, A
    [J]. ADVANCES IN VISUAL COMPUTING, PROCEEDINGS, 2005, 3804 : 621 - +
  • [8] KAPLAN: A 3D Point Descriptor for Shape Completion
    Richard, Audrey
    Cherabier, Ian
    Oswald, Martin R.
    Pollefeys, Marc
    Schindler, Konrad
    [J]. 2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 101 - 110
  • [9] Registration of point clouds for 3D shape inspection
    Shi, Quan
    Xi, Ning
    Chen, Yifan
    Sheng, Weihua
    [J]. 2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 235 - +
  • [10] Shape Recognition in 3D Point-Clouds
    Schnabel, Ruwen
    Wessel, Raoul
    Wahl, Roland
    Klein, Reinhard
    [J]. WSCG 2008, FULL PAPERS, 2008, : 65 - 72