Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering

被引:2
|
作者
Edirimuni, Dasith de Silva [1 ]
Lu, Xuequan [1 ]
Li, Gang [1 ]
Robles-Kelly, Antonio [1 ,2 ]
机构
[1] Deakin Univ, Sch Informat Technol, Waurn Ponds, VIC 3216, Australia
[2] Def Sci & Technol Grp, Edinburg, SA 5111, Australia
关键词
Filtering; Point cloud compression; Estimation; Three-dimensional displays; Task analysis; Noise measurement; Training; Contrastive learning; machine learning; normal estimation; point cloud filtering; SURFACE;
D O I
10.1109/TVCG.2023.3263866
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Point cloud filtering and normal estimation are two fundamental research problems in the 3D field. Existing methods usually perform normal estimation and filtering separately and often show sensitivity to noise and/or inability to preserve sharp geometric features such as corners and edges. In this article, we propose a novel deep learning method to jointly estimate normals and filter point clouds. We first introduce a 3D patch based contrastive learning framework, with noise corruption as an augmentation, to train a feature encoder capable of generating faithful representations of point cloud patches while remaining robust to noise. These representations are consumed by a simple regression network and supervised by a novel joint loss, simultaneously estimating point normals and displacements that are used to filter the patch centers. Experimental results show that our method well supports the two tasks simultaneously and preserves sharp features and fine details. It generally outperforms state-of-the-art techniques on both tasks.
引用
收藏
页码:4527 / 4541
页数:15
相关论文
共 50 条
  • [1] PCDNF: Revisiting Learning-Based Point Cloud Denoising via Joint Normal Filtering
    Liu, Zheng
    Zhao, Yaowu
    Zhan, Sijing
    Liu, Yuanyuan
    Chen, Renjie
    He, Ying
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 5419 - 5436
  • [2] Deep feature-preserving normal estimation for point cloud filtering
    Lu, Dening
    Lu, Xuequan
    Sun, Yangxing
    Wang, Jun
    COMPUTER-AIDED DESIGN, 2020, 125
  • [3] Contrastive Boundary Learning for Point Cloud Segmentation
    Tang, Liyao
    Zhan, Yibing
    Chen, Zhe
    Yu, Baosheng
    Tao, Dacheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8479 - 8489
  • [4] Learning Signed Hyper Surfaces for Oriented Point Cloud Normal Estimation
    Li, Qing
    Feng, Huifang
    Shi, Kanle
    Gao, Yue
    Fang, Yi
    Liu, Yu-Shen
    Han, Zhizhong
    IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46 (12) : 9957 - 9974
  • [5] DEEP POINT CLOUD NORMAL ESTIMATION VIA TRIPLET LEARNING (DEMONSTRATION)
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [6] Weighted Point Cloud Normal Estimation
    Wang, Weijia
    Lu, Xuequan
    Shao, Di
    Liu, Xiao
    Dazeley, Richard
    Robles-Kelly, Antonio
    Pan, Wei
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2015 - 2020
  • [7] Joint contrastive learning of structural and semantic for graph collaborative filtering
    Dai, Jie
    Li, Qingshan
    Nong, Tianyi
    Bi, Qipeng
    Chu, Hua
    NEUROCOMPUTING, 2024, 586
  • [8] A 3D Point Cloud Filtering Method for Leaves Based on Manifold Distance and Normal Estimation
    Hu, Chunhua
    Pan, Zhou
    Li, Pingping
    REMOTE SENSING, 2019, 11 (02)
  • [9] Attentive and Contrastive Learning for Joint Depth and Motion Field Estimation
    Lee, Seokju
    Rameau, Francois
    Pan, Fei
    Kweon, In So
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4842 - 4851
  • [10] Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
    Jiang, Li
    Shi, Shaoshuai
    Tian, Zhuotao
    Lai, Xin
    Liu, Shu
    Fu, Chi-Wing
    Jia, Jiaya
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6403 - 6412