Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

被引:0
|
作者
Wang, Peng-Shuai [1 ]
Yang, Yu-Qi [1 ,2 ]
Zou, Qian-Fang [1 ,3 ]
Wu, Zhirong [1 ]
Liu, Yang [1 ]
Tong, Xin [1 ]
机构
[1] Microsoft Res Asia, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
[3] Univ Sci & Technol China, Hefei, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. Our key idea is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HRNet to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, Our network is concatenated with simple task-specific back-ends and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods. For fine-grained shape segmentation on the PartNet dataset, our method even surpasses existing supervised methods by a large margin.
引用
收藏
页码:2773 / 2781
页数:9
相关论文
共 50 条
  • [1] Transcoding across 3D shape representations for unsupervised learning of 3D shape feature
    Furuya, Takahiko
    Ohbuchi, Ryutarou
    [J]. PATTERN RECOGNITION LETTERS, 2020, 138 (138) : 146 - 154
  • [2] Unsupervised Feature Learning via Non-Parametric Instance Discrimination
    Wu, Zhirong
    Xiong, Yuanjun
    Yu, Stella X.
    Lin, Dahua
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3733 - 3742
  • [3] Unsupervised 3D shape segmentation and co-segmentation via deep learning
    Shu, Zhenyu
    Qi, Chengwu
    Xin, Shiqing
    Hu, Chao
    Wang, Li
    Zhang, Yu
    Liu, Ligang
    [J]. COMPUTER AIDED GEOMETRIC DESIGN, 2016, 43 : 39 - 52
  • [4] Combining unsupervised learning and discrimination for 3D action recognition
    Chen, Guang
    Clarke, Daniel
    Giuliani, Manuel
    Gaschler, Andre
    Knoll, Alois
    [J]. SIGNAL PROCESSING, 2015, 110 : 67 - 81
  • [5] Unsupervised 3D Shape Representation Learning Using Normalizing Flow
    Li, Xiang
    Wen, Congcong
    Huang, Hao
    [J]. COMPUTER VISION - ACCV 2022, PT I, 2023, 13841 : 158 - 175
  • [6] Single Image 3D Shape Retrieval via Cross-Modal Instance and Category Contrastive Learning
    Lin, Ming-Xian
    Yang, Jie
    Wang, He
    Lai, Yu-Kun
    Jia, Rongfei
    Zhao, Binqiang
    Gao, Lin
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11385 - 11395
  • [7] A multiresolution descriptor for deformable 3D shape retrieval
    Chunyuan Li
    A. Ben Hamza
    [J]. The Visual Computer, 2013, 29 : 513 - 524
  • [8] A multiresolution descriptor for deformable 3D shape retrieval
    Li, Chunyuan
    Ben Hamza, A.
    [J]. VISUAL COMPUTER, 2013, 29 (6-8): : 513 - 524
  • [9] 3D Instance Segmentation via Multi-Task Metric Learning
    Lahoud, Jean
    Ghanem, Bernard
    Pollefeys, Marc
    Oswald, Martin R.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9255 - 9265
  • [10] SIGNet: Semantic Instance Aided Unsupervised 3D Geometry Perception
    Meng, Yue
    Lu, Yongxi
    Raj, Aman
    Sunarjo, Samuel
    Guo, Rui
    Javidi, Tara
    Bansal, Gaurav
    Bharadia, Dinesh
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9802 - 9812