Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

被引:0
|
作者
Wang, Peng-Shuai [1 ]
Yang, Yu-Qi [1 ,2 ]
Zou, Qian-Fang [1 ,3 ]
Wu, Zhirong [1 ]
Liu, Yang [1 ]
Tong, Xin [1 ]
机构
[1] Microsoft Res Asia, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
[3] Univ Sci & Technol China, Hefei, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. Our key idea is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HRNet to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, Our network is concatenated with simple task-specific back-ends and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods. For fine-grained shape segmentation on the PartNet dataset, our method even surpasses existing supervised methods by a large margin.
引用
收藏
页码:2773 / 2781
页数:9
相关论文
共 50 条
  • [21] Object Discovery in 3D scenes via Shape Analysis
    Karpathy, Andrej
    Miller, Stephen
    Li Fei-Fei
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 2088 - 2095
  • [22] Multiresolution Hierarchical Shape Models in 3D Subcortical Brain Structures
    Cerrolaza, Juan J.
    Carranza Herrezuelo, Noemi
    Villanueva, Arantxa
    Cabeza, Rafael
    Gonzalez Ballester, Miguel Angel
    Linguraru, Marius George
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2013, PT II, 2013, 8150 : 641 - 648
  • [23] Learning Descriptor Networks for 3D Shape Synthesis and Analysis
    Xie, Jianwen
    Zheng, Zilong
    Gao, Ruiqi
    Wang, Wenguan
    Zhu, Song-Chun
    Wu, Ying Nian
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8629 - 8638
  • [24] MRGAN: Multi-Rooted 3D Shape Representation Learning with Unsupervised Part Disentanglement
    Gal, Rinon
    Bermano, Amit
    Zhang, Hao
    Cohen-Or, Daniel
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 2039 - 2048
  • [25] Evidence for tactile 3D shape discrimination by octopus
    Buresch, Kendra C.
    Huget, Noelle D.
    Brister, William C.
    Zhou, Elaine Y.
    Lineaweaver, Abraham S.
    Rifai, Chloe
    Hu, Jinyang
    Stevenson, Zoe E.
    Boal, Jean G.
    Hanlon, Roger T.
    [J]. JOURNAL OF COMPARATIVE PHYSIOLOGY A-NEUROETHOLOGY SENSORY NEURAL AND BEHAVIORAL PHYSIOLOGY, 2024, 210 (05): : 815 - 823
  • [26] Unsupervised 3D Shape Coverage Estimation with Applications to Colonoscopy
    Blau, Yochai
    Freedman, Daniel
    Dashinsky, Valentin
    Goldenberg, Roman
    Rivlin, Ehud
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3364 - 3374
  • [27] Unsupervised 3D Shape Completion through GAN Inversion
    Zhang, Junzhe
    Chen, Xinyi
    Cai, Zhongang
    Pan, Liang
    Zhao, Haiyu
    Yi, Shuai
    Yeo, Chai Kiat
    Dai, Bo
    Loy, Chen Change
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1768 - 1777
  • [28] KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control
    Jakab, Tomas
    Tucker, Richard
    Makadia, Ameesh
    Wu, Jiajun
    Snavely, Noah
    Kanazawa, Angjoo
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12778 - 12787
  • [29] Unsupervised 3D Shape Reconstruction by Part Retrieval and Assembly
    Xi, Xianghao
    Guerrero, Paul
    Fisher, Matthew
    Chaudhuri, Siddhartha
    Ritchie, Daniel
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8559 - 8567
  • [30] Adaptation via Proxy: Building Instance-Aware Proxy for Unsupervised Domain Adaptive 3D Object Detection
    Li, Ziyu
    Yao, Yuncong
    Quan, Zhibin
    Qi, Lei
    Feng, Zhen-Hua
    Yang, Wankou
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3478 - 3492