SCMS-Net: Self-Supervised Clustering-Based 3D Meshes Segmentation Network

被引:7
|
作者
Jiao, Xue [1 ,2 ]
Chen, Yonggang [1 ]
Yang, Xiaohui [1 ,2 ]
机构
[1] Henan Inst Sci & Technol, Sch Math, Xinxiang 453003, Peoples R China
[2] Henan Univ, Henan Engn Res Ctr Artificial Intelligence Theory, Sch Math & Stat, Kaifeng 475000, Peoples R China
关键词
3D mesh segmentation; Unsupervised segmentation; Self-supervised learning; Deep clustering; CO-SEGMENTATION; SHAPE SEGMENTATION;
D O I
10.1016/j.cad.2023.103512
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The superior performance of deep learning in different domains has sparked significant interest in its applicability to 3D computer graphics. Deep learning has become the dominant technical architecture in current 3D mesh segmentation. However, learning-based 3D segmentation methods usually rely on high-quality training datasets, which are not readily available in practical applications. How to segment 3D meshes without exhaustive label annotations remains a challenging problem, especially in the context of deep learning. As a subset of unsupervised learning methods, self-supervised learning offers a promising learning paradigm for unlabeled 3D mesh segmentation. In this paper, we introduce a self-supervised clustering-Based network specifically for the segmentation of label-free 3D meshes. Our self-supervised clustering-based 3D mesh segmentation network (SCMS-Net) employs a two-branch architecture to learn effective feature representation. The two branches are unified into an end-to-end framework using a self-supervised strategy. Finally, the label predictions of the parts are generated by iterative clustering. We conducted ablation studies and comparative experiments on a standard benchmark to demonstrate the effectiveness of our approach. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Segmentation of 3D Meshes Using p-Spectral Clustering
    Chahhou, Mohamed
    Moumoun, Lahcen
    El Far, Mohamed
    Gadi, Taoufiq
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (08) : 1687 - 1693
  • [32] Self-supervised Learning for Sketch-Based 3D Shape Retrieval
    Chen, Zhixiang
    Zhao, Haifeng
    Zhang, Yan
    Sun, Guozi
    Wu, Tianjian
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 318 - 329
  • [33] Self-supervised 3D Anatomy Segmentation Using Self-distilled Masked Image Transformer (SMIT)
    Jiang, Jue
    Tyagi, Neelam
    Tringale, Kathryn
    Crane, Christopher
    Veeraraghavan, Harini
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT IV, 2022, 13434 : 556 - 566
  • [34] Pretraining of 3D image segmentation models for retinal OCT using denoising-based self-supervised learning
    Rivail, Antoine
    Araujo, Teresa
    Schmidt-erfurth, Ursula
    Bogunovic, Hrvoje
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (09): : 5025 - 5040
  • [35] Joint Supervised and Self-Supervised Learning for 3D Real World Challenges
    Alliegro, Antonio
    Boscaini, Davide
    Tommasi, Tatiana
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 6718 - 6725
  • [36] Self-supervised 3D Skeleton Completion for Vascular Structures
    Ren, Jiaxiang
    Li, Zhenghong
    Cheng, Wensheng
    Zou, Zhilin
    Park, Kicheon
    Pan, Yingtian
    Ling, Haibin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 579 - 589
  • [37] 3D Human Pose Machines with Self-Supervised Learning
    Wang, Keze
    Lin, Liang
    Jiang, Chenhan
    Qian, Chen
    Wei, Pengxu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) : 1069 - 1082
  • [38] Enhancing Face Recognition with Self-Supervised 3D Reconstruction
    He, Mingjie
    Zhang, Jie
    Shan, Shiguang
    Chen, Xilin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4052 - 4061
  • [39] Self-Supervised Learning of Detailed 3D Face Reconstruction
    Chen, Yajing
    Wu, Fanzi
    Wang, Zeyu
    Song, Yibing
    Ling, Yonggen
    Bao, Linchao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8696 - 8705
  • [40] Visual Reinforcement Learning With Self-Supervised 3D Representations
    Ze, Yanjie
    Hansen, Nicklas
    Chen, Yinbo
    Jain, Mohit
    Wang, Xiaolong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (05) : 2890 - 2897