Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

被引:17
|
作者
Shu, Zhenyu [1 ]
Shen, Xiaoyong [2 ]
Xin, Shiqing [3 ]
Chang, Qingjun [1 ]
Feng, Jieqing [4 ]
Kavan, Ladislav [5 ]
Liu, Ligang [6 ]
机构
[1] Zhejiang Univ, Ningbo Inst Technol, Sch Comp & Data Engn, Ningbo, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] ShanDong Univ, Sch Comp Sci & Technol, Jinan, Peoples R China
[4] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[5] Univ Utah, Sch Comp, Salt Lake City, UT USA
[6] Univ Sci & Technol China, Graph & Geometr Comp Lab, Sch Math Sci, Hefei, Anhui, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Shape; Three-dimensional displays; Training; Labeling; Training data; Solid modeling; Deep learning; 3D shapes; segmentation; scribble; weakly-supervised; deep learning; UNSUPERVISED CO-SEGMENTATION; MESH SEGMENTATION;
D O I
10.1109/TVCG.2019.2892076
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Shape segmentation is a fundamental problem in shape analysis. Previous research shows that prior knowledge helps to improve the segmentation accuracy and quality. However, completely labeling each 3D shape in a large training data set requires a heavy manual workload. In this paper, we propose a novel weakly-supervised algorithm for segmenting 3D shapes using deep learning. Our method jointly propagates information from scribbles to unlabeled faces and learns deep neural network parameters. Therefore, it does not rely on completely labeled training shapes and only needs a really simple and convenient scribble-based partially labeling process, instead of the extremely time-consuming and tedious fully labeling processes. Various experimental results demonstrate the proposed method's superior segmentation performance over the previous unsupervised approaches and comparable segmentation performance to the state-of-the-art fully supervised methods.
引用
收藏
页码:2671 / 2682
页数:12
相关论文
共 50 条
  • [1] Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label
    Zhang, Xinliang
    Zhu, Lei
    He, Hangzhou
    Jin, Lujia
    Lu, Yanye
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7332 - 7340
  • [2] Scribble-Based Hierarchical Weakly Supervised Learning for Brain Tumor Segmentation
    Ji, Zhanghexuan
    Shen, Yan
    Ma, Chunwei
    Gao, Mingchen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 175 - 183
  • [3] Weakly-supervised structural component segmentation via scribble annotations
    Zhang, Chenyu
    Li, Ke
    Yin, Zhaozheng
    Qin, Ruwen
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024,
  • [4] Scribble2D5: Weakly-Supervised Volumetric Image Segmentation via Scribble Annotations
    Chen, Qiuhui
    Hong, Yi
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 234 - 243
  • [5] Weakly-supervised learning for catheter segmentation in 3D frustum ultrasound
    Yang, Hongxu
    Shan, Caifeng
    Kolen, Alexander F.
    De With, Peter H. N.
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2022, 96
  • [6] Weakly-Supervised Mirror Detection via Scribble Annotations
    Zha, Mingfeng
    Pei, Yunqiang
    Wang, Guoqing
    Li, Tianyu
    Yang, Yang
    Qian, Wenbin
    Shen, Heng Tao
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 6953 - 6961
  • [7] Absolute 3D Human Pose Estimation via Weakly-supervised Learning
    Guo, Yiru
    Chen, Zerui
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 273 - 276
  • [8] One-Shot Weakly-Supervised Segmentation in 3D Medical Images
    Lei, Wenhui
    Su, Qi
    Jiang, Tianyu
    Gu, Ran
    Wang, Na
    Liu, Xinglong
    Wang, Guotai
    Zhang, Xiaofan
    Zhang, Shaoting
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (01) : 175 - 189
  • [9] 3D FACE RECONSTRUCTION BASED ON WEAKLY-SUPERVISED LEARNING MORPHABLE FACE MODEL
    Liang, Kai-Wen
    Li, Pin-Hsuan
    Lo, Chung-Hsun
    Wang, Chien-Yao
    Chen, Yung-Fang
    Wang, Jia-Ching
    Chang, Pao-Chi
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3523 - 3527
  • [10] HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
    Li, Mengtian
    Xie, Yuan
    Shen, Yunhang
    Ke, Bo
    Qiao, Ruizhi
    Ren, Bo
    Lin, Shaohui
    Ma, Lizhuang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14910 - 14919