3D shape segmentation via shape fully convolutional networks

被引:12
|
作者
Wang, Pengyu [1 ]
Gan, Yuan [1 ]
Shui, Panpan [1 ]
Yu, Fenggen [1 ]
Zhang, Yan [1 ]
Chen, Songle [2 ]
Sun, Zhengxing [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Minist Educ, Key Lab Broadband Wireless Commun & Sensor Networ, Nanjing 210003, Jiangsu, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 76卷
基金
美国国家科学基金会;
关键词
OBJECT RECOGNITION; CO-SEGMENTATION; FEATURES;
D O I
10.1016/j.cag.2018.07.011
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We design a novel fully convolutional network architecture for shapes, denoted by shape fully convolutional networks (SFCN). 3D shapes are represented as graph structures in the SFCN architecture, based on novel graph convolution and pooling operations, which are similar to convolution and pooling operations used on images. Meanwhile, to build our SFCN architecture in the original image segmentation fully convolutional network (FCN) architecture, we also design and implement a generating operation with bridging function. This ensures that the convolution and pooling operation we have designed can be successfully applied in the original FCN architecture. In this paper, we also present a new shape segmentation approach based on SFCN. Furthermore, we allow more general and challenging input, such as mixed datasets of different categories of shapes which can prove the ability of our generalisation. In our approach, SFCNs are trained triangles-to-triangles by using three low-level geometric features as input. Finally, the feature voting-based multi-label graph cuts is adopted to optimise the segmentation results obtained by SFCN prediction. The experiment results show that our method can effectively learn and predict mixed shape datasets of either similar or different characteristics, and achieve excellent segmentation results. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:182 / 192
页数:11
相关论文
共 50 条
  • [1] 3D shape segmentation via shape fully convolutional networks
    Wang, Pengyu
    Gan, Yuan
    Shui, Panpan
    Yu, Fenggen
    Zhang, Yan
    Chen, Songle
    Sun, Zhengxing
    [J]. COMPUTERS & GRAPHICS-UK, 2018, 70 : 128 - 139
  • [2] 3D shape segmentation via shape fully convolutional networks (vol 70, pg 128, 2018)
    Wang, Pengyu
    Gan, Yuan
    Shui, Panpan
    Yu, Fenggen
    Zhang, Yan
    Chen, Songle
    Sun, Zhengxing
    [J]. COMPUTERS & GRAPHICS-UK, 2018, 76 : 181 - 181
  • [3] Directionally Convolutional Networks for 3D Shape Segmentation
    Xu, Haotian
    Dong, Ming
    Zhong, Zichun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2717 - 2726
  • [4] 3D Shape Segmentation with Projective Convolutional Networks
    Kalogerakis, Evangelos
    Averkiou, Melinos
    Maji, Subhransu
    Chaudhuri, Siddhartha
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6630 - 6639
  • [5] 3D Shape Segmentation Based on Viewpoint Entropy and Projective Fully Convolutional Networks Fusing Multi-view Features
    Shui, Panpan
    Wang, Pengyu
    Yu, Fenggen
    Hu, Bingyang
    Gan, Yuan
    Liu, Kun
    Zhang, Yan
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1056 - 1061
  • [6] High-Quality Textured 3D Shape Reconstruction with Cascaded Fully Convolutional Networks
    Liu, Zheng-Ning
    Cao, Yan-Pei
    Kuang, Zheng-Fei
    Kobbelt, Leif
    Hu, Shi-Min
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (01) : 83 - 97
  • [7] Star Shape Prior in Fully Convolutional Networks for Skin Lesion Segmentation
    Mirikharaji, Zahra
    Hamarneh, Ghassan
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 : 737 - 745
  • [8] Volumetric segmentation via 3D active shape models
    Dickens, MM
    Gleason, SS
    Sari-Sarraf, H
    [J]. FIFTH IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION, PROCEEDINGS, 2002, : 248 - 252
  • [9] Voxel-Based 3D Shape Segmentation Using Deep Volumetric Convolutional Neural Networks
    Liu, Yuqi
    Long, Wei
    Shu, Zhenyu
    Yi, Shun
    Xin, Shiqing
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2022, 2022, 13443 : 489 - 500
  • [10] Liver Segmentation in Magnetic Resonance Imaging via Mean Shape Fitting with Fully Convolutional Neural Networks
    Zeng, Qi
    Karimi, Davood
    Pang, Emily H. T.
    Mohammed, Shahed
    Schneider, Caitlin
    Honarvar, Mohammad
    Salcudean, Septimiu E.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 246 - 254