3D shape segmentation via shape fully convolutional networks

被引:12
|
作者
Wang, Pengyu [1 ]
Gan, Yuan [1 ]
Shui, Panpan [1 ]
Yu, Fenggen [1 ]
Zhang, Yan [1 ]
Chen, Songle [2 ]
Sun, Zhengxing [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Minist Educ, Key Lab Broadband Wireless Commun & Sensor Networ, Nanjing 210003, Jiangsu, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 76卷
基金
美国国家科学基金会;
关键词
OBJECT RECOGNITION; CO-SEGMENTATION; FEATURES;
D O I
10.1016/j.cag.2018.07.011
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We design a novel fully convolutional network architecture for shapes, denoted by shape fully convolutional networks (SFCN). 3D shapes are represented as graph structures in the SFCN architecture, based on novel graph convolution and pooling operations, which are similar to convolution and pooling operations used on images. Meanwhile, to build our SFCN architecture in the original image segmentation fully convolutional network (FCN) architecture, we also design and implement a generating operation with bridging function. This ensures that the convolution and pooling operation we have designed can be successfully applied in the original FCN architecture. In this paper, we also present a new shape segmentation approach based on SFCN. Furthermore, we allow more general and challenging input, such as mixed datasets of different categories of shapes which can prove the ability of our generalisation. In our approach, SFCNs are trained triangles-to-triangles by using three low-level geometric features as input. Finally, the feature voting-based multi-label graph cuts is adopted to optimise the segmentation results obtained by SFCN prediction. The experiment results show that our method can effectively learn and predict mixed shape datasets of either similar or different characteristics, and achieve excellent segmentation results. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:182 / 192
页数:11
相关论文
共 50 条
  • [31] Non-rigid 3D Shape Classification based on Convolutional Neural Networks
    Llerena Quenaya, Jan Franco
    Lopez Del Alamo, Cristian Jose
    [J]. 2017 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2017,
  • [32] Towards dense volumetric pancreas segmentation in CT using 3D fully convolutional networks
    Roth, Holger
    Oda, Masahiro
    Shimizu, Natsuki
    Oda, Hirohisa
    Hayashi, Yuichiro
    Kitasaka, Takayuki
    Fujiwara, Michitaka
    Misawa, Kazunari
    Mori, Kensaku
    [J]. MEDICAL IMAGING 2018: IMAGE PROCESSING, 2018, 10574
  • [33] Large-Scale Shape Retrieval with Sparse 3D Convolutional Neural Networks
    Notchenko, Alexandr
    Kapushev, Yermek
    Burnaev, Evgeny
    [J]. ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS, AIST 2017, 2018, 10716 : 245 - 254
  • [34] Sketch-based 3D Shape Retrieval using Convolutional Neural Networks
    Wang, Fang
    Kang, Le
    Li, Yi
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1875 - 1883
  • [35] Training deep convolutional neural networks to acquire the best view of a 3D shape
    Wen Zhou
    Jinyuan Jia
    [J]. Multimedia Tools and Applications, 2020, 79 : 581 - 601
  • [36] Balanced principal component for 3D shape recognition using convolutional neural networks
    Luo, Wenjie
    Zhang, Han
    Ni, Peng
    Tian, Xuedong
    [J]. IET IMAGE PROCESSING, 2020, 14 (17) : 4468 - 4476
  • [37] Fully Automated Pancreas Segmentation with Two-Stage 3D Convolutional Neural Networks
    Zhao, Ningning
    Tong, Nuo
    Ruan, Dan
    Sheng, Ke
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 201 - 209
  • [38] Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks
    Salehi, Seyed Sadegh Mohseni
    Erdogmus, Deniz
    Gholipour, Ali
    [J]. MACHINE LEARNING IN MEDICAL IMAGING (MLMI 2017), 2017, 10541 : 379 - 387
  • [39] 3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study
    Dolz, Jose
    Desrosiers, Christian
    Ben Ayed, Ismail
    [J]. NEUROIMAGE, 2018, 170 : 456 - 470
  • [40] Multi-class multimodal semantic segmentation with an improved 3D fully convolutional networks
    Jiang, Han
    Guo, Yanrong
    [J]. Neurocomputing, 2022, 391 : 220 - 226