A survey of deep learning-based 3D shape generation

被引:3
|
作者
Xu, Qun-Ce [1 ]
Mu, Tai-Jiang [1 ]
Yang, Yong-Liang [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, BNRist, Beijing 100084, Peoples R China
[2] Univ Bath, Dept Comp Sci, Bath, England
基金
中国国家自然科学基金;
关键词
3D representations; geometry learning; generative models; deep learning; MODELS;
D O I
10.1007/s41095-022-0321-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep learning has been successfully used for tasks in the 2D image domain. Research on 3D computer vision and deep geometry learning has also attracted attention. Considerable achievements have been made regarding feature extraction and discrimination of 3D shapes. Following recent advances in deep generative models such as generative adversarial networks, effective generation of 3D shapes has become an active research topic. Unlike 2D images with a regular grid structure, 3D shapes have various representations, such as voxels, point clouds, meshes, and implicit functions. For deep learning of 3D shapes, shape representation has to be taken into account as there is no unified representation that can cover all tasks well. Factors such as the representativeness of geometry and topology often largely affect the quality of the generated 3D shapes. In this survey, we comprehensively review works on deep-learning-based 3D shape generation by classifying and discussing them in terms of the underlying shape representation and the architecture of the shape generator. The advantages and disadvantages of each class are further analyzed. We also consider the 3D shape datasets commonly used for shape generation. Finally, we present several potential research directions that hopefully can inspire future works on this topic.
引用
收藏
页码:407 / 442
页数:36
相关论文
共 50 条
  • [1] A survey of deep learning-based 3D shape generation
    Qun-Ce Xu
    Tai-Jiang Mu
    Yong-Liang Yang
    Computational Visual Media, 2023, 9 : 407 - 442
  • [2] Deep learning-based 3D reconstruction: a survey
    Samavati, Taha
    Soryani, Mohsen
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (09) : 9175 - 9219
  • [3] Deep learning-based 3D reconstruction: a survey
    Taha Samavati
    Mohsen Soryani
    Artificial Intelligence Review, 2023, 56 : 9175 - 9219
  • [4] 3D shape sensing and deep learning-based segmentation of strawberries
    Le Louëdec J.
    Cielniak G.
    Computers and Electronics in Agriculture, 2021, 190
  • [5] Deep learning-based action recognition with 3D skeleton: A survey
    Xing, Yuling
    Zhu, Jia
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (01) : 80 - 92
  • [6] Survey on deep learning-based 3D object detection in autonomous driving
    Liang, Zhenming
    Huang, Yingping
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023, 45 (04) : 761 - 776
  • [7] Deep learning-based 3D reconstruction from multiple images: A survey
    Wang, Chuhua
    Reza, Md Alimoor
    Vats, Vibhas
    Ju, Yingnan
    Thakurdesai, Nikhil
    Wang, Yuchen
    Crandall, David J.
    Jung, Soon-heung
    Seo, Jeongil
    NEUROCOMPUTING, 2024, 597
  • [8] Deep learning-based framework for Shape Instance Registration on 3D CAD models
    Figueiredo, Lucas
    Ivson, Paulo
    Celes, Waldemar
    COMPUTERS & GRAPHICS-UK, 2021, 101 : 72 - 81
  • [9] Deep learning-based 3D point cloud classification: A systematic survey and outlook
    Zhang, Huang
    Wang, Changshuo
    Tian, Shengwei
    Lu, Baoli
    Zhang, Liping
    Ning, Xin
    Bai, Xiao
    DISPLAYS, 2023, 79
  • [10] A Dictionary Learning-Based 3D Morphable Shape Model
    Ferrari, Claudio
    Lisanti, Giuseppe
    Berretti, Stefano
    Del Bimbo, Alberto
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (12) : 2666 - 2679