FaceVAE: Generation of a 3D Geometric Object Using Variational Autoencoders

被引:4
|
作者
Park, Sungsoo [1 ,2 ]
Kim, Hyeoncheol [2 ]
机构
[1] Korea Virtual Real Inc, Seoul 05719, South Korea
[2] Korea Univ, Dept Comp Sci & Engn, Seoul 02841, South Korea
关键词
VAE; deep learning; 3D geometry; graph data; generation model;
D O I
10.3390/electronics10222792
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning for 3D data has become a popular research theme in many fields. However, most of the research on 3D data is based on voxels, 2D images, and point clouds. At actual industrial sites, face-based geometry data are being used, but their direct application to industrial sites remains limited due to a lack of existing research. In this study, to overcome these limitations, we present a face-based variational autoencoder (FVAE) model that generates 3D geometry data using a variational autoencoder (VAE) model directly from face-based geometric data. Our model improves the existing node and edge-based adjacency matrix and optimizes it for geometric learning by using a face- and edge-based adjacency matrix according to the 3D geometry structure. In the experiment, we achieved the result of generating adjacency matrix information with 72% precision and 69% recall through end-to-end learning of Face-Based 3D Geometry. In addition, we presented various structurization methods for 3D unstructured geometry and compared their performance, and proved the method to effectively perform reconstruction of the learned structured data through experiments.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Plausible 3D Face Wrinkle Generation Using Variational Autoencoders
    Deng, Qixin
    Ma, Luming
    Jin, Aobo
    Bi, Huikun
    Le, Binh Huy
    Deng, Zhigang
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (09) : 3113 - 3125
  • [2] Scene Graph Masked Variational Autoencoders for 3D Scene Generation
    Xu, Rui
    Hui, Le
    Han, Yuehui
    Qian, Jianjun
    Xie, Jin
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5725 - 5733
  • [3] 3D Hair Synthesis Using Volumetric Variational Autoencoders
    Saito, Shunsuke
    Hu, Liwen
    Ma, Chongyang
    Ibayashi, Hikaru
    Luo, Linjie
    Li, Hao
    [J]. SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [4] 3D Hair Synthesis Using Volumetric Variational Autoencoders
    Saito, Shunsuke
    Hu, Liwen
    Ma, Chongyang
    Ibayashi, Hikaru
    Luo, Linjie
    Li, Hao
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):
  • [5] Variational autoencoders for 3D data processing
    Molnar, Szilard
    Tamas, Levente
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (02)
  • [6] Variational autoencoders for 3D data processing
    Szilárd Molnár
    Levente Tamás
    [J]. Artificial Intelligence Review, 57
  • [7] Voxel-Based 3D Object Reconstruction from Single 2D Image Using Variational Autoencoders
    Tahir, Rohan
    Sargano, Allah Bux
    Habib, Zulfiqar
    [J]. MATHEMATICS, 2021, 9 (18)
  • [8] Variational Autoencoders for Deforming 3D Mesh Models
    Tan, Qingyang
    Gao, Lin
    Lai, Yu-Kun
    Xia, Shihong
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5841 - 5850
  • [9] 3D SHAPE SYNTHESIS FOR CONCEPTUAL DESIGN AND OPTIMIZATION USING VARIATIONAL AUTOENCODERS
    Zhang, Wentai
    Yang, Zhangsihao
    Jiang, Haoliang
    Nigam, Suyash
    Yamakawa, Soji
    Furuhata, Tomotake
    Shimada, Kenji
    Kara, Levent Burak
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 2A, 2020,
  • [10] Towards 3D object recognition with contractive autoencoders
    Liu, Bo
    Kong, Lingcheng
    Zhao, Jianghai
    Wu, Jinghua
    Tan, Zhiying
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2016), 2016, 10033