3D Generative Model Latent Disentanglement via Local Eigenprojection

被引:1
|
作者
Foti, Simone [1 ]
Koo, Bongjin [1 ,2 ]
Stoyanov, Danail [1 ]
Clarkson, Matthew J. [1 ]
机构
[1] UCL, London, England
[2] Univ Calif Santa Barbara, Santa Barbara, CA USA
基金
英国惠康基金;
关键词
disentanglement; generative adversarial networks; geometric deep learning; variational autoencoder;
D O I
10.1111/cgf.14793
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Designing realistic digital humans is extremely complex. Most data-driven generative models used to simplify the creation of their underlying geometric shape do not offer control over the generation of local shape attributes. In this paper, we overcome this limitation by introducing a novel loss function grounded in spectral geometry and applicable to different neural-network-based generative models of 3D head and body meshes. Encouraging the latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks (GANs) to follow the local eigenprojections of identity attributes, we improve latent disentanglement and properly decouple the attribute creation. Experimental results show that our local eigenprojection disentangled (LED) models not only offer improved disentanglement with respect to the state-of-the-art, but also maintain good generation capabilities with training times comparable to the vanilla implementations of the models. Our code and pre-trained models are available at .
引用
收藏
页数:13
相关论文
共 50 条
  • [31] 3D textured model encryption via 3D Lu chaotic mapping
    Jin, Xin
    Zhu, Shuyun
    Xiao, Chaoen
    Sun, Hongbo
    Li, Xiaodong
    Zhao, Geng
    Ge, Shiming
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2017, 60 (12)
  • [32] 3D textured model encryption via 3D Lu chaotic mapping
    Xin JIN
    Shuyun ZHU
    Chaoen XIAO
    Hongbo SUN
    Xiaodong LI
    Geng ZHAO
    Shiming GE
    [J]. Science China(Information Sciences), 2017, 60 (12) : 224 - 232
  • [33] 3D textured model encryption via 3D Lu chaotic mapping
    Xin Jin
    Shuyun Zhu
    Chaoen Xiao
    Hongbo Sun
    Xiaodong Li
    Geng Zhao
    Shiming Ge
    [J]. Science China Information Sciences, 2017, 60
  • [34] A DASKL Descriptor via Encoding the Information of Keypoints and a 3D Local Surface for 3D Matching
    Wu, Yuanhao
    Wang, Chunyang
    Liu, Xuelian
    Shi, Chunhao
    Li, Xuemei
    [J]. ELECTRONICS, 2022, 11 (15)
  • [35] RGB-D face recognition under various conditions via 3D constrained local model
    Kaashki, Nastaran Nourbakhsh
    Safabakhsh, Reza
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 52 : 66 - 85
  • [36] The 3D Model Retrieval Based on Local Features
    Huo, Lei
    Lv, Xueqiang
    Zhang, Kai
    Li, Zhuo
    [J]. 2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014,
  • [37] Variational Autoencoder Model Based on 3D Convolutional Neural Network for generative design framework of 3D chair
    Park, T.
    Park, J. Min
    Murdivien, S. A.
    Um, J.
    [J]. INTERNATIONAL JOURNAL OF INDUSTRIAL ENGINEERING AND MANAGEMENT, 2024, 15 (01): : 1 - 17
  • [38] Learning a Hierarchical Latent-Variable Model of 3D Shapes
    Liu, Shikun
    Giles, C. Lee
    Ororbia, Alexander G., II
    [J]. 2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, : 542 - 551
  • [39] A Point Cloud Generative Model via Tree-Structured Graph Convolutions for 3D Brain Shape Reconstruction
    Hu, Bowen
    Lei, Baiying
    Shen, Yanyan
    Liu, Yong
    Wang, Shuqiang
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 263 - 274
  • [40] 3D solid model generation method based on a generative adversarial network
    Du, Wenfeng
    Xia, Zhuang
    Han, Leyu
    Gao, Boqing
    [J]. APPLIED INTELLIGENCE, 2023, 53 (13) : 17035 - 17060