3D Generative Model Latent Disentanglement via Local Eigenprojection

被引:1
|
作者
Foti, Simone [1 ]
Koo, Bongjin [1 ,2 ]
Stoyanov, Danail [1 ]
Clarkson, Matthew J. [1 ]
机构
[1] UCL, London, England
[2] Univ Calif Santa Barbara, Santa Barbara, CA USA
基金
英国惠康基金;
关键词
disentanglement; generative adversarial networks; geometric deep learning; variational autoencoder;
D O I
10.1111/cgf.14793
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Designing realistic digital humans is extremely complex. Most data-driven generative models used to simplify the creation of their underlying geometric shape do not offer control over the generation of local shape attributes. In this paper, we overcome this limitation by introducing a novel loss function grounded in spectral geometry and applicable to different neural-network-based generative models of 3D head and body meshes. Encouraging the latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks (GANs) to follow the local eigenprojections of identity attributes, we improve latent disentanglement and properly decouple the attribute creation. Experimental results show that our local eigenprojection disentangled (LED) models not only offer improved disentanglement with respect to the state-of-the-art, but also maintain good generation capabilities with training times comparable to the vanilla implementations of the models. Our code and pre-trained models are available at .
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Deep 3D morphable model refinement via progressive growing of conditional Generative Adversarial Networks
    Galteri, Leonardo
    Ferrari, Claudio
    Lisanti, Giuseppe
    Berretti, Stefano
    Del Bimbo, Alberto
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 185 : 31 - 42
  • [22] Neural 3D face rendering conditioned on 2D appearance via GAN disentanglement method
    Chen, Ruizhao
    Yi, Ran
    Wang, Tuanfeng Yang
    Ma, Lizhuang
    [J]. COMPUTERS & GRAPHICS-UK, 2023, 116 : 336 - 344
  • [23] Generative tracking of 3D human motion in latent space by sequential clonal selection algorithm
    Yi Li
    Zhengxing Sun
    [J]. Multimedia Tools and Applications, 2014, 69 : 79 - 109
  • [24] Generative tracking of 3D human motion in latent space by sequential clonal selection algorithm
    Li, Yi
    Sun, Zhengxing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 69 (01) : 79 - 109
  • [25] A deep generative model of 3D single-cell organization
    Donovan-Maiye, Rory M.
    Brown, Jackson M.
    Chan, Caleb K.
    Ding, Liya
    Yan, Calysta
    Gaudreault, Nathalie
    Theriot, Julie A.
    Maleckar, Mary M.
    Knijnenburg, Theo A.
    Johnson, Gregory R.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2022, 18 (01)
  • [26] Paired 3D Model Generation with Conditional Generative Adversarial Networks
    Ongun, Cihan
    Temizel, Alptekin
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I, 2019, 11129 : 473 - 487
  • [27] 3D visualization model construction based on generative adversarial networks
    Liu, Xiaojuan
    Zhou, Shangbo
    Wu, Sheng
    Tan, Duo
    Yao, Rui
    [J]. PEERJ COMPUTER SCIENCE, 2022, 8
  • [28] A 3D Generative Model for Structure-Based Drug Design
    Luo, Shitong
    Guan, Jiaqi
    Ma, Jianzhu
    Peng, Jian
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [29] A single 3D shape wavelet-based generative model
    Huang, Hao
    Yuan, Shuaihang
    Peng, Zheng
    Hao, Yu
    Wen, Congcong
    Fang, Yi
    [J]. COMPUTERS & GRAPHICS-UK, 2024, 119
  • [30] Personalized Audio-Driven 3D Facial Animation via Style-Content Disentanglement
    Chai, Yujin
    Shao, Tianjia
    Weng, Yanlin
    Zhou, Kun
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (03) : 1803 - 1820