A Style-Based Generator Architecture for Generative Adversarial Networks

被引:1243
|
作者
Karras, Tero [1 ]
Laine, Samuli [1 ]
Aila, Timo [1 ]
机构
[1] NVIDIA Corp, Helsinki 00180, Finland
关键词
Generators; Convolution; Training; Image resolution; Aerospace electronics; Generative adversarial networks; Interpolation; Generative models; deep learning; neural networks;
D O I
10.1109/TPAMI.2020.2970919
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an alternative generator architecture for generative adversarial networks, borrowing from style transfer literature. The new architecture leads to an automatically learned, unsupervised separation of high-level attributes (e.g., pose and identity when trained on human faces) and stochastic variation in the generated images (e.g., freckles, hair), and it enables intuitive, scale-specific control of the synthesis. The new generator improves the state-of-the-art in terms of traditional distribution quality metrics, leads to demonstrably better interpolation properties, and also better disentangles the latent factors of variation. To quantify interpolation quality and disentanglement, we propose two new, automated methods that are applicable to any generator architecture. Finally, we introduce a new, highly varied and high-quality dataset of human faces.
引用
收藏
页码:4217 / 4228
页数:12
相关论文
共 50 条
  • [1] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4396 - 4405
  • [2] Microstructure synthesis using style-based generative adversarial networks
    Fokina, Daria
    Muravleva, Ekaterina
    Ovchinnikov, George
    Oseledets, Ivan
    [J]. PHYSICAL REVIEW E, 2020, 101 (04)
  • [3] Style-based quantum generative adversarial networks for Monte Carlo events
    Bravo-Prieto, Carlos
    Baglio, Julien
    Ce, Marco
    Francis, Anthony
    Grabowska, Dorota M.
    Carrazza, Stefano
    [J]. QUANTUM, 2022, 6
  • [4] Conditional Style-Based Generative Adversarial Networks for Renewable Scenario Generation
    Yuan, Ran
    Wang, Bo
    Sun, Yeqi
    Song, Xuanning
    Watada, Junzo
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (02) : 1281 - 1296
  • [5] TLGAN: Conditional Style-Based Traffic light Generation with Generative Adversarial Networks
    Wang, Danfeng
    Ma, Xin
    [J]. 2021 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE BIG DATA AND INTELLIGENT SYSTEMS (HPBD&IS), 2021, : 192 - 195
  • [6] 3D Segmentation Guided Style-Based Generative Adversarial Networks for PET Synthesis
    Zhou, Yang
    Yang, Zhiwen
    Zhang, Hui
    Chang, Eric I-Chao
    Fan, Yubo
    Xu, Yan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (08) : 2092 - 2104
  • [7] Time-Domain Signal Synthesis with Style-Based Generative Adversarial Networks Applied to Guided Waves
    Heesch, Mateusz
    Mendrok, Krzysztof
    Dworakowski, Ziemowit
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING (ICAISC 2021), PT I, 2021, 12854 : 78 - 88
  • [8] StyleWaveGAN: Style-based synthesis of drum sounds using generative adversarial networks for higher audio quality
    Lavault, Antoine
    Roebel, Axel
    Voiry, Matthieu
    [J]. 2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 234 - 238
  • [9] Style-based Point Generator with Adversarial Rendering for Point Cloud Completion
    Xie, Chulin
    Wang, Chuxin
    Zhang, Bo
    Yang, Hao
    Chen, Dong
    Wen, Fang
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4617 - 4626
  • [10] A Style-Based Caricature Generator
    Laishram, Lamyanba
    Shaheryar, Muhammad
    Lee, Jong Taek
    Jung, Soon Ki
    [J]. FRONTIERS OF COMPUTER VISION, IW-FCV 2023, 2023, 1857 : 71 - 82