BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation

被引:0
|
作者
Li, Xu [1 ]
Li, Bowei [2 ]
Fang, Minghao [3 ]
Huang, Rui [4 ]
Huang, Xiaoran [5 ]
机构
[1] Cent South Univ, Dept Comp Sci, Changsha 410083, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710126, Peoples R China
[3] Zhejiang Univ, Zhejiang Univ Univ Illinois Urbana Champaign Inst, Haining 314400, Peoples R China
[4] Zhejiang Univ, Sch Earth Sci, Hangzhou 310000, Peoples R China
[5] Nanjing Univ Posts & Telecommun, Sch Software Engn, Nanjing 210023, Peoples R China
关键词
anime face generation; self-attention generative adversarial network; blur dataset; memory replay; generative adversarial network; self-attention;
D O I
10.3390/math11204401
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we propose a novel network, self-attention generative adversarial network with blur and memory (BaMSGAN), for generating anime faces with improved clarity and faster convergence while retaining the capacity for continuous learning. Traditional self-attention generative adversarial networks (SAGANs) produce anime faces of higher quality compared to deep convolutional generative adversarial networks (DCGANs); however, some edges remain blurry and distorted, and the generation speed is sluggish. Additionally, common issues hinder the model's ability to learn continuously. To address these challenges, we introduce a blurring preprocessing step on a portion of the training dataset, which is then fed to the discriminator as fake data to encourage the model to avoid blurry edges. Furthermore, we incorporate regulation into the optimizer to mitigate mode collapse. Additionally, memory data stored in the memory repository is presented to the model every epoch to alleviate catastrophic forgetting, thereby enhancing performance throughout the training process. Experimental results demonstrate that BaMSGAN outperforms prior work in anime face generation, significantly reducing distortion rates and accelerating shape convergence.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Dialogue Generation Using Self-Attention Generative Adversarial Network
    Hatua, Amartya
    Nguyen, Trung T.
    Sung, Andrew H.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON CONVERSATIONAL DATA & KNOWLEDGE ENGINEERING (CDKE), 2019, : 33 - 38
  • [2] LinesToFacePhoto: Face Photo Generation From Lines With Conditional Self-Attention Generative Adversarial Network
    Li, Yuhang
    Chen, Xuejin
    Wu, Feng
    Zha, Zheng-Jun
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2323 - 2331
  • [3] SELF-ATTENTION GENERATIVE ADVERSARIAL NETWORK FOR SPEECH ENHANCEMENT
    Huy Phan
    Nguyen, Huy Le
    Chen, Oliver Y.
    Koch, Philipp
    Duong, Ngoc Q. K.
    McLoughlin, Ian
    Mertins, Alfred
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7103 - 7107
  • [4] Self-attention generative adversarial network with the conditional constraint
    Jia Y.
    Ma L.
    [J]. Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2019, 46 (06): : 163 - 170
  • [5] Self-Attention Generative Adversarial Networks
    Zhang, Han
    Goodfellow, Ian
    Metaxas, Dimitris
    Odena, Augustus
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [6] Self-attention generative adversarial networks applied to conditional music generation
    Pedro Lucas Tomaz Neves
    José Fornari
    João Batista Florindo
    [J]. Multimedia Tools and Applications, 2022, 81 : 24419 - 24430
  • [7] Self-attention generative adversarial networks applied to conditional music generation
    Tomaz Neves, Pedro Lucas
    Fornari, Jose
    Florindo, Joao Batista
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (17) : 24419 - 24430
  • [8] Sample Generation with Self-Attention Generative Adversarial Adaptation Network (SaGAAN) for Hyperspectral Image Classification
    Zhao, Wenzhi
    Chen, Xi
    Chen, Jiage
    Qu, Yang
    [J]. REMOTE SENSING, 2020, 12 (05)
  • [9] SAPCGAN: Self-Attention based Generative Adversarial Network for Point Clouds
    Li, Yushi
    Baciu, George
    [J]. PROCEEDINGS OF 2020 IEEE 19TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC 2020), 2020, : 52 - 59
  • [10] Self-Attention Generative Adversarial Network for Synthetic CT Generation from CBCT in Head and Neck Radiotherapy
    Wu, S.
    Liu, S.
    Qian, D.
    Wang, R.
    Chen, H.
    Lu, Y.
    Sun, Y.
    [J]. MEDICAL PHYSICS, 2021, 48 (06)