BaMSGAN: Self-Attention Generative Adversarial Network with Blur and Memory for Anime Face Generation

被引:0
|
作者
Li, Xu [1 ]
Li, Bowei [2 ]
Fang, Minghao [3 ]
Huang, Rui [4 ]
Huang, Xiaoran [5 ]
机构
[1] Cent South Univ, Dept Comp Sci, Changsha 410083, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710126, Peoples R China
[3] Zhejiang Univ, Zhejiang Univ Univ Illinois Urbana Champaign Inst, Haining 314400, Peoples R China
[4] Zhejiang Univ, Sch Earth Sci, Hangzhou 310000, Peoples R China
[5] Nanjing Univ Posts & Telecommun, Sch Software Engn, Nanjing 210023, Peoples R China
关键词
anime face generation; self-attention generative adversarial network; blur dataset; memory replay; generative adversarial network; self-attention;
D O I
10.3390/math11204401
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we propose a novel network, self-attention generative adversarial network with blur and memory (BaMSGAN), for generating anime faces with improved clarity and faster convergence while retaining the capacity for continuous learning. Traditional self-attention generative adversarial networks (SAGANs) produce anime faces of higher quality compared to deep convolutional generative adversarial networks (DCGANs); however, some edges remain blurry and distorted, and the generation speed is sluggish. Additionally, common issues hinder the model's ability to learn continuously. To address these challenges, we introduce a blurring preprocessing step on a portion of the training dataset, which is then fed to the discriminator as fake data to encourage the model to avoid blurry edges. Furthermore, we incorporate regulation into the optimizer to mitigate mode collapse. Additionally, memory data stored in the memory repository is presented to the model every epoch to alleviate catastrophic forgetting, thereby enhancing performance throughout the training process. Experimental results demonstrate that BaMSGAN outperforms prior work in anime face generation, significantly reducing distortion rates and accelerating shape convergence.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Application of Self-Attention Generative Adversarial Network for Electromagnetic Imaging in Half-Space
    Chiu, Chien-Ching
    Lee, Yang-Han
    Chen, Po-Hsiang
    Shih, Ying-Chen
    Hao, Jiang
    [J]. SENSORS, 2024, 24 (07)
  • [22] Multi-scale self-attention generative adversarial network for pathology image restoration
    Meiyan Liang
    Qiannan Zhang
    Guogang Wang
    Na Xu
    Lin Wang
    Haishun Liu
    Cunlin Zhang
    [J]. The Visual Computer, 2023, 39 : 4305 - 4321
  • [23] Improved self-attention generative adversarial adaptation network-based melanoma classification
    Gowthami, S.
    Harikumar, R.
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (03) : 4113 - 4122
  • [24] Unsupervised Training Data Generation of Handwritten Formulas using Generative Adversarial Networks with Self-Attention
    Springstein, Matthias
    Mueller-Budack, Eric
    Ewerth, Ralph
    [J]. MMPT '21: PROCEEDINGS OF THE 2021 WORKSHOP ON MULTI-MODAL PRE-TRAINING FOR MULTIMEDIA UNDERSTANDING, 2021, : 46 - 54
  • [25] Stroke Electroencephalogram Data Synthesizing through Progressive Efficient Self-Attention Generative Adversarial Network
    Wang, Suzhe
    Zhang, Xueying
    Li, Fenglian
    Wu, Zelin
    [J]. Computers, Materials and Continua, 2024, 81 (01): : 1177 - 1196
  • [26] SA-CapsGAN: Using Capsule Networks with embedded self-attention for Generative Adversarial Network
    Sun, Guangcong
    Ding, Shifei
    Sun, Tongfeng
    Zhang, Chenglong
    [J]. NEUROCOMPUTING, 2021, 423 (423) : 399 - 406
  • [27] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Niu, Jiawei
    Liu, Zhunga
    Pan, Quan
    Yang, Yanbo
    LI, Yang
    [J]. CHINESE JOURNAL OF AERONAUTICS, 2023, 36 (03) : 303 - 315
  • [28] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Jiawei NIU
    Zhunga LIU
    Quan PAN
    Yanbo YANG
    Yang LI
    [J]. Chinese Journal of Aeronautics, 2023, (03) : 303 - 315
  • [29] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Jiawei NIU
    Zhunga LIU
    Quan PAN
    Yanbo YANG
    Yang LI
    [J]. Chinese Journal of Aeronautics, 2023, 36 (03) : 303 - 315
  • [30] AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation
    Li, Bing
    Zhu, Yuanlue
    Wang, Yitong
    Lin, Chia-Wen
    Ghanem, Bernard
    Shen, Linlin
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4077 - 4091