Face Image Inpainting With Evolutionary Generators

被引:16
|
作者
Han, Chong [1 ]
Wang, Junli [1 ]
机构
[1] Tongji Univ, Dept Elect & Informat Engn, Shanghai 201804, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Neuro-evolution; Autoencoder; Generative Adversarial Networks; Face Image Inpainting;
D O I
10.1109/LSP.2020.3048608
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, deep learning has become a mainstream method of image inpainting. It can not only restore the image texture, obtain high-level abstract features of images, but also restore semantic images such as human face images. Among these methods, generative adversarial networks (GANs) using autoencoder as the generator have become the promising model for image inpainting. These models implement the end-to-end image inpainting and also generate visually reasonable and clear image structures and textures. However, GANs often have problems with gradient vanishing and model collapse during training, so we propose a Generative Adversarial Network with Evolutionary Generators (EG-GAN) and apply it in face image inpainting. To stabilize the model training process, EG-GAN trains the generator network by evolution, combines two mutation functions as a training objective to update the parameter of generator networks, and produces offspring generators through crossover, using the matcher assists the discriminator to criticize the generated image. Experiments on various face image datasets such as CelebA-HQ and CelebA show that EG-GAN successfully overcomes the gradient vanishing problem, achieves stable and efficient training, and generates visually reasonable images.
引用
收藏
页码:190 / 193
页数:4
相关论文
共 50 条
  • [1] Face Image Inpainting via Variational Autoencoder
    Zhang X.
    Cheng L.
    Bai S.
    Zhang F.
    Sun N.
    Wang Z.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (03): : 401 - 409
  • [2] Face Image Inpainting Using Attribute Guided
    Zhang F.
    Ye K.
    Wang L.
    Liu Z.
    Wang Z.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (07): : 1085 - 1094
  • [3] A Survey of Face Image Inpainting Based on Deep Learning
    Su, Shiqi
    Yang, Miao
    He, Libo
    Shao, Xiaofeng
    Zuo, Yuxuan
    Qiang, Zhenping
    CLOUD COMPUTING, CLOUDCOMP 2021, 2022, 430 : 72 - 87
  • [4] Face Inpainting with Pre-trained Image Transformers
    Gonc, Kaan
    Saglam, Baturay
    Kozat, Suleyman S.
    Dibeklioglu, Hamdi
    2022 30TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2022,
  • [5] Face Image Inpainting Based on Generative Adversarial Network
    Gao, Xinyi
    Minh Nguyen
    Yan, Wei Qi
    PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,
  • [6] Learning Adaptive Patch Generators for Mask-Robust Image Inpainting
    Sun, Hongyi
    Li, Wanhua
    Duan, Yueqi
    Zhou, Jie
    Lu, Jiwen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4240 - 4252
  • [7] Image inpainting algorithm based on TV model and evolutionary algorithm
    Li, Kangshun
    Wei, Yunshan
    Yang, Zhen
    Wei, Wenhua
    SOFT COMPUTING, 2016, 20 (03) : 885 - 893
  • [8] Face Image Inpainting Algorithm Based on Generative Adversarial Network
    Miao, Yalin
    Jia, Huanhuan
    Liu, Xuemin
    Zhang, Yang
    Zhao, Liyi
    2019 6TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2019), 2019, : 282 - 286
  • [9] Face Image Inpainting Using Cascaded Generative Adversarial Networks
    Chen J.-Z.
    Wang J.
    Gong X.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (06): : 910 - 917
  • [10] Semantic face image inpainting based on Generative Adversarial Network
    Zhang, Heshu
    Li, Tao
    2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2020, : 530 - 535