Face Image Inpainting With Evolutionary Generators

被引:16
|
作者
Han, Chong [1 ]
Wang, Junli [1 ]
机构
[1] Tongji Univ, Dept Elect & Informat Engn, Shanghai 201804, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Neuro-evolution; Autoencoder; Generative Adversarial Networks; Face Image Inpainting;
D O I
10.1109/LSP.2020.3048608
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, deep learning has become a mainstream method of image inpainting. It can not only restore the image texture, obtain high-level abstract features of images, but also restore semantic images such as human face images. Among these methods, generative adversarial networks (GANs) using autoencoder as the generator have become the promising model for image inpainting. These models implement the end-to-end image inpainting and also generate visually reasonable and clear image structures and textures. However, GANs often have problems with gradient vanishing and model collapse during training, so we propose a Generative Adversarial Network with Evolutionary Generators (EG-GAN) and apply it in face image inpainting. To stabilize the model training process, EG-GAN trains the generator network by evolution, combines two mutation functions as a training objective to update the parameter of generator networks, and produces offspring generators through crossover, using the matcher assists the discriminator to criticize the generated image. Experiments on various face image datasets such as CelebA-HQ and CelebA show that EG-GAN successfully overcomes the gradient vanishing problem, achieves stable and efficient training, and generates visually reasonable images.
引用
收藏
页码:190 / 193
页数:4
相关论文
共 50 条
  • [31] An image inpainting method
    Li, BR
    Qi, Y
    Shen, XK
    NINTH INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN AND COMPUTER GRAPHICS, PROCEEDINGS, 2005, : 531 - 536
  • [32] Image Inpainting: A Review
    Elharrouss, Omar
    Almaadeed, Noor
    Al-Maadeed, Somaya
    Akbari, Younes
    NEURAL PROCESSING LETTERS, 2020, 51 (02) : 2007 - 2028
  • [33] Image affine inpainting
    Wang, Zhaozhong
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2008, 5112 : 1061 - 1070
  • [34] Generative face inpainting hashing for occluded face retrieval
    Yang, Yuxiang
    Tian, Xing
    Ng, Wing W. Y.
    Wang, Ran
    Gao, Ying
    Kwong, Sam
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (05) : 1725 - 1738
  • [35] Digital inpainting - Survey and multilayer image inpainting algorithms
    Shih, TK
    Chang, RC
    THIRD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND APPLICATIONS, VOL 1, PROCEEDINGS, 2005, : 15 - 24
  • [36] Image Inpainting Based on Image Segmentation
    Zhang, Ru
    Chen, Qiujiang
    Miao, Zhenjiang
    Tang, Zhen
    ICWMMN 2010, PROCEEDINGS, 2010, : 315 - +
  • [37] Image inpainting under single image
    Ma, Wenjuan
    Hu, Maolin
    Hu, Pengyong
    CISP 2008: FIRST INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOL 1, PROCEEDINGS, 2008, : 636 - 640
  • [38] Inpainting with style: forcing style coherence to image inpainting with deep image prior
    Morotti, Elena
    Merizzi, Fabio
    Evangelista, Davide
    Cascarano, Pasquale
    FRONTIERS IN COMPUTER SCIENCE, 2024, 6
  • [39] Extracting Facial Features and Face Inpainting
    Yu, Lin Chun
    Tang, Nick C.
    Jun, Huang Bo
    Shih, Timothy K.
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2008, 9TH PACIFIC RIM CONFERENCE ON MULTIMEDIA, 2008, 5353 : 863 - 866
  • [40] Large Inpainting of Face Images With Trainlets
    Sulam, Jeremias
    Elad, Michael
    IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (12) : 1839 - 1843