Face Image Inpainting via Variational Autoencoder

被引：0
|
作者：
Zhang X. [1 ,2 ]
Cheng L. [2 ]
Bai S. [2 ]
Zhang F. [3 ]
Sun N. [1 ]
Wang Z. [2 ]
机构：
[1] College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao
[2] State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou
[3] College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou
来源：
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2020年 / 32卷 / 03期
关键词：
Discriminative network; Disentanglement; Image fusion; Image inpainting; Variational autoencoder;
D O I：
10.3724/SP.J.1089.2020.17938
中图分类号：
学科分类号：
摘要：
Face image inpainting based on the convolutional neural network has enabled a variety of applications, ranging from criminal investigation to cultural relics protection. However, the results of existing methods are often limited to insufficient diversity and still far from realistic. In this work, we generate more reasonable missing facial content with a variant of variational auto-encoder, as well as generative adversarial network. Furthermore, we impose constraints on latent variables to encourage the distribution of representations to be factorial that making them independent across dimensions. Latter, the optimal boundary was obtained through dynamic programming, and finally we get the seamless results by Poisson image editing. Experiments on CelebA dataset demonstrated that the proposed method achieved better inpainting results and disentanglement. © 2020, Beijing China Science Journal Publishing Co. Ltd. All right reserved.
引用
收藏
页码：401 / 409
页数：8
相关论文
共 30 条
  • [11] Yu J.H., Lin Z., Yang J.M., Et al., Generative image inpainting with contextual attention, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5505-5514, (2018)
  • [12] Song Y.H., Yang C., Lin Z., Et al., Contextual-based image inpainting: infer, match, and translate, Proceedings of European Conference on Computer Vision, pp. 3-18, (2018)
  • [13] Kingma D.P., Welling M., Auto-encoding variational bayes
  • [14] Perez P., Gangnet M., Blake A., Poisson image editing, ACM Transactions on Graphics, 22, 3, pp. 313-318, (2003)
  • [15] Goodfellow I., Pouget-Abadie J., Mirza M., Et al., Generative adversarial nets, Proceedings of the 27th International Conference on Neural Information Processing Systems, pp. 2672-2680, (2014)
  • [16] Liu Z.W., Luo P., Wang X.G., Et al., Deep learning face attributes in the wild, Proceedings of the IEEE International Conference on Computer Vision, pp. 3730-3738, (2015)
  • [17] Yeh R.A., Chen C., Lim T.Y., Et al., Semantic image inpainting with deep generative models, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5485-5493, (2017)
  • [18] Elad A., Kerzhner Y., Romano Y., Image Inpainting Using Pre-Trained Classification-CNN, (2018)
  • [19] Altinel F., Ozay M., Okatani T., Deep structured energy-based image inpainting, Proceedings of the 24th International Conference on Pattern Recognition, pp. 423-428, (2018)
  • [20] van den Oord A., Kalchbrenner N., Kavukcuoglu K., Pixel recurrent neural networks
123