Face Image Inpainting via Variational Autoencoder

被引：0

作者：

Zhang X. ^{[1
,2
]}

Cheng L. ^{[2
]}

Bai S. ^{[2
]}

Zhang F. ^{[3
]}

Sun N. ^{[1
]}

Wang Z. ^{[2
]}

机构：

[1] College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao

[2] State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou

[3] College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou

来源：

Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2020年 / 32卷 / 03期

关键词：

Discriminative network; Disentanglement; Image fusion; Image inpainting; Variational autoencoder;

D O I：

10.3724/SP.J.1089.2020.17938

中图分类号：

学科分类号：

摘要：

Face image inpainting based on the convolutional neural network has enabled a variety of applications, ranging from criminal investigation to cultural relics protection. However, the results of existing methods are often limited to insufficient diversity and still far from realistic. In this work, we generate more reasonable missing facial content with a variant of variational auto-encoder, as well as generative adversarial network. Furthermore, we impose constraints on latent variables to encourage the distribution of representations to be factorial that making them independent across dimensions. Latter, the optimal boundary was obtained through dynamic programming, and finally we get the seamless results by Poisson image editing. Experiments on CelebA dataset demonstrated that the proposed method achieved better inpainting results and disentanglement. © 2020, Beijing China Science Journal Publishing Co. Ltd. All right reserved.

引用

页码：401 / 409

页数：8

共 30 条

[1] Bertalmio M., Sapiro G., Caselles V., Et al., Image inpainting, Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417-424, (2000)
[2] Chan T., Shen J., Mathematical Models for Local Deterministic Inpainting, (2000)
[3] Barnes C., Shechtman E., Finkelstein A., Et al., PatchMatch: a randomized correspondence algorithm for structural image editing, ACM Transactions on Graphics, 28, 3, (2009)
[4] Chan T.F., Shen J.H., Nontexture inpainting by curvature-driven diffusions, Journal of Visual Communication and Image Representation, 12, 4, pp. 436-449, (2001)
[5] Oliveira M.M., Bowen B., Mckenna R., Et al., Fast digital image inpainting, Proceedings of the International Conference on Visualization and Image Processing, pp. 261-266, (2001)
[6] Zhou T., Tang F., Wang J., Et al., Digital image inpainting with radial basis functions, Journal of Image and Graphics, 9, 10, pp. 1190-1196, (2004)
[7] Pathak D., Krahenbuhl P., Donahue J., Et al., Context encoders: feature learning by inpainting, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2536-2544, (2016)
[8] Yang C., Lu X., Lin Z., Et al., High-resolution image inpainting using multi-scale neural patch synthesis, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6721-6729, (2017)
[9] Li Y.J., Liu S.F., Yang J.M., Et al., Generative face completion, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3911-3919, (2017)
[10] Iizuka S., Simo-Serra E., Ishikawa H., Globally and locally consistent image completion, ACM Transactions on Graphics, 36, 4, (2017)

← 1 2 3 →