3D face reconstruction from single image with generative adversarial networks

被引:2
|
作者
Malah, Mehdi [1 ]
Hemam, Mounir [1 ]
Abbas, Faycal [2 ]
机构
[1] Univ Abbes Laghrour Khenchela, ICOSI Lab, BP 1252, El Houria 40004, Algeria
[2] Univ Abbes Laghrour Khenchela, LESIA Lab, BP 1252, El Houria 40004, Algeria
关键词
Single image 3D reconstruction; Face reconstruction; Generative adversarial networks; Graph convolution networks; GAN;
D O I
10.1016/j.jksuci.2022.11.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional reconstruction techniques extract information from the object's geometry or one or more 2D images. On the other hand, the limit of the existing methods is that they generate less precise objects. Thus the lack of robustness towards several face reconstruction problems, such as the position of the head, occlusion, noise, and lighting variation. Therefore, generative neural networks and graphical convolution networks have marked a significant evolution in the field of 3D reconstruction. This paper proposes a model for 3D face reconstruction from a single 2D image. Our model is composed of a generator and a discriminator based on convolutional graphic layers. Indeed, in order to generate a face mesh with expression, our idea is to use the landmarks associated with this image as input to the generator to reconstruct a face geometry with expression and improve the convergence rate. As a result, our model offers an accurate reconstruction of facial geometry with expression; thus, our model outperforms state-of-the-art methods through qualitative and quantitative comparison.& COPY; 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:250 / 256
页数:7
相关论文
共 50 条
  • [1] GENERATIVE ADVERSARIAL NETWORKS FOR SINGLE PHOTO 3D RECONSTRUCTION
    Kniaz, V. V.
    Remondino, F.
    Knyaz, V. A.
    [J]. 8TH INTERNATIONAL WORKSHOP 3D-ARCH: 3D VIRTUAL RECONSTRUCTION AND VISUALIZATION OF COMPLEX ARCHITECTURES, 2019, 42-2 (W9): : 403 - 408
  • [2] 3D Face Image Inpainting with Generative Adversarial Nets
    Wei, Tongxin
    Li, Qingbao
    Liu, Jinjin
    Zhang, Ping
    Chen, Zhifeng
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [3] Generative adversarial networks and their application to 3D face generation: A survey
    Toshpulatov, Mukhiddin
    Lee, Wookey
    Lee, Suan
    [J]. IMAGE AND VISION COMPUTING, 2021, 108
  • [4] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [5] Face Reconstruction from Voice using Generative Adversarial Networks
    Wen, Yandong
    Singh, Rita
    Raj, Bhiksha
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [6] 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
    Kemelmacher-Shlizerman, Ira
    Basri, Ronen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 394 - 405
  • [7] Coarse to Fine 3D Face Reconstruction from Single Image
    Galteri, L.
    Ferrari, C.
    Lisanti, G.
    Berretti, S.
    Del Bimbo, A.
    [J]. 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 745 - 745
  • [8] 3D Reconstruction from a Single Image for a Chinese Talking Face
    Liu, Ning
    Fang, Ning
    Kamata, Seiichiro
    [J]. TENCON 2010: 2010 IEEE REGION 10 CONFERENCE, 2010, : 1613 - 1616
  • [9] Dense 3D Face Reconstruction from a Single RGB Image
    Mao, Jianxu
    Zhang, Yifeng
    Liu, Caiping
    Tao, Ziming
    Yi, Junfei
    Wang, Yaonan
    [J]. 2022 IEEE 25TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING, CSE, 2022, : 24 - 31
  • [10] 3D Face Reconstruction With Geometry Details From a Single Image
    Jiang, Luo
    Zhang, Juyong
    Deng, Bailin
    Li, Hao
    Liu, Ligang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 4756 - 4770