3D face reconstruction from single image with generative adversarial networks

被引:2
|
作者
Malah, Mehdi [1 ]
Hemam, Mounir [1 ]
Abbas, Faycal [2 ]
机构
[1] Univ Abbes Laghrour Khenchela, ICOSI Lab, BP 1252, El Houria 40004, Algeria
[2] Univ Abbes Laghrour Khenchela, LESIA Lab, BP 1252, El Houria 40004, Algeria
关键词
Single image 3D reconstruction; Face reconstruction; Generative adversarial networks; Graph convolution networks; GAN;
D O I
10.1016/j.jksuci.2022.11.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional reconstruction techniques extract information from the object's geometry or one or more 2D images. On the other hand, the limit of the existing methods is that they generate less precise objects. Thus the lack of robustness towards several face reconstruction problems, such as the position of the head, occlusion, noise, and lighting variation. Therefore, generative neural networks and graphical convolution networks have marked a significant evolution in the field of 3D reconstruction. This paper proposes a model for 3D face reconstruction from a single 2D image. Our model is composed of a generator and a discriminator based on convolutional graphic layers. Indeed, in order to generate a face mesh with expression, our idea is to use the landmarks associated with this image as input to the generator to reconstruct a face geometry with expression and improve the convergence rate. As a result, our model offers an accurate reconstruction of facial geometry with expression; thus, our model outperforms state-of-the-art methods through qualitative and quantitative comparison.& COPY; 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:250 / 256
页数:7
相关论文
共 50 条
  • [41] Research on 3D Reconstruction of Human Face Based on Single Image
    Zhang, Chaoying
    Su, Minglan
    Liu, Qiaoqiao
    Liang, Baolin
    Wang, Jianxiu
    [J]. 2021 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, INFORMATION AND COMMUNICATION ENGINEERING, 2021, 11933
  • [42] Review of Single-Image 3D Face Reconstruction Methods
    Wang, Jingting
    Li, Huibin
    [J]. Computer Engineering and Applications, 2023, 59 (17) : 1 - 21
  • [43] Application of generative adversarial networks in image, face reconstruction and medical imaging: challenges and the current progress
    Sabnam, Sadeeba
    Rajagopal, Sivakumar
    [J]. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2024, 12 (01):
  • [44] 3D Human Pose Estimation With Generative Adversarial Networks
    Xia, Hailun
    Xiao, Meng
    [J]. IEEE ACCESS, 2020, 8 : 206198 - 206206
  • [45] A systematic literature review of generative adversarial networks (GANs) in 3D avatar reconstruction from 2D images
    Koh, Angela Jia Hui
    Tan, Siok Yee
    Nasrudin, Mohammad Faidzul
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (26) : 68813 - 68853
  • [46] Normalized Face Image Generation with Perceptron Generative Adversarial Networks
    Liu, Xiaofeng
    Kumar, B. V. K. Vijaya
    Ge, Yubin
    Yang, Chao
    You, Jane
    Jia, Ping
    [J]. 2018 IEEE 4TH INTERNATIONAL CONFERENCE ON IDENTITY, SECURITY, AND BEHAVIOR ANALYSIS (ISBA), 2018,
  • [47] Cost-efficient 3D Face Reconstruction from a Single 2D Image
    Yun, Juseung
    Lee, Jaeyoung
    Han, Dongyoon
    Ju, Jeongwoo
    Kim, Junmo
    [J]. 2017 19TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATIONS TECHNOLOGY (ICACT) - OPENING NEW ERA OF SMART SOCIETY, 2017, : 629 - 632
  • [48] Face It: 3D Facial Reconstruction from a Single 2D Image for Games and Simulations
    Kirtzic, J. Steven
    Daescu, Ovidiu
    [J]. 2011 INTERNATIONAL CONFERENCE ON CYBERWORLDS, 2011, : 244 - 248
  • [49] 3D Face Reconstruction From Single 2D Image Using Distinctive Features
    Afzal, H. M. Rehan
    Luo, Suhuai
    Afzal, M. Kamran
    Chaudhary, Gopal
    Khari, Manju
    Kumar, Sathish A. P.
    [J]. IEEE ACCESS, 2020, 8 (08): : 180681 - 180689
  • [50] Face Image Inpainting Using Cascaded Generative Adversarial Networks
    Chen J.-Z.
    Wang J.
    Gong X.
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (06): : 910 - 917