Method for Generating Panoramic Textures for 3D Face Reconstruction Based on the 3D Morphable Model

被引:0
|
作者
Hao, Shujia [1 ]
Wen, Mingyun [1 ]
Cho, Kyungeun [1 ]
机构
[1] Dongguk Univ Seoul, Dept Multimedia Engn, 30,Pildong Ro 1 Gil, Seoul 04620, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 19期
基金
新加坡国家研究基金会;
关键词
panoramic texture generation; deep learning; adversarial learning; image translation;
D O I
10.3390/app121910020
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Three-dimensional (3D) reconstruction techniques are playing an increasingly important role in education and entertainment. Real and recognizable avatars can enhance the immersion and interactivity of virtual systems. In 3D face modeling technology, face texture carries vital face recognition information. Therefore, this study proposes a panoramic 3D face texture generation method for 3D face reconstruction from a single 2D face image based on a 3D Morphable model (3DMM). Realistic and comprehensive panoramic facial textures can be obtained using generative networks as texture converters. Furthermore, we propose a low-cost method for generating face texture datasets for data collection. Experimental results show that the proposed method can generate panoramic face textures for 3D face meshes from a single image input, resulting in the final generation of textured 3D models that look realistic from different viewpoints.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Mesh resampling alignment for 3D face morphable model
    Hu, YL
    Yin, BC
    Sun, YF
    [J]. PROCEEDINGS OF THE 2004 INTERNATIONAL SYMPOSIUM ON INTELLIGENT MULTIMEDIA, VIDEO AND SPEECH PROCESSING, 2004, : 250 - 253
  • [32] 3D Morphable Face Models Revisited
    Patel, Ankur
    Smith, William A. P.
    [J]. CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 1327 - 1334
  • [33] 3D Morphable Face Models and Their Applications
    Kittler, Josef
    Huber, Patrik
    Feng, Zhen-Hua
    Hu, Guosheng
    Christmas, William
    [J]. ARTICULATED MOTION AND DEFORMABLE OBJECTS, 2016, 9756 : 185 - 206
  • [34] Expression Invariant 3D Face Recognition with a Morphable Model
    Amberg, Brian
    Knothe, Reinhard
    Vetter, Thomas
    [J]. 2008 8TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2008), VOLS 1 AND 2, 2008, : 667 - 672
  • [35] 3D Face Fitting using Multi-stage Parameter Updating in the 3D Morphable Face Model
    Choi, Inho
    Kim, Daijin
    [J]. ISM: 2008 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA, 2008, : 274 - 279
  • [36] HeadFusion: 360° Head Pose Tracking Combining 3D Morphable Model and 3D Reconstruction
    Yu, Yu
    Mora, Kenneth Alberto Funes
    Odobez, Jean-Marc
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) : 2653 - 2667
  • [37] Method of Creating the 3D Face Model of Character Based on Textures Maps Module
    Zolotukhin, Denys
    Sachenko, Anatoliy
    Hermanowich, Artur
    Komar, Myroslav
    Bykovyy, Pavlo
    [J]. PATTERN RECOGNITION AND INFORMATION PROCESSING, PRIP 2019, 2019, 1055 : 134 - 146
  • [38] A Lightweight Monocular 3D Face Reconstruction Method Based on Improved 3D Morphing Models
    You, Xingyi
    Wang, Yue
    Zhao, Xiaohu
    [J]. SENSORS, 2023, 23 (15)
  • [39] An ellipsoidal model for generating realistic 3D facial textures
    Park, YoungJae
    Jang, SeokWoo
    Lee, JoongJae
    Lee, YangWeon
    Kim, GyeYoung
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2013, 46 (01) : 36 - 44
  • [40] 3D Face Morphable Models "In-the-Wild"
    Booth, James
    Antonakos, Epameinondas
    Ploumpis, Stylianos
    Trigeorgis, George
    Panagakis, Yannis
    Zafeiriou, Stefanos
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5464 - 5473