Method for Generating Panoramic Textures for 3D Face Reconstruction Based on the 3D Morphable Model

被引:0
|
作者
Hao, Shujia [1 ]
Wen, Mingyun [1 ]
Cho, Kyungeun [1 ]
机构
[1] Dongguk Univ Seoul, Dept Multimedia Engn, 30,Pildong Ro 1 Gil, Seoul 04620, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 19期
基金
新加坡国家研究基金会;
关键词
panoramic texture generation; deep learning; adversarial learning; image translation;
D O I
10.3390/app121910020
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Three-dimensional (3D) reconstruction techniques are playing an increasingly important role in education and entertainment. Real and recognizable avatars can enhance the immersion and interactivity of virtual systems. In 3D face modeling technology, face texture carries vital face recognition information. Therefore, this study proposes a panoramic 3D face texture generation method for 3D face reconstruction from a single 2D face image based on a 3D Morphable model (3DMM). Realistic and comprehensive panoramic facial textures can be obtained using generative networks as texture converters. Furthermore, we propose a low-cost method for generating face texture datasets for data collection. Experimental results show that the proposed method can generate panoramic face textures for 3D face meshes from a single image input, resulting in the final generation of textured 3D models that look realistic from different viewpoints.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Generating Face Images Based on 3D Morphable Model
    Sopiak, Dominik
    Oravec, Milos
    Pavlovicova, Jarmila
    Bukovcikova, Zuzana
    Dittingerova, Monika
    Bil'anska, Alexandra
    Novotna, Maria
    Gontkovic, Jozef
    [J]. 2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 58 - 62
  • [2] 3D Face Modeling based on 3D Dense Morphable Face Shape Model
    Kim, Yongsuk Jang
    Chung, Sun-Tae
    Kim, Boogyun
    Cho, Seongwon
    [J]. PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 27, 2008, 27 : 103 - +
  • [3] 3D Face Reconstruction from Video Using 3D Morphable Model and Silhouette
    Baumberger, Christian
    Reyes, Mauricio
    Constantinescu, Mihai
    Olariu, Radu
    de Aguiar, Edilson
    Oliveira-Santos, Thiago
    [J]. 2014 27TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2014, : 1 - 8
  • [4] Face recognition based on a 3D Morphable Model
    Blanz, Volker
    [J]. PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION - PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE, 2006, : 617 - 622
  • [5] 3D Morphable Face Model for Face Animation
    Ye, Dan
    Fuh, Chiou-Shann
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2020, 20 (01)
  • [6] Nonlinear 3D Face Morphable Model
    Luan Tran
    Liu, Xiaoming
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7346 - 7355
  • [7] 3D3M: 3D Modulated Morphable Model for Monocular Face Reconstruction
    Li, Yong
    Hao, Qiang
    Hu, Jianguo
    Pan, Xinmiao
    Li, Zechao
    Cui, Zhen
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6642 - 6652
  • [8] 3D FACE RECONSTRUCTION BASED ON WEAKLY-SUPERVISED LEARNING MORPHABLE FACE MODEL
    Liang, Kai-Wen
    Li, Pin-Hsuan
    Lo, Chung-Hsun
    Wang, Chien-Yao
    Chen, Yung-Fang
    Wang, Jia-Ching
    Chang, Pao-Chi
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3523 - 3527
  • [9] Face recognition based on fitting a 3D morphable model
    Blanz, V
    Vetter, T
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (09) : 1063 - 1074
  • [10] An improved 3D face synthesis based on morphable model
    Wang, CZ
    Yin, BC
    Shi, Q
    Sun, YF
    [J]. ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS II, 2005, 187 : 183 - 187