Hair-GAN: Recovering 3D hair structure from a single image using generative adversarial networks

被引:25
|
作者
Zhang, Meng [1 ]
Zheng, Youyi [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310058, Peoples R China
来源
VISUAL INFORMATICS | 2019年 / 3卷 / 02期
关键词
Single-view hair modeling; 3D volumetric structure; Deep learning; Generative adversarial networks;
D O I
10.1016/j.visinf.2019.06.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We introduce Hair-GAN, an architecture of generative adversarial networks, to recover the 3D hair structure from a single image. The goal of our networks is to build a parametric transformation from 2D hair maps to 3D hair structure. The 3D hair structure is represented as a 3D volumetric field which encodes both the occupancy and the orientation information of the hair strands. Given a single hair image, we first align it with a bust model and extract a set of 2D maps encoding the hair orientation information in 2D, along with the bust depth map to feed into our Hair-GAN. With our generator network, we compute the 3D volumetric field as the structure guidance for the final hair synthesis. The modeling results not only resemble the hair in the input image but also possesses many vivid details in other views. The efficacy of our method is demonstrated by using a variety of hairstyles and comparing with the prior art. (C) 2019 Zhejiang University and Zhejiang University Press. Published by Elsevier B.V.
引用
收藏
页码:102 / 112
页数:11
相关论文
共 50 条
  • [1] Hair-GAN: Recovering 3D hair structure from a single image using generative adversarial networks (vol 3, pg 102, 2019)
    He, Xiangyang
    VISUAL INFORMATICS, 2020, 4 (04): : 40 - 40
  • [2] 3D face reconstruction from single image with generative adversarial networks
    Malah, Mehdi
    Hemam, Mounir
    Abbas, Faycal
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (01) : 250 - 256
  • [3] GAN-D: Generative Adversarial Networks for Image Deconvolution
    Lee, Ha Yeon
    Kwak, Jin Myung
    Ban, Byunghyun
    Na, Seon Jin
    Lee, Se Ra
    Lee, Heung-Kyu
    2017 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2017, : 132 - 137
  • [4] GENERATIVE ADVERSARIAL NETWORKS FOR SINGLE PHOTO 3D RECONSTRUCTION
    Kniaz, V. V.
    Remondino, F.
    Knyaz, V. A.
    8TH INTERNATIONAL WORKSHOP 3D-ARCH: 3D VIRTUAL RECONSTRUCTION AND VISUALIZATION OF COMPLEX ARCHITECTURES, 2019, 42-2 (W9): : 403 - 408
  • [5] 3D Geological Image Synthesis From 2D Examples Using Generative Adversarial Networks
    Coiffier, Guillaume
    Renard, Philippe
    Lefebvre, Sylvain
    FRONTIERS IN WATER, 2020, 2
  • [6] 3D image augmentation using Neural Style Transfer and Generative Adversarial Networks
    Cuong Do
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIII, 2020, 11510
  • [7] Automatic Generation of a 3D Braid Hair Model from a Single Image
    Omine, Taisei
    Morimoto, Yuki
    Tsuruno, Reiji
    PROCEEDINGS OF SIGGRAPH 2022 POSTERS, SIGGRAPH 2022, 2022,
  • [8] Generation of 3D hair model from 2D image using image processing
    Kong, WM
    Takahashi, H
    Nakajima, M
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XIX, 1996, 2847 : 303 - 311
  • [9] MM-GAN: 3D MRI Data Augmentation for Medical Image Segmentation via Generative Adversarial Networks
    Sun, Yi
    Yuan, Peisen
    Sun, Yuming
    11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 227 - 234
  • [10] Brain Tumor Segmentation Using 3D Generative Adversarial Networks
    Li, Yitong
    Chen, Yue
    Shi, Y.
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (04)