Creating a 3D Mesh in A-pose from a Single Image for Character Rigging

被引:0
|
作者
Lee, Seunghwan [1 ]
Liu, C. Karen [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
<bold>CCS Concepts</bold>; center dot <bold>Computing methodologies</bold> -> <bold>Computer vision</bold>; <bold>Rendering</bold>; NEURAL RADIANCE FIELDS;
D O I
10.1111/cgf.15177
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Learning-based methods for 3D content generation have shown great potential to create 3D characters from text prompts, videos, and images. However, current methods primarily focus on generating static 3D meshes, overlooking the crucial aspect of creating an animatable 3D meshes. Directly using 3D meshes generated by existing methods to create underlying skeletons for animation presents many challenges because the generated mesh might exhibit geometry artifacts or assume arbitrary poses that complicate the subsequent rigging process. This work proposes a new framework for generating a 3D animatable mesh from a single 2D image depicting the character. We do so by enforcing the generated 3D mesh to assume an A-pose, which can mitigate the geometry artifacts and facilitate the use of existing automatic rigging methods. Our approach aims to leverage the generative power of existing models across modalities without the need for new data or large-scale training. We evaluate the effectiveness of our framework with qualitative results, as well as ablation studies and quantitative comparisons with existing 3D mesh generation models.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Image2Mesh: A Learning Framework for Single Image 3D Reconstruction
    Pontes, Jhony K.
    Kong, Chen
    Sridharan, Sridha
    Lucey, Simon
    Eriksson, Anders
    Fookes, Clinton
    COMPUTER VISION - ACCV 2018, PT I, 2019, 11361 : 365 - 381
  • [42] Mesh fitting based 3D character modeling
    Tong, Kai-Man
    Hui, Kin-Chuen
    Wang, Charlie C. L.
    TECHNOLOGIES FOR E-LEARNING AND DIGITAL ENTERTAINMENT, PROCEEDINGS, 2006, 3942 : 861 - 872
  • [43] Semi-Supervised 3D Holistic Human Mesh Reconstruction from A Single Image
    Santoso, Joshua
    Williem
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [44] Detailed 3D Human Body Reconstruction From a Single Image Based on Mesh Deformation
    Zhang, Sizhuo
    Xiao, Nanfeng
    IEEE ACCESS, 2021, 9 : 8595 - 8603
  • [45] SAR: Spatial-Aware Regression for 3D Hand Pose and Mesh Reconstruction from a Monocular RGB Image
    Zheng, Xiaozheng
    Ren, Pengfei
    Sun, Haifeng
    Wang, Jingyu
    Qi, Qi
    Liao, Jianxin
    2021 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2021), 2021, : 99 - 108
  • [46] 3D Cinemagraphy from a Single Image
    Li, Xingyi
    Cao, Zhiguo
    Sun, Huiqiang
    Zhang, Jianming
    Xian, Ke
    Ling, Guosheng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4595 - 4605
  • [47] Multi-person 3D pose estimation from a single image captured by a fisheye camera
    Zhang, Yahui
    You, Shaodi
    Karaoglu, Sezer
    Gevers, Theo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 222
  • [48] WPL-Based Constraint for 3D Human Pose Estimation from a Single Depth Image
    Xing, Huiqin
    Yang, Jianyu
    SENSORS, 2022, 22 (23)
  • [49] 3D HEAD POSE ESTIMATION BASED ON GRAPH CONVOLUTIONAL NETWORK FROM A SINGLE RGB IMAGE
    Lie, Wen-Nung
    Yim, Monyneath
    Aing, Lee
    Chiang, Jui-Chiu
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3963 - 3967
  • [50] Joint 3D Human Shape Recovery and Pose Estimation from a Single Image with Bilayer Graph
    Yu, Xin
    van Baar, Jeroen
    Chen, Siheng
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 505 - 514