Creating a 3D Mesh in A-pose from a Single Image for Character Rigging

被引:0
|
作者
Lee, Seunghwan [1 ]
Liu, C. Karen [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
<bold>CCS Concepts</bold>; center dot <bold>Computing methodologies</bold> -> <bold>Computer vision</bold>; <bold>Rendering</bold>; NEURAL RADIANCE FIELDS;
D O I
10.1111/cgf.15177
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Learning-based methods for 3D content generation have shown great potential to create 3D characters from text prompts, videos, and images. However, current methods primarily focus on generating static 3D meshes, overlooking the crucial aspect of creating an animatable 3D meshes. Directly using 3D meshes generated by existing methods to create underlying skeletons for animation presents many challenges because the generated mesh might exhibit geometry artifacts or assume arbitrary poses that complicate the subsequent rigging process. This work proposes a new framework for generating a 3D animatable mesh from a single 2D image depicting the character. We do so by enforcing the generated 3D mesh to assume an A-pose, which can mitigate the geometry artifacts and facilitate the use of existing automatic rigging methods. Our approach aims to leverage the generative power of existing models across modalities without the need for new data or large-scale training. We evaluate the effectiveness of our framework with qualitative results, as well as ablation studies and quantitative comparisons with existing 3D mesh generation models.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] A hybrid network for estimating 3D interacting hand pose from a single RGB image
    Wenxia Bao
    Qiuyue Gao
    Xianjun Yang
    Signal, Image and Video Processing, 2024, 18 : 3801 - 3814
  • [32] Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
    Bogo, Federica
    Kanazawa, Angjoo
    Lassner, Christoph
    Gehler, Peter
    Romero, Javier
    Black, Michael J.
    COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 561 - 578
  • [33] 3D hand pose estimation from a single RGB image by weighting the occlusion and classification
    Mahdikhanlou, Khadijeh
    Ebrahimnezhad, Hossein
    PATTERN RECOGNITION, 2023, 136
  • [34] Camera distance helps 3D hand pose estimated from a single RGB image
    Cui, Yuan
    Li, Moran
    Gao, Yuan
    Gao, Changxin
    Wu, Fan
    Wen, Hao
    Li, Jiwei
    Sang, Nong
    GRAPHICAL MODELS, 2023, 127
  • [35] 3D human pose and shape estimation with dense correspondence from a single depth image
    Wang, Kangkan
    Zhang, Guofeng
    Yang, Jian
    VISUAL COMPUTER, 2023, 39 (01): : 429 - 441
  • [36] Occlusion-Robust 3D Hand Pose Estimation from a Single RGB Image
    Ishii, Asuka
    Nakano, Gaku
    Inoshita, Tetsuo
    PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [37] Structure-Aware 3D Hand Pose Regression from a Single Depth Image
    Malik, Jameel
    Elhayek, Ahmed
    Stricker, Didier
    VIRTUAL REALITY AND AUGMENTED REALITY, EUROVR 2018, 2018, 11162 : 3 - 17
  • [38] 3D Human Pose Estimation from a Single Image via Distance Matrix Regression
    Moreno-Noguer, Francesc
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1561 - 1570
  • [39] 3D human pose and shape estimation with dense correspondence from a single depth image
    Kangkan Wang
    Guofeng Zhang
    Jian Yang
    The Visual Computer, 2023, 39 : 429 - 441
  • [40] CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalization
    Peng, Hao-Yang
    Zhang, Jia-Peng
    Guo, Meng-Hao
    Cao, Yan-Pei
    Hu, Shi-Min
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (04):