Creating a 3D Mesh in A-pose from a Single Image for Character Rigging

被引:0
|
作者
Lee, Seunghwan [1 ]
Liu, C. Karen [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
<bold>CCS Concepts</bold>; center dot <bold>Computing methodologies</bold> -> <bold>Computer vision</bold>; <bold>Rendering</bold>; NEURAL RADIANCE FIELDS;
D O I
10.1111/cgf.15177
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Learning-based methods for 3D content generation have shown great potential to create 3D characters from text prompts, videos, and images. However, current methods primarily focus on generating static 3D meshes, overlooking the crucial aspect of creating an animatable 3D meshes. Directly using 3D meshes generated by existing methods to create underlying skeletons for animation presents many challenges because the generated mesh might exhibit geometry artifacts or assume arbitrary poses that complicate the subsequent rigging process. This work proposes a new framework for generating a 3D animatable mesh from a single 2D image depicting the character. We do so by enforcing the generated 3D mesh to assume an A-pose, which can mitigate the geometry artifacts and facilitate the use of existing automatic rigging methods. Our approach aims to leverage the generative power of existing models across modalities without the need for new data or large-scale training. We evaluate the effectiveness of our framework with qualitative results, as well as ablation studies and quantitative comparisons with existing 3D mesh generation models.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Creating a 3D Mesh in A-pose from a Single Image for Character Rigging
    Lee, Seunghwan
    Liu, C. Karen
    ACM SIGGRAPH / EUROGRAPHICS SYMPOSIUM OF COMPUTER ANIMATION 2024, 2024,
  • [2] Creating 3D Human Character Mesh Prototypes from a Single Front-view Sketch
    Bakerman, Shaikah
    Ansara, Rufino R.
    Joslin, Chris
    PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 1: GRAPP, 2018, : 248 - 255
  • [3] Skeleton Transformer Networks: 3D Human Pose and Skinned Mesh from Single RGB Image
    Yoshiyasu, Yusuke
    Sagawa, Ryusuke
    Ayusawa, Ko
    Murai, Akihiko
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 485 - 500
  • [4] Object Wake-Up: 3D Object Rigging from a Single Image
    Yang, Ji
    Zuo, Xinxin
    Wang, Sen
    Yu, Zhenbo
    Li, Xingyu
    Ni, Bingbing
    Gong, Minglun
    Cheng, Li
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 311 - 327
  • [5] 3D Character Animation Generation from a Single Image
    Lin Z.
    Huang H.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (09): : 1341 - 1350
  • [6] Multimodal 3D Human Pose Estimation from a Single Image
    Spurlock, Scott
    Souvenir, Richard
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 663 - 670
  • [7] Accurate 3D Pose Estimation From a Single Depth Image
    Ye, Mao
    Wang, Xianwang
    Yang, Ruigang
    Ren, Liu
    Pollefeys, Marc
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 731 - 738
  • [8] 3D hand pose retrieval from a single 2D image
    Guan, HY
    Chua, CS
    Ho, YK
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2001, : 157 - 160
  • [9] Single Image 3D Human Pose Estimation from Noisy Observations
    Simo-Serra, E.
    Ramisa, A.
    Alenya, G.
    Torras, C.
    Moreno-Noguer, F.
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 2673 - 2680
  • [10] 3D Hand Shape and Pose Estimation from a Single RGB Image
    Ge, Liuhao
    Ren, Zhou
    Li, Yuncheng
    Xue, Zehao
    Wang, Yingying
    Cai, Jianfei
    Yuan, Junsong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10825 - 10834