Creating a 3D Mesh in A-pose from a Single Image for Character Rigging

被引:0
|
作者
Lee, Seunghwan [1 ]
Liu, C. Karen [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
关键词
<bold>CCS Concepts</bold>; center dot <bold>Computing methodologies</bold> -> <bold>Computer vision</bold>; <bold>Rendering</bold>; NEURAL RADIANCE FIELDS;
D O I
10.1111/cgf.15177
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Learning-based methods for 3D content generation have shown great potential to create 3D characters from text prompts, videos, and images. However, current methods primarily focus on generating static 3D meshes, overlooking the crucial aspect of creating an animatable 3D meshes. Directly using 3D meshes generated by existing methods to create underlying skeletons for animation presents many challenges because the generated mesh might exhibit geometry artifacts or assume arbitrary poses that complicate the subsequent rigging process. This work proposes a new framework for generating a 3D animatable mesh from a single 2D image depicting the character. We do so by enforcing the generated 3D mesh to assume an A-pose, which can mitigate the geometry artifacts and facilitate the use of existing automatic rigging methods. Our approach aims to leverage the generative power of existing models across modalities without the need for new data or large-scale training. We evaluate the effectiveness of our framework with qualitative results, as well as ablation studies and quantitative comparisons with existing 3D mesh generation models.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Uncertainty-Aware Semi-Supervised Learning of 3D Face Rigging from Single Image
    Zhao, Yong
    Chen, Haifeng
    Sahli, Hichem
    Lu, Ke
    Jiang, Dongmei
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,
  • [22] Deep 3D Pose Dictionary: 3D Human Pose Estimation from Single RGB Image Using Deep Convolutional Neural Network
    Elbasiony, Reda
    Gomaa, Walid
    Ogata, Tetsuya
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT III, 2018, 11141 : 310 - 320
  • [23] SINGLE IMAGE 3D VEHICLE POSE ESTIMATION FOR AUGMENTED REALITY
    Lu, Yawen
    Kourian, Sophia
    Salvaggio, Carl
    Xu, Chenliang
    Lu, Guoyu
    2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [24] Single Image 3D Object Detection and Pose Estimation for Grasping
    Zhu, Menglong
    Derpanis, Konstantinos G.
    Yang, Yinfei
    Brahmbhatt, Samarth
    Zhang, Mabel
    Phillips, Cody
    Lecce, Matthieu
    Daniilidis, Kostas
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 3936 - 3943
  • [25] Sketch2Pose: Estimating a 3D Character Pose from a Bitmap Sketch
    Brodt, Kirill
    Bessmeltsev, Mikhail
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (04):
  • [26] 3D Mesh Reconstruction of Indoor Scenes from a Single Image In-the-Wild
    Lin, Peizhen
    Zhong, Hongliang
    Wang, Lei
    Cheng, Jun
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [27] Estimating 3D hand pose from a cluttered image
    Athitsos, V
    Sclaroff, S
    2003 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2003, : 432 - 439
  • [28] Single Image 3D Without a Single 3D Image
    Fouhey, David F.
    Hussain, Wajahat
    Gupta, Abhinav
    Hebert, Martial
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1053 - 1061
  • [29] A hybrid network for estimating 3D interacting hand pose from a single RGB image
    Bao, Wenxia
    Gao, Qiuyue
    Yang, Xianjun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (04) : 3801 - 3814
  • [30] Learning Joint Twist Rotation for 3D Human Pose Estimation from a Single Image
    Nakatsuka, Chihiro
    Xu, Jianfeng
    Tasaka, Kazuyuki
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 379 - 386