Animatomy: an Animator-centric, Anatomically Inspired System for 3D Facial Modeling, Animation and Transfer

被引:13
|
作者
Choi, Byungkuk [1 ]
Eom, Haekwang [1 ]
Mouscadet, Benjamin [1 ]
Cullingford, Stephen [2 ]
Ma, Kurt [1 ]
Gassel, Stefanie [1 ]
Kim, Suzi [1 ]
Moffat, Andrew [1 ]
机构
[1] Weta Digital, Wellington, New Zealand
[2] Weta FX, Wellington, New Zealand
关键词
Facial modeling; facial expression; facial animation; data-driven animation; animation system; deformation; motion capture;
D O I
10.1145/3550469.3555398
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present Animatomy, a novel anatomic+animator centric representation of the human face. Present FACS-based systems are plagued with problems of face muscle separation, coverage, opposition, and redundancy. We, therefore, propose a collection of muscle fiber curves as an anatomic basis, whose contraction and relaxation provide us with a fine-grained parameterization of human facial expression. We build an end-to-end modular deformation architecture using this representation that enables: automatic optimization of the parameters of a specific face from high-quality dynamic facial scans; face animation driven by performance capture, keyframes, or dynamic simulation; interactive and direct manipulation of facial expression; and animation transfer from an actor to a character. We validate our facial system by showing compelling animated results, applications, and a quantitative comparison of our facial reconstruction to ground truth performance capture. Our system is being intensively used by a large creative team on Avatar: The Way of Water. We report feedback from these users as qualitative evaluation of our system.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Unity 3D animation modeling based on machine vision and embedded system
    Liu, Jin
    [J]. Microprocessors and Microsystems, 2021, 82
  • [32] Implementation of interactive 3D facial animation with Cult3D technology
    Pu, Qing
    XuYun, Qing
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2004, 16 (03): : 382 - 384
  • [33] 3D paper-cut modeling and animation
    Li, Yan
    Yu, Jinhui
    Ma, Kwan-Hu
    Shi, Jiaoying
    [J]. COMPUTER ANIMATION AND VIRTUAL WORLDS, 2007, 18 (4-5) : 395 - 403
  • [34] Teaching 3D modeling and animation in the high schools
    Coin, R
    [J]. COMPUTER GRAPHICS-US, 2005, 39 (02): : 24 - 25
  • [35] Special issue: 3D modeling and animation of clothes
    Magnenat-Thalmann, N
    Eberhardt, B
    [J]. JOURNAL OF VISUALIZATION AND COMPUTER ANIMATION, 2001, 12 (01): : I - I
  • [36] Fast Parameterized Modeling for 3D Animation Role
    Liu, Yang
    [J]. PROGRESS IN MEASUREMENT AND TESTING, PTS 1 AND 2, 2010, 108-111 : 747 - 752
  • [37] A Study on 3D Face Modeling for Animation Matching
    Weon, Sunhee
    Choi, Hyungil
    Kim, Gyeyoung
    [J]. NCM 2008: 4TH INTERNATIONAL CONFERENCE ON NETWORKED COMPUTING AND ADVANCED INFORMATION MANAGEMENT, VOL 2, PROCEEDINGS, 2008, : 153 - +
  • [38] 3D Semantic Parameterization for Human Shape Modeling: Application to 3D Animation
    Rupprecht, Christian
    Pauly, Olivier
    Theobalt, Christian
    Ilic, Slobodan
    [J]. 2013 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2013), 2013, : 255 - 262
  • [39] Study on Unity 3d Character Animation in Mecanim Animation System
    Kuang, Yang
    Wang, Xin
    [J]. 2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL MODELING, SIMULATION AND APPLIED MATHEMATICS (CMSAM 2016), 2016, : 263 - 266
  • [40] Emotional representation and animation of 3D facial models: The interface approach
    Lavagetto, F
    [J]. 2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2001, : 594 - 597