Animatomy: an Animator-centric, Anatomically Inspired System for 3D Facial Modeling, Animation and Transfer

被引:13
|
作者
Choi, Byungkuk [1 ]
Eom, Haekwang [1 ]
Mouscadet, Benjamin [1 ]
Cullingford, Stephen [2 ]
Ma, Kurt [1 ]
Gassel, Stefanie [1 ]
Kim, Suzi [1 ]
Moffat, Andrew [1 ]
机构
[1] Weta Digital, Wellington, New Zealand
[2] Weta FX, Wellington, New Zealand
关键词
Facial modeling; facial expression; facial animation; data-driven animation; animation system; deformation; motion capture;
D O I
10.1145/3550469.3555398
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present Animatomy, a novel anatomic+animator centric representation of the human face. Present FACS-based systems are plagued with problems of face muscle separation, coverage, opposition, and redundancy. We, therefore, propose a collection of muscle fiber curves as an anatomic basis, whose contraction and relaxation provide us with a fine-grained parameterization of human facial expression. We build an end-to-end modular deformation architecture using this representation that enables: automatic optimization of the parameters of a specific face from high-quality dynamic facial scans; face animation driven by performance capture, keyframes, or dynamic simulation; interactive and direct manipulation of facial expression; and animation transfer from an actor to a character. We validate our facial system by showing compelling animated results, applications, and a quantitative comparison of our facial reconstruction to ground truth performance capture. Our system is being intensively used by a large creative team on Avatar: The Way of Water. We report feedback from these users as qualitative evaluation of our system.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] 3D facial modeling for animation: A nonlinear approach
    Wang, Yushun
    Zhuang, Yueting
    [J]. ADVANCES IN MULTIMEDIA MODELING, PT 1, 2007, 4351 : 64 - 73
  • [2] Expression Transfer: A System to build 3D Blend Shapes for Facial Animation
    Pawaskar, Chandan
    Ma, Wan-Chun
    Carnegie, Kieran
    Lewis, J. P.
    Rhee, Taehyun
    [J]. PROCEEDINGS OF 2013 28TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ 2013), 2013, : 154 - 159
  • [3] Lightweight wrinkle synthesis for 3D facial modeling and animation
    Li, Jun
    Xu, Weiwei
    Cheng, Zhiquan
    Xu, Kai
    Klein, Reinhard
    [J]. COMPUTER-AIDED DESIGN, 2015, 58 : 117 - 122
  • [4] Modeling and animation of individualized faces for 3D facial expression synthesis
    Zhang, Y
    Prakash, EC
    Sung, E
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2003, 13 (01) : 42 - 64
  • [5] 3D facial modeling, animation, and rendering for digital humans: A survey
    Zhang, Yiwei
    Su, Renbin
    Yu, Jun
    Li, Rui
    [J]. NEUROCOMPUTING, 2024, 598
  • [6] 3D performance capture for facial animation
    MacVicar, D
    Ford, S
    Borland, E
    Rixon, R
    Patterson, J
    Cockshott, P
    [J]. 2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 42 - 49
  • [7] 3D Facial Animation for Mobile Devices
    De Martino, Jose Mario
    Leite, Tatiane Silvia
    [J]. WSCG 2010: FULL PAPERS PROCEEDINGS, 2010, : 81 - 87
  • [8] 3D HUMAN FACE MODELING FOR FACIAL ANIMATION USING REGIONAL ADAPTATION
    Huang, Yanhui
    Fan, Yangyu
    Liu, Weihua
    Wang, Liangliang
    [J]. 2014 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (CHINASIP), 2014, : 394 - 398
  • [9] The Animator's (Missing) Hand: How Practice Informs Seeing in 3D Animation
    Kennedy, Jason
    [J]. 5TH INTERNATIONAL CONFERENCE ON ILLUSTRATION AND ANIMATION (CONFIA 2017), 2017, : 298 - 309
  • [10] A review regarding the 3D facial animation pipeline
    de Carvalho Cruz, Artur Tavares
    Teixeira, Joao Marcelo
    [J]. PROCEEDINGS OF SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY, SVR 2021, 2021, : 192 - 196