Animatomy: an Animator-centric, Anatomically Inspired System for 3D Facial Modeling, Animation and Transfer

被引:13
|
作者
Choi, Byungkuk [1 ]
Eom, Haekwang [1 ]
Mouscadet, Benjamin [1 ]
Cullingford, Stephen [2 ]
Ma, Kurt [1 ]
Gassel, Stefanie [1 ]
Kim, Suzi [1 ]
Moffat, Andrew [1 ]
机构
[1] Weta Digital, Wellington, New Zealand
[2] Weta FX, Wellington, New Zealand
关键词
Facial modeling; facial expression; facial animation; data-driven animation; animation system; deformation; motion capture;
D O I
10.1145/3550469.3555398
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present Animatomy, a novel anatomic+animator centric representation of the human face. Present FACS-based systems are plagued with problems of face muscle separation, coverage, opposition, and redundancy. We, therefore, propose a collection of muscle fiber curves as an anatomic basis, whose contraction and relaxation provide us with a fine-grained parameterization of human facial expression. We build an end-to-end modular deformation architecture using this representation that enables: automatic optimization of the parameters of a specific face from high-quality dynamic facial scans; face animation driven by performance capture, keyframes, or dynamic simulation; interactive and direct manipulation of facial expression; and animation transfer from an actor to a character. We validate our facial system by showing compelling animated results, applications, and a quantitative comparison of our facial reconstruction to ground truth performance capture. Our system is being intensively used by a large creative team on Avatar: The Way of Water. We report feedback from these users as qualitative evaluation of our system.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] A comprehensive system for facial animation of generic 3D head models driven by speech
    Lucas D Terissi
    Mauricio Cerda
    Juan C Gómez
    Nancy Hitschfeld-Kahler
    Bernard Girau
    [J]. EURASIP Journal on Audio, Speech, and Music Processing, 2013
  • [22] Linear Deformation on 3D Face Model for Facial Animation
    Pamungkas, Joannes Agung Satriyo
    Suyoto
    Gunanto, Samuel Gandang
    [J]. 2016 1ST INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, INFORMATION SYSTEMS AND ELECTRICAL ENGINEERING (ICITISEE), 2016, : 87 - 92
  • [23] REAL-TIME CONTROL OF 3D FACIAL ANIMATION
    Luo, Changwei
    Yu, Jun
    Jiang, Chen
    Li, Rui
    Wang, Zengfu
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2014,
  • [24] Applying AI techniques for transferring 3D facial animation
    Bui, The Duy
    [J]. ICTACS 2006: First International Conference on Theories and Applications of Computer Science 2006, 2007, : 135 - 149
  • [25] Vision-based Animation of 3D Facial Avatars
    Cho, Taehoon
    Choi, Jin-Ho
    Kim, Hyeon-Joong
    Choi, Soo-Mi
    [J]. 2014 INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2014, : 128 - 132
  • [26] Analysis of Facial Feature Design for 3D Animation Characters
    Chen, Kuan-Lin
    Chen, I-Ping
    Hsieh, Chi-Min
    [J]. VISUAL COMMUNICATION QUARTERLY, 2020, 27 (02) : 70 - 83
  • [27] 3D facial animation from Chinese text.
    Li, N
    Bu, JJ
    Chen, C
    Liang, RH
    [J]. 2003 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-5, CONFERENCE PROCEEDINGS, 2003, : 3738 - 3743
  • [28] Versatile Face Animator: Driving Arbitrary 3D Facial Avatar in RGBD Space
    Wang, Haoyu
    Wu, Haozhe
    Xing, Junliang
    Jia, Jia
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7776 - 7784
  • [29] Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis
    Huang, Yanhui
    Zhang, Xing
    Fan, Yangyu
    Yin, Lijun
    Seversky, Lee
    Allen, James
    Lei, Tao
    Dong, Weijun
    [J]. IMAGE AND VISION COMPUTING, 2012, 30 (10) : 750 - 761
  • [30] Unity 3D animation modeling based on machine vision and embedded system
    Liu, Jin
    [J]. MICROPROCESSORS AND MICROSYSTEMS, 2021, 82