A review of motion retargeting techniques for 3D character facial animation☆

被引:1
|
作者
Zhu, ChangAn [1 ]
Joslin, Chris [1 ]
机构
[1] Carleton Univ, 1125 Colonel By Dr, Ottawa, ON K1S 5B6, Canada
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 123卷
基金
加拿大自然科学与工程研究理事会;
关键词
3D facial animation; Facial motion retargeting; Face parameterization; Motion capture; Visual effects; ACTION CODING SYSTEM; EXPRESSIONS; MOVEMENT; MODELS; FACES;
D O I
10.1016/j.cag.2024.104037
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D face animation has been a critical component of character animation in a wide range of media since the early 90's. The conventional process for animating a 3D face is usually keyframe-based, which is laborintensive. Therefore, the film and game industries have started using live-action actors' performances to animate the faces of 3D characters, the process is also known as performance-driven facial animation. At the core of performance-driven facial animation is facial motion retargeting, which transfers the source facial motions to a target 3D face. However, facial motion retargeting still has many limitations that influence its capability to further assist the facial animation process. Existing motion retargeting frameworks cannot accurately transfer the source motion's semantic information (i.e., meaning and intensity of the motion), especially when applying the motion to non-human-like or stylized target characters. The retargeting quality relies on the parameterization of the target face, which is time-consuming to build and usually not generalizable across proportionally different faces. In this survey paper, we review the literature relating to 3D facial motion retargeting methods and the relevant topics within this area. We provide a systematic understanding of the essential modules of the retargeting pipeline, a taxonomy of the available approaches under these modules, and a thorough analysis of their advantages and limitations with research directions that could potentially contribute to this area. We also contributed a 3D character categorization matrix, which has been used in this survey and might be useful for future research to evaluate the character compatibility of their retargeting or face parameterization methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Review of constraints-based motion retargeting techniques in 3D animations
    Gu, Pingping
    Zheng, Yuhui
    Wang, Danli
    Wu, Qingfeng
    [J]. 2016 11TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE), 2016, : 708 - 711
  • [2] A review regarding the 3D facial animation pipeline
    de Carvalho Cruz, Artur Tavares
    Teixeira, Joao Marcelo
    [J]. PROCEEDINGS OF SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY, SVR 2021, 2021, : 192 - 196
  • [3] Applying AI techniques for transferring 3D facial animation
    Bui, The Duy
    [J]. ICTACS 2006: First International Conference on Theories and Applications of Computer Science 2006, 2007, : 135 - 149
  • [4] Redundancy Reduction in 3D Facial Motion Capture Data for Animation
    Wellein, Daniela I.
    Curio, Cristobal
    Buelthoff, Heinrich H.
    [J]. APGV 2007: SYMPOSIUM ON APPLIED PERCEPTION IN GRAPHICS AND VISUALIZATION, PROCEEDINGS, 2007, : 136 - 136
  • [5] Character animation from 2D pictures and 3D motion data
    Hornung, Alexander
    Dekkers, Ellen
    Kobbelt, Leif
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (01):
  • [6] Real-time Facial Animation for 3D Stylized Character with Emotion Dynamics
    Pan, Ye
    Zhang, Ruisi
    Wang, Jingying
    Ding, Yu
    Mitchell, Kenny
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6851 - 6859
  • [7] Editing and synthesis of 3D facial animation by motion propagation and isomap analysis
    Wang, Yushun
    Xiao, Jun
    Zhuang, Yueting
    Wang, Yujie
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2008, 20 (12): : 1590 - 1595
  • [8] Distributing 3D character animation on the internet
    Hash, M
    [J]. Proceedings of the Eighth IASTED International Conference on Internet and Multimedia Systems and Applications, 2004, : 48 - 52
  • [9] 3D performance capture for facial animation
    MacVicar, D
    Ford, S
    Borland, E
    Rixon, R
    Patterson, J
    Cockshott, P
    [J]. 2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 42 - 49
  • [10] 3D Facial Animation for Mobile Devices
    De Martino, Jose Mario
    Leite, Tatiane Silvia
    [J]. WSCG 2010: FULL PAPERS PROCEEDINGS, 2010, : 81 - 87