A review on data-driven learning of a talking head model

被引:0
|
作者
Htike K.K. [1 ]
机构
[1] School of Information Technology, UCSI University, Kuala Lumpur
关键词
Animated speech; Audio-driven facial motion synthesis; Audio-visual correlation; Facial animation; Talking face; Virtual avatar;
D O I
10.1504/IJISTA.2017.084239
中图分类号
学科分类号
摘要
Constructing a talking head model of a person allows generation of a novel talking face animation from an unseen audio sequence of the person. This has important applications such as building virtual avatars of people that can interact with real people in novel situations, model-based video compression, teleconferencing, human-computer interaction, computer graphics and video games. Traditionally, talking head models have been built by manual painstaking work. The advancement of computer vision and machine learning techniques, especially in the past decade, has made possible the automatic learning of a talking head model of a person from data. In this paper, we focus on this area of machine learning based data-driven facial animation and critically review the most common approaches, compare and contrast among them and identify promising research directions and prospects. © Copyright 2017 Inderscience Enterprises Ltd.
引用
收藏
页码:169 / 190
页数:21
相关论文
共 50 条
  • [1] Data-Driven vs Model-Driven Imitative Learning
    Tembine, Hamidou
    [J]. 2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 22 - 29
  • [2] Data-driven graph construction and graph learning: A review
    Qiao, Lishan
    Zhang, Limei
    Chen, Songcan
    Shen, Dinggang
    [J]. NEUROCOMPUTING, 2018, 312 : 336 - 351
  • [3] Data-driven learning of differential equations: combining data and model uncertainty
    Glasner, Karl
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2023, 42 (01):
  • [4] Data-driven learning of differential equations: combining data and model uncertainty
    Karl Glasner
    [J]. Computational and Applied Mathematics, 2023, 42
  • [5] AN APPROACH TO DATA-DRIVEN LEARNING
    MARKOV, Z
    [J]. LECTURE NOTES IN ARTIFICIAL INTELLIGENCE, 1991, 535 : 127 - 140
  • [6] Approach to data-driven learning
    Markov, Z.
    [J]. International Workshop on Fundamentals of Artificial Intelligence Research, 1991,
  • [7] Data-Driven Personalized Learning
    Guo, Xue
    He, Xiangchun
    Pei, Zhuoyun
    [J]. PROCEEDINGS OF 2023 6TH INTERNATIONAL CONFERENCE ON EDUCATIONAL TECHNOLOGY MANAGEMENT, ICETM 2023, 2023, : 49 - 54
  • [8] Metacognition and Data-Driven Learning
    Sato, Masatoshi
    [J]. TESOL QUARTERLY, 2024, 58 (03) : 1246 - 1255
  • [9] Complex Algorithms for Data-Driven Model Learning in Science and Engineering
    Montans, Francisco J.
    Chinesta, Francisco
    Gomez-Bombarelli, Rafael
    Kutz, J. Nathan
    [J]. COMPLEXITY, 2019, 2019
  • [10] Synthesis of model predictive control based on data-driven learning
    Zhou, Yuanqiang
    Li, Dewei
    Xi, Yugeng
    Gan, Zhongxue
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (08)