Speech-driven 3D Facial Animation for Mobile Entertainment

被引：0
|
作者：
Yan, Juan [1 ]
Xie, Xiang [1 ]
Hu, Hao [1 ]
机构：
[1] Beijing Inst Technol, Dept Elect Engn, Beijing 100081, Peoples R China
来源：
INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5 | 2008年
关键词：
Smart phone application; MMS; 3D facial animation;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents an entertainment-oriented application for mobile service, which generates customized speech-driven 3D facial animation and delivers to end-user by MMS (Multimedia Messaging Service). Some important methods of this application are discussed, including the 3D facial model based on 3 photos, the 3D facial animation driven by speech or text on-line and the video format transformer for most smart phones. The implementation shows the facial animation runs vividly and the system gets a positive feedback by subjects' evaluation.
引用
收藏
页码：2334 / 2337
页数：4
相关论文
共 50 条
  • [41] A comprehensive system for facial animation of generic 3D head models driven by speech
    Terissi, Lucas D.
    Cerda, Mauricio
    Gomez, Juan C.
    Hitschfeld-Kahler, Nancy
    Girau, Bernard
    [J]. EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2013,
  • [42] A comprehensive system for facial animation of generic 3D head models driven by speech
    Lucas D Terissi
    Mauricio Cerda
    Juan C Gómez
    Nancy Hitschfeld-Kahler
    Bernard Girau
    [J]. EURASIP Journal on Audio, Speech, and Music Processing, 2013
  • [43] Speech-driven face synthesis from 3D video
    Ypsilos, LA
    Hilton, A
    Turkmani, A
    Jackson, PJB
    [J]. 2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 58 - 65
  • [44] FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation Learning
    Haque, Kazi Injamamul
    Yumak, Zerrin
    [J]. PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ICMI 2023, 2023, : 282 - 291
  • [45] Audio-to-Visual Conversion Via HMM Inversion for Speech-Driven Facial Animation
    Terissi, Lucas D.
    Gomez, Juan Carlos
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE - SBIA 2008, PROCEEDINGS, 2008, 5249 : 33 - 42
  • [46] Speech-Driven Facial Animation Using a Shared Gaussian Process Latent Variable Model
    Deena, Salil
    Galata, Aphrodite
    [J]. ADVANCES IN VISUAL COMPUTING, PT 1, PROCEEDINGS, 2009, 5875 : 89 - 100
  • [47] 3D facial animation driven by speech-video dual-modal signals
    Ji, Xuejie
    Liao, Zhouzhou
    Dong, Lanfang
    Tang, Yingchao
    Li, Guoming
    Mao, Meng
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (05) : 5951 - 5964
  • [48] Speech driven facial animation
    Yang, TJ
    Lin, IC
    Hung, CS
    Huang, CF
    Ming, OY
    [J]. COMPUTER ANIMATION AND SIMULATION'99, 1999, : 99 - 108
  • [49] Learning Speech-driven 3D Conversational Gestures from Video
    Habibie, Ikhsanul
    Xu, Weipeng
    Mehta, Dushyant
    Liu, Lingjie
    Seidel, Hans-Peter
    Pons-Moll, Gerard
    Elgharib, Mohamed
    Theobalt, Christian
    [J]. PROCEEDINGS OF THE 21ST ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA), 2021, : 101 - 108
  • [50] SPACE : Speech-driven Portrait Animation with Controllable Expression
    Gururani, Siddharth
    Mallya, Arun
    Wang, Ting-Chun
    Valle, Rafael
    Liu, Ming-Yu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20857 - 20866
12345