Speech-driven 3D Facial Animation for Mobile Entertainment

被引:0
|
作者
Yan, Juan [1 ]
Xie, Xiang [1 ]
Hu, Hao [1 ]
机构
[1] Beijing Inst Technol, Dept Elect Engn, Beijing 100081, Peoples R China
关键词
Smart phone application; MMS; 3D facial animation;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an entertainment-oriented application for mobile service, which generates customized speech-driven 3D facial animation and delivers to end-user by MMS (Multimedia Messaging Service). Some important methods of this application are discussed, including the 3D facial model based on 3 photos, the 3D facial animation driven by speech or text on-line and the video format transformer for most smart phones. The implementation shows the facial animation runs vividly and the system gets a positive feedback by subjects' evaluation.
引用
收藏
页码:2334 / 2337
页数:4
相关论文
共 50 条
  • [31] Speech-driven facial animation with spectral gathering and temporal attention
    Chai, Yujin
    Weng, Yanlin
    Wang, Lvdi
    Zhou, Kun
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2022, 16 (03)
  • [32] Speech-driven facial animation with spectral gathering and temporal attention
    Yujin Chai
    Yanlin Weng
    Lvdi Wang
    Kun Zhou
    [J]. Frontiers of Computer Science, 2022, 16
  • [33] SYNTHESIZING REAL-TIME SPEECH-DRIVEN FACIAL ANIMATION
    Luo, Changwei
    Yu, Jun
    Wang, Zengfu
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [34] SynFace—Speech-Driven Facial Animation for Virtual Speech-Reading Support
    Giampiero Salvi
    Jonas Beskow
    Samer Al Moubayed
    Björn Granström
    [J]. EURASIP Journal on Audio, Speech, and Music Processing, 2009
  • [35] Speech-Driven Facial Animation by LSTM-RNN for Communication Use
    Nishimura, Ryosuke
    Sakata, Nobuchika
    Tominaga, Tomu
    Hijikata, Yoshinori
    Harada, Kensuke
    Kiyokawa, Kiyoshi
    [J]. 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 1102 - 1103
  • [36] REALTIME SPEECH-DRIVEN FACIAL ANIMATION USING GAUSSIAN MIXTURE MODELS
    Luo, Changwei
    Yu, Jun
    Li, Xian
    Wang, Zengfu
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2014,
  • [37] Speech-Driven Facial Animation by LSTM-RNN for Communication Use
    Nishimura, Ryosuke
    Sakata, Nobuchika
    Tominaga, Tomu
    Hijikata, Yoshinori
    Harada, Kensuke
    Kiyokawa, Kiyoshi
    [J]. 2019 12TH ASIA PACIFIC WORKSHOP ON MIXED AND AUGMENTED REALITY (APMAR), 2019, : 22 - 29
  • [38] 3D Facial Animation for Mobile Devices
    De Martino, Jose Mario
    Leite, Tatiane Silvia
    [J]. WSCG 2010: FULL PAPERS PROCEEDINGS, 2010, : 81 - 87
  • [39] Speech-driven animation with meaningful behaviors
    Sadoughi, Najmeh
    Busso, Carlos
    [J]. SPEECH COMMUNICATION, 2019, 110 : 90 - 100
  • [40] Geometry-Guided Dense Perspective Network for Speech-Driven Facial Animation
    Liu, Jingying
    Hui, Binyuan
    Li, Kun
    Liu, Yunke
    Lai, Yu-Kun
    Zhang, Yuxiang
    Liu, Yebin
    Yang, Jingyu
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (12) : 4873 - 4886