Emotional representation and animation of 3D facial models: The interface approach

被引:0
|
作者
Lavagetto, F [1 ]
机构
[1] Univ Genoa, DIST, Genoa, Italy
关键词
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The activity of the IST European Research Project INTERFACE(1) is oriented to the development of advanced interfaces based on an interaction engine capable of interpreting natural voice or gestures and answering through artificial voice and animation feed-backs. Classic technologies of voice recognition and synthesis have been integrated with innovative algorithms for emotional speech modeling. Video analysis techniques have been developed for interpreting human gestures capable of being reproduced artificially through three-dimensional virtual animated faces and bodies. The INTERFACE objective is that of integrating all these analysis/synthesis techniques into a single piece of technology capable of accepting queries through talk and facial expressions, as we are used to do in everyday life with relatives, friends and colleagues, and of providing answers to the user through virtual actors capable of reproducing artificially human voice and gestures. The INTERFACE achievements have been recently demonstrated with live demos during international exhibitions and conferences.
引用
收藏
页码:594 / 597
页数:4
相关论文
共 50 条
  • [1] 3D facial modeling for animation: A nonlinear approach
    Wang, Yushun
    Zhuang, Yueting
    [J]. ADVANCES IN MULTIMEDIA MODELING, PT 1, 2007, 4351 : 64 - 73
  • [2] Speech-driven 3D Facial Animation with Implicit Emotional Awareness: A Deep Learning Approach
    Pham, Hai X.
    Cheung, Samuel
    Pavlovic, Vladimir
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 2328 - 2336
  • [3] Statistical models of facial expressions for realistic 3D avatar animation
    Zalewski, L
    Gong, S
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, : 217 - 222
  • [4] A piece-wise learning approach to 3D facial animation
    Wang, Yushun
    Zhuang, Yueting
    Xiao, Jun
    Wu, Fei
    [J]. ADVANCES IN WEB BASED LEARNING - ICWL 2007, 2008, 4823 : 416 - 427
  • [5] 3D Emotional Facial Animation Synthesis with Factored Conditional Restricted Boltzmann Machines
    Zhao, Yong
    Jiang, Dongmei
    Sahli, Hichem
    [J]. 2015 INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2015, : 797 - 803
  • [6] 3D performance capture for facial animation
    MacVicar, D
    Ford, S
    Borland, E
    Rixon, R
    Patterson, J
    Cockshott, P
    [J]. 2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 42 - 49
  • [7] 3D Facial Animation for Mobile Devices
    De Martino, Jose Mario
    Leite, Tatiane Silvia
    [J]. WSCG 2010: FULL PAPERS PROCEEDINGS, 2010, : 81 - 87
  • [8] Classification of 3D Models for the 3D Animation Environments
    He Yuesheng
    Tang, Yuan Yan
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 3786 - 3791
  • [9] CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation
    Liang, Xiangyu
    Zhuang, Wenlin
    Wang, Tianyong
    Geng, Guangxing
    Geng, Guangyue
    Xia, Haifeng
    Xia, Siyu
    [J]. 2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [10] A comprehensive system for facial animation of generic 3D head models driven by speech
    Terissi, Lucas D.
    Cerda, Mauricio
    Gomez, Juan C.
    Hitschfeld-Kahler, Nancy
    Girau, Bernard
    [J]. EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2013,