A Real-time Speech Driven Talking Avatar based on Deep Neural Network

被引：0

作者：

Zhao, Kai ^{[1
]}

Wu, Zhiyong ^{[1
]}

Cai, Lianhong ^{[1
]}

机构：

[1] Tsinghua Univ, Grad Sch Shenzhen, Shenzhen Key Lab Informat Sci & Technol, Tsinghua CUHK Joint Res Ctr Media Sci Technol & S, Shenzhen 518057, Peoples R China

来源：

2013 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA) | 2013年

关键词：

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

This paper describes our initial work in developing a real-time speech driven talking avatar system with deep neural network. The input of the system is the acoustic speech and the output is the articulatory movements (that are synchronized with the input speech) on a 3-dimentional avatar. The mapping from the input acoustic features to the output articulatory features is achieved by virtue of deep neural network (DNN). Experiments on the well known acoustic-articulatory English speech corpus MNGU0 demonstrate that the proposed audio-visual mapping method based on DNN can achieve good performance.

引用

页数：4

共 50 条

[41] A Smart Deep Convolutional Neural Network for Real-Time Surface Inspection
Passos, Adriano G.
Cousseau, Tiago
Luersen, Marco A.
COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 41 (02): : 583 - 593
[42] Real-Time Detection for Wheat Head Applying Deep Neural Network
Gong, Bo
Ergu, Daji
Cai, Ying
Ma, Bo
SENSORS, 2021, 21 (01) : 1 - 13
[43] Deep convolutional neural network based real-time abnormal behavior detection in social networks
Mavaluru, Dinesh
Mubarakali, Azath
Narapureddy, Bayapa Reddy
Ramakrishnan, Jayabrabu
John, Rajan
Ravishankar, Nadana
Karthika, P.
COMPUTERS & ELECTRICAL ENGINEERING, 2023, 111
[44] Offline to online speaker adaptation for real-time deep neural network based LVCSR systems
Yanhua Long
Yijie Li
Bo Zhang
Multimedia Tools and Applications, 2018, 77 : 28101 - 28119
[45] Real-Time Modular Deep Neural Network-Based Adaptive Control of Nonlinear Systems
Le, Duc M.
Greene, Max L.
Makumi, Wanjiku A.
Dixon, Warren E.
IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 476 - 481
[46] Lightweight Deep Neural Network-based Real-Time Pose Estimation on Embedded Systems
Heo, Junho
Kim, Ginam
Park, Jaeseo
Kim, Yeonsu
Cho, Sung-Sik
Lee, Chang Won
Kang, Suk-Ju
2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1066 - 1071
[47] Simplification of Deep Neural Network-Based Object Detector for Real-Time Edge Computing
Choi, Kyoungtaek
Wi, Seong Min
Jung, Ho Gi
Suhr, Jae Kyu
SENSORS, 2023, 23 (07)
[48] Real-time Face Recognition based on Deep neural network methods to solve occlusion problems
Annagrebah, Salma
Maizate, Abderrahim
Hassouni, Larbi
2019 THIRD INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS 2019), 2019,
[49] MyoTac: Real-Time Recognition of Tactical Sign Language Based on Lightweight Deep Neural Network
Li, Huiyong
Zhang, Yifan
Cao, Qian
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
[50] Offline to online speaker adaptation for real-time deep neural network based LVCSR systems
Long, Yanhua
Li, Yijie
Zhang, Bo
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (21) : 28101 - 28119

← 1 2 3 4 5 →