Modeling sensory-to-motor mappings using neural nets and a 3D articulatory speech synthesizer

被引:0
|
作者
Kroeger, Bernd J. [1 ]
Birkholz, Peter [2 ]
Kannampuzha, Jim [1 ]
Neuschaefer-Rube, Christiane [1 ]
机构
[1] Rhein Westfal TH Aachen, Univ Hosp Aachen, Dept Phoniatr Pedaudiol & Commun Disorders, Aachen, Germany
[2] Univ Rostock, Dept Comp Sci, D-18055 Rostock, Germany
关键词
speech production; neural model; articulatory model; articulatory speech synthesis; speech acquisition;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A comprehensive neural model of speech motor control including a three dimensional articulatory speech synthesizer as a front-end device is described in detail in this paper. The training of the sensory-to-motor mappings - which can be interpreted as the prelinguistic phase of speech acquisition - is described in detail for quasi-static as well as for dynamic articulation.
引用
收藏
页码:565 / +
页数:2
相关论文
共 50 条
  • [1] 3D Mesoscopic Imaging of Neural Connections in Sensory and Motor Cortices
    Tang, Qinggong
    Tsytsarev, Vassiliy
    Lin, Jonathan
    Liu, Yi
    Chen, Chao-wei
    Erzurumlu, Reha S.
    Chen, Yu
    [J]. 2016 IEEE PHOTONICS CONFERENCE (IPC), 2016, : 150 - 151
  • [2] Collision Handling in 3D Articulatory Animation for Chinese Speech Articulation
    Li, Rui
    Yu, Jun
    Wang, Zengfu
    [J]. IFAC PAPERSONLINE, 2015, 48 (28): : 1047 - 1052
  • [3] Sensory articulation speech system: SASSy - a 3D animation based therapeutic application for motor speech disorders
    Cornelius, Pip
    Higgett, Nick
    Kaleem, Rehan
    [J]. JOURNAL OF ASSISTIVE TECHNOLOGIES, 2011, 5 (03) : 123 - 130
  • [4] ANALYZING VISIBLE ARTICULATORY MOVEMENTS IN SPEECH PRODUCTION FOR SPEECH-DRIVEN 3D FACIAL ANIMATION
    Kim, Hyung Kyu
    Lee, Sangmin
    Kim, Hak Gu
    [J]. Proceedings - International Conference on Image Processing, ICIP, 2024, : 3575 - 3579
  • [5] 3D Modeling of Virtualized Reality Objects Using Neural Computing
    Serna-Morales, Andres F.
    Prieto, Flavio
    Bayro-Corrochano, Eduardo
    Sanchez, Edgar N.
    [J]. 2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 2191 - 2198
  • [6] VISUAL ATTENTION MODELING FOR 3D VIDEO USING NEURAL NETWORKS
    Iatsun, Iana
    Larabi, Mohamed-Chaker
    Fernandez-Maloigne, Christine
    [J]. 2014 INTERNATIONAL CONFERENCE ON 3D IMAGING (IC3D), 2014,
  • [7] 3D HUMAN MOVEMENT (WALKING) MODELING USING NEURAL NETWORK
    Awang, Suryanti
    Shamsuddin, Sin Marlyam
    [J]. 2006 INTERNATIONAL CONFERENCE ON COMPUTING & INFORMATICS (ICOCI 2006), 2006, : 247 - +
  • [8] Deep Neural Network Based 3D Articulatory Movement Prediction Using Both Text and Audio Inputs
    Yu, Lingyun
    Yu, Jun
    Ling, Qiang
    [J]. MULTIMEDIA MODELING (MMM 2019), PT I, 2019, 11295 : 68 - 79
  • [9] Synthesizing 3D Trump: Predicting and Visualizing the Relationship Between Text, Speech, and Articulatory Movements
    Yu, Jun
    Ling, Qiang
    Luo, Changwei
    Chen, Chang Wen
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (12) : 2223 - 2233
  • [10] DefGraspNets: Grasp Planning on 3D Fields with Graph Neural Nets
    Huang, Isabella
    Narang, Yashraj
    Bajcsy, Ruzena
    Ramos, Fabio
    Hermans, Tucker
    Fox, Dieter
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 5894 - 5901