Adverse conditions improve distinguishability of auditory, motor, and perceptuo-motor theories of speech perception: An exploratory Bayesian modelling study

被引:22
|
作者
Moulin-Frier, C. [1 ]
Laurent, R. [1 ,2 ]
Bessiere, P. [2 ,3 ]
Schwartz, J. L. [1 ]
Diard, J. [4 ]
机构
[1] Grenoble Univ, CNRS, GIPSA Lab, UMR 5216, F-38402 Grenoble, France
[2] Grenoble Univ, CNRS, LIG, UMR 5217, F-38402 Grenoble, France
[3] Coll France, CNRS, LPPA, UMR 7152, F-75231 Paris, France
[4] Grenoble Univ, CNRS, LPNC, UMR 5105, F-38402 Grenoble, France
来源
LANGUAGE AND COGNITIVE PROCESSES | 2012年 / 27卷 / 7-8期
关键词
Auditory; motor; and perceptuo-motor theories of speech communication; Bayesian modelling; Speech perception in adverse conditions; Model distinguishability; PREMOTOR CORTEX; OPINION;
D O I
10.1080/01690965.2011.645313
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
In this paper, we put forward a computational framework for the comparison between motor, auditory, and perceptuo-motor theories of speech communication. We first recall the basic arguments of these three sets of theories, either applied to speech perception or to speech production. Then we expose a unifying Bayesian model able to express each theory in a probabilistic way. Focusing on speech perception, we demonstrate that under two hypotheses, regarding communication noise and inter-speaker variability, providing perfect conditions for speech communication, motor, and auditory theories are indistinguishable. We then degrade successively each hypothesis to study the distinguishability of the different theories in "adverse" conditions. We first present simulations on a simplified implementation of the model with mono-dimensional sensory and motor variables, and secondly we consider a simulation of the human vocal tract providing more realistic auditory and articulatory variables. Simulation results allow us to emphasise the respective roles of motor and auditory knowledge in various conditions of speech perception in adverse conditions, and to suggest some guidelines for future studies aiming at assessing the role of motor knowledge in speech perception.
引用
收藏
页码:1240 / 1263
页数:24
相关论文
共 5 条
  • [1] The Complementary Roles of Auditory and Motor Information Evaluated in a Bayesian Perceptuo-Motor Model of Speech Perception
    Laurent, Raphael
    Barnaud, Marie-Lou
    Schwartz, Jean-Luc
    Bessiere, Pierre
    Diard, Julien
    PSYCHOLOGICAL REVIEW, 2017, 124 (05) : 572 - 602
  • [2] Reanalyzing neurocognitive data on the role of the motor system in speech perception within COSMO, a Bayesian perceptuo-motor model of speech communication
    Barnaud, Marie-Lou
    Bessiere, Pierre
    Diard, Julien
    Schwartz, Jean-Luc
    BRAIN AND LANGUAGE, 2018, 187 : 19 - 32
  • [3] The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception
    Schwartz, Jean-Luc
    Basirat, Anahita
    Menard, Lucie
    Sato, Marc
    JOURNAL OF NEUROLINGUISTICS, 2012, 25 (05) : 336 - 354
  • [4] Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication
    Barnaud, Marie-Lou
    Schwartz, Jean-Luc
    Bessiere, Pierre
    Diard, Julien
    PLOS ONE, 2019, 14 (01):
  • [5] A computational model of perceptuo-motor processing in speech perception: learning to imitate and categorize synthetic CV syllables
    Laurent, Raphael
    Schwartz, Jean-Luc
    Bessiere, Pierre
    Diard, Julien
    14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 2796 - 2800