Neural tracking of speech envelope does not unequivocally reflect intelligibility

被引:8
|
作者
Koesem, Anne [1 ,2 ,3 ]
Dai, Bohan [1 ,2 ]
McQueen, James M. [1 ,2 ]
Hagoort, Peter [1 ,2 ]
机构
[1] Max Planck Inst Psycholinguist, NL-6500 AH Nijmegen, Netherlands
[2] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, NL-6500 HB Nijmegen, Netherlands
[3] INSERM, Lyon Neurosci Res Ctr CRNL, CoPhy Team, U1028, F-69500 Bron, France
关键词
Speech; Language; Entrainment; Neural oscillations; MEG; CORTICAL ENTRAINMENT; PHASE PATTERNS; OSCILLATIONS; COMPREHENSION; RESPONSES; ACOUSTICS;
D O I
10.1016/j.neuroimage.2023.120040
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
During listening, brain activity tracks the rhythmic structures of speech signals. Here, we directly dissociated the contribution of neural envelope tracking in the processing of speech acoustic cues from that related to linguistic processing. We examined the neural changes associated with the comprehension of Noise-Vocoded (NV) speech using magnetoencephalography (MEG). Participants listened to NV sentences in a 3-phase training paradigm: (1) pre-training, where NV stimuli were barely comprehended, (2) training with exposure of the original clear version of speech stimulus, and (3) post-training, where the same stimuli gained intelligibility from the training phase. Using this paradigm, we tested if the neural responses of a speech signal was modulated by its intelligibility without any change in its acoustic structure. To test the influence of spectral degradation on neural envelope tracking independently of training, participants listened to two types of NV sentences (4-band and 2-band NV speech), but were only trained to understand 4-band NV speech. Significant changes in neural tracking were observed in the delta range in relation to the acoustic degradation of speech. However, we failed to find a direct effect of intelligibility on the neural tracking of speech envelope in both theta and delta ranges, in both auditory regions-of-interest and whole-brain sensor-space analyses. This suggests that acoustics greatly influence the neural tracking response to speech envelope, and that caution needs to be taken when choosing the control signals for speech-brain tracking analyses, considering that a slight change in acoustic parameters can have strong effects on the neural tracking response.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] A multi-resolution envelope-power based model for speech intelligibility
    Jorgensen, Soren
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2013, 134 (01): : 436 - 446
  • [42] Effects of envelope bandwidth on the intelligibility of sine- and noise-vocoded speech
    Souza, Pamela
    Rosen, Stuart
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2009, 126 (02): : 792 - 805
  • [43] Effects of manipulating the signal-to-noise envelope power ratio on speech intelligibility
    Jorgensen, Soren
    Decorsiere, Remi
    Dau, Torsten
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 137 (03): : 1401 - 1410
  • [44] Modeling speech intelligibility with recovered envelope from temporal fine structure stimulus
    Chen, Fei
    Tsao, Yu
    Lai, Ying-Hui
    SPEECH COMMUNICATION, 2016, 81 : 120 - 128
  • [45] Predicting speech intelligibility based on a correlation metric in the envelope power spectrum domain
    Relano-Iborra, Helia
    May, Tobias
    Zaar, Johannes
    Scheidiger, Christoph
    Dau, Torsten
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2016, 140 (04): : 2670 - 2679
  • [46] Effect of Speech Rate on Neural Tracking of Speech
    Mueller, Jana Annina
    Wendt, Dorothea
    Kollmeier, Birger
    Debener, Stefan
    Brand, Thomas
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [47] Effects of acoustic periodicity and intelligibility on the neural oscillations in response to speech
    Steinmetzger, Kurt
    Rosen, Stuart
    NEUROPSYCHOLOGIA, 2017, 95 : 173 - 181
  • [48] Binaural Speech Intelligibility Estimation Using Deep Neural Networks
    Kondo, Kazuhiro
    Taira, Kazuya
    Kobayashi, Yosuke
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 1858 - 1862
  • [49] TEXTBOOK GRAMMAR - DOES IT REFLECT NATIVE SPEAKER SPEECH
    GLISAN, EW
    DRESCHER, V
    MODERN LANGUAGE JOURNAL, 1993, 77 (01): : 23 - 33
  • [50] Nonintrusive Speech Intelligibility Prediction Using Convolutional Neural Networks
    Andersen, Asger Heidemann
    de Haan, Jan Mark
    Tan, Zheng-Hua
    Jensen, Jesper
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (10) : 1925 - 1939