Perceptual restoration of masked speech in human cortex

被引:90
|
作者
Leonard, Matthew K. [1 ,2 ]
Baud, Maxime O. [3 ]
Sjerps, Matthias J. [4 ,5 ]
Chang, Edward F. [1 ,2 ,6 ]
机构
[1] Univ Calif San Francisco, Dept Neurol Surg, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[2] Univ Calif San Francisco, Ctr Integrat Neurosci, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[3] Univ Calif San Francisco, Dept Neurol, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[4] Univ Calif Berkeley, Dept Linguist, 1203 Dwinelle Hall 2650, Berkeley, CA 94720 USA
[5] Radboud Univ Nijmegen, Ctr Cognit Neuroimaging, Donders Inst Brain Cognit & Behav, Neurobiol Language Dept, Kapittelweg 29, NL-6525 EN Nijmegen, Netherlands
[6] Univ Calif San Francisco, Dept Physiol, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
来源
NATURE COMMUNICATIONS | 2016年 / 7卷
关键词
PHONEMIC RESTORATION; NEURAL ACTIVITY; DYNAMICS; CONTEXT; INFORMATION; INTEGRATION; KNOWLEDGE; MODEL;
D O I
10.1038/ncomms13619
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Humans are adept at understanding speech despite the fact that our natural listening environment is often filled with interference. An example of this capacity is phoneme restoration, in which part of a word is completely replaced by noise, yet listeners report hearing the whole word. The neurological basis for this unconscious fill-in phenomenon is unknown, despite being a fundamental characteristic of human hearing. Here, using direct cortical recordings in humans, we demonstrate that missing speech is restored at the acoustic-phonetic level in bilateral auditory cortex, in real-time. This restoration is preceded by specific neural activity patterns in a separate language area, left frontal cortex, which predicts the word that participants later report hearing. These results demonstrate that during speech perception, missing acoustic content is synthesized online from the integration of incoming sensory cues and the internal neural dynamics that bias word-level expectation and prediction.
引用
下载
收藏
页数:9
相关论文
共 50 条
  • [21] Temporal lobe perceptual predictions for speech are instantiated in motor cortex and reconciled by inferior frontal cortex
    Cope, Thomas E.
    Sohoglu, Ediz
    Peterson, Katie A.
    Jones, P. Simon
    Rua, Catarina
    Passamonti, Luca
    Sedley, William
    Post, Brechtje
    Coebergh, Jan
    Butler, Christopher R.
    Garrard, Peter
    Abdel-Aziz, Khaled
    Husain, Masud
    Griffiths, Timothy D.
    Patterson, Karalyn
    Davis, Matthew H.
    Rowe, James B.
    CELL REPORTS, 2023, 42 (05):
  • [22] Reading-induced shifts of perceptual speech representations in auditory cortex
    Milene Bonte
    Joao M. Correia
    Mirjam Keetels
    Jean Vroomen
    Elia Formisano
    Scientific Reports, 7
  • [23] Reading-induced shifts of perceptual speech representations in auditory cortex
    Bonte, Milene
    Correia, Joao M.
    Keetels, Mirjam
    Vroomen, Jean
    Formisano, Elia
    SCIENTIFIC REPORTS, 2017, 7
  • [24] Perceptual learning with masked stimuli
    Fahle, M.
    Eggert, T.
    Wischhusen, S.
    Spang, K.
    PERCEPTION, 2006, 35 : 8 - 8
  • [25] The Tracking of Speech Envelope in the Human Cortex
    Kubanek, Jan
    Brunner, Peter
    Gunduz, Aysegul
    Poeppel, David
    Schalk, Gerwin
    PLOS ONE, 2013, 8 (01):
  • [26] Neural mechanisms of perceptual grouping in human visual cortex
    Mao, LH
    Han, SH
    Guo, CY
    Jiang, Y
    CHINESE SCIENCE BULLETIN, 2004, 49 (08): : 819 - 823
  • [27] Neural mechanisms of perceptual grouping in human visual cortex
    MAO Lihua1
    2. Learning & Cognition Lab
    Science Bulletin, 2004, (08) : 819 - 823
  • [28] Olfactory perceptual learning in human piriform and orbitofrontal cortex
    Gottfried, J. A.
    Li, W.
    Luxenberg, E.
    Howard, J.
    CHEMICAL SENSES, 2006, 31 (05) : A28 - A28
  • [29] Perceptual decision-making in human prefrontal cortex
    Ungerleider, LG
    Heekeren, H
    Marrett, S
    Bandettini, PA
    PERCEPTION, 2004, 33 : 23 - 23
  • [30] MISSING COMPONENT RESTORATION FOR MASKED SPEECH SIGNALS BASED ON TIME-DOMAIN SPECTROGRAM FACTORIZATION
    Seki, Shogo
    Kameoka, Hirokazu
    Toda, Tomoki
    Takeda, Kazuya
    2017 IEEE 27TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2017,