Perceptual restoration of masked speech in human cortex

被引:90
|
作者
Leonard, Matthew K. [1 ,2 ]
Baud, Maxime O. [3 ]
Sjerps, Matthias J. [4 ,5 ]
Chang, Edward F. [1 ,2 ,6 ]
机构
[1] Univ Calif San Francisco, Dept Neurol Surg, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[2] Univ Calif San Francisco, Ctr Integrat Neurosci, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[3] Univ Calif San Francisco, Dept Neurol, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
[4] Univ Calif Berkeley, Dept Linguist, 1203 Dwinelle Hall 2650, Berkeley, CA 94720 USA
[5] Radboud Univ Nijmegen, Ctr Cognit Neuroimaging, Donders Inst Brain Cognit & Behav, Neurobiol Language Dept, Kapittelweg 29, NL-6525 EN Nijmegen, Netherlands
[6] Univ Calif San Francisco, Dept Physiol, 675 Nelson Rising Lane,Room 535, San Francisco, CA 94158 USA
来源
NATURE COMMUNICATIONS | 2016年 / 7卷
关键词
PHONEMIC RESTORATION; NEURAL ACTIVITY; DYNAMICS; CONTEXT; INFORMATION; INTEGRATION; KNOWLEDGE; MODEL;
D O I
10.1038/ncomms13619
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Humans are adept at understanding speech despite the fact that our natural listening environment is often filled with interference. An example of this capacity is phoneme restoration, in which part of a word is completely replaced by noise, yet listeners report hearing the whole word. The neurological basis for this unconscious fill-in phenomenon is unknown, despite being a fundamental characteristic of human hearing. Here, using direct cortical recordings in humans, we demonstrate that missing speech is restored at the acoustic-phonetic level in bilateral auditory cortex, in real-time. This restoration is preceded by specific neural activity patterns in a separate language area, left frontal cortex, which predicts the word that participants later report hearing. These results demonstrate that during speech perception, missing acoustic content is synthesized online from the integration of incoming sensory cues and the internal neural dynamics that bias word-level expectation and prediction.
引用
下载
收藏
页数:9
相关论文
共 50 条
  • [1] Perceptual restoration of masked speech in human cortex
    Matthew K. Leonard
    Maxime O. Baud
    Matthias J. Sjerps
    Edward F. Chang
    Nature Communications, 7
  • [2] PERCEPTUAL RESTORATION OF INTERMITTENT SPEECH USING HUMAN SPEECH-LIKE NOISE
    Mizumachi, Mitsunori
    Imanaga, Shouma
    Horiuchi, Toshiharu
    PROCEEDINGS OF THE 23RD INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: FROM ANCIENT TO MODERN ACOUSTICS, 2016,
  • [3] Comparing human and automatic speech recognition in a perceptual restoration experiment
    Remes, Ulpu
    Lopez, Ana Ramirez
    Juvela, Lauri
    Palomaki, Kalle
    Brown, Guy J.
    Alku, Paavo
    Kurimo, Mikko
    COMPUTER SPEECH AND LANGUAGE, 2016, 35 : 14 - 31
  • [4] Neural speech restoration at the cocktail party: Auditory cortex recovers masked speech of both attended and ignored speakers
    Brodbeck, Christian
    Jiao, Alex
    Hong, L. Elliot
    Simon, Jonathan Z.
    PLOS BIOLOGY, 2020, 18 (10)
  • [5] PERCEPTUAL RESTORATION OF MISSING SPEECH SOUNDS
    WARREN, RM
    SCIENCE, 1970, 167 (3917) : 392 - &
  • [6] IMPROVING THE PERCEPTUAL QUALITY OF IDEAL BINARY MASKED SPEECH
    Lightburn, Leo
    De Sena, Enzo
    Moore, Alastair
    Naylo, Patrick A.
    Brookes, Mike
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 661 - 665
  • [7] Reconstruction techniques for improving the perceptual quality of binary masked speech
    Williamson, D.S. (williado@cse.ohio-state.edu), 1600, Acoustical Society of America (136):
  • [8] Reconstruction techniques for improving the perceptual quality of binary masked speech
    Williamson, Donald S.
    Wang, Yuxuan
    Wang, DeLiang
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2014, 136 (02): : 892 - 902
  • [9] Perceptual Restoration of Degraded Speech Is Preserved with Advancing Age
    Saija, Jefta D.
    Akyurek, Elkan G.
    Andringa, Tjeerd C.
    Baskent, Deniz
    JARO-JOURNAL OF THE ASSOCIATION FOR RESEARCH IN OTOLARYNGOLOGY, 2014, 15 (01): : 139 - 148
  • [10] PERCEPTUAL RESTORATION OF INTERMITTENT SPEECH UNDER NOISY ENVIRONMENT
    Mizumachi, Mitsunori
    Motomura, Satoshi
    Takakura, Tomohito
    Horiuchi, Toshiharu
    PROCEEDINGS OF THE 22ND INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: MAJOR CHALLENGES IN ACOUSTICS, NOISE AND VIBRATION RESEARCH, 2015, 2015,