Decoding the temporal dynamics of spoken word and nonword processing from EEG

被引:7
|
作者
McMurray, Bob [1 ,2 ]
Sarrett, McCall E. [3 ]
Chiu, Samantha [4 ]
Black, Alexis K. [5 ]
Wang, Alice [6 ]
Canale, Rebecca [7 ]
Aslin, Richard N. [8 ,9 ,10 ]
机构
[1] Univ Iowa, Dept Psychol & Brain Sci, Dept Commun Sci & Disorders, Dept Linguist, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Otolaryngol, Iowa City, IA 52242 USA
[3] Univ Iowa, Interdisciplinary Grad Program Neurosci, Iowa City, IA USA
[4] Univ Iowa, Dept Psychol & Brain Sci, 278 PBSB, Iowa City, IA 52242 USA
[5] Univ British Columbia, Sch Audiol & Speech Sci, Haskins Labs, Vancouver, BC, Canada
[6] Univ Oregon, Haskins Labs, Dept Psychol, Eugene, OR 97403 USA
[7] Univ Connecticut, Dept Psychol Sci, Haskins Labs, Storrs, CT USA
[8] Yale Univ, Dept Psychol, Haskins Labs, New Haven, CT USA
[9] Yale Univ, Ctr Child Study, New Haven, CT 06520 USA
[10] Univ Connecticut, Dept Psychol, Storrs, CT USA
关键词
Spoken Word Recognition; Speech Decoding; EEG; Machine Learning; TIME-COURSE; LEXICAL COMPETITION; PATTERN-ANALYSIS; TRACE MODEL; RECOGNITION; PERCEPTION; INTEGRATION; TRACKING; SIGNAL; SOUND;
D O I
10.1016/j.neuroimage.2022.119457
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage ) or a similar sounding competitor ( badger ), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] The dynamics of spoken word recognition in bilinguals
    Desroches, Amy S.
    Friesen, Deanna C.
    Teles, Matthew
    Korade, Chloe A.
    Forest, Evan W.
    BILINGUALISM-LANGUAGE AND COGNITION, 2022, 25 (04) : 705 - 710
  • [22] The influence of lexical statistics on temporal lobe cortical dynamics during spoken word listening
    Cibelli, Emily S.
    Leonard, Matthew K.
    Johnson, Keith
    Chang, Edward F.
    BRAIN AND LANGUAGE, 2015, 147 : 66 - 75
  • [23] A multivariate investigation of visual word, face, and ensemble processing: Perspectives from EEG-based decoding and feature selection
    Nemrodov, Dan
    Ling, Shouyu
    Nudnou, Ilya
    Roberts, Tyler
    Cant, Jonathan S.
    Lee, Andy C. H.
    Nestor, Adrian
    PSYCHOPHYSIOLOGY, 2020, 57 (03)
  • [24] Decoding the Development of Face Processing With EEG
    Mares, Ines
    Ewing, Louise
    Farran, Emily
    Papasavva, Michael
    Smith, Fraser W.
    Smith, Marie L.
    PERCEPTION, 2019, 48 : 75 - 75
  • [25] Spatiotemporal dynamics of the processing of spoken inflected and derived words: a combined EEG and MEG study
    Leminen, Alina
    Leminen, Miika
    Lehtonen, Minna
    Nevalainen, Paivi
    Ylinen, Sari
    Kimppa, Lilli
    Sannemann, Christian
    Makela, Jyrki P.
    Kujala, Teija
    FRONTIERS IN HUMAN NEUROSCIENCE, 2011, 5
  • [26] Syllabification strategies in spoken word processing: Evidence from phonological priming
    Titone, D
    Connine, CM
    PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 1997, 60 (04): : 251 - 263
  • [27] Syllabification strategies in spoken word processing: Evidence from phonological priming
    D. Titone
    C. M. Connine
    Psychological Research, 1997, 60 : 251 - 263
  • [28] Patterns of word and nonword processing in skilled and less-skilled readers
    Alexandra Gottardo
    Penny Chiappe
    Linda S. Siegel
    Keith E. Stanovich
    Reading and Writing, 1999, 11 : 465 - 487
  • [29] Patterns of word and nonword processing in skilled and less-skilled readers
    Gottardo, A
    Chiappe, P
    Siegel, LS
    Stanovich, KE
    READING AND WRITING, 1999, 11 (5-6) : 465 - 487
  • [30] Spoken word processing creates a lexical bottleneck
    Cleland, Alexandra A.
    Tamminen, Jakke
    Quinlan, Philip T.
    Gaskell, M. Gareth
    LANGUAGE AND COGNITIVE PROCESSES, 2012, 27 (04): : 572 - 593