Decoding the temporal dynamics of spoken word and nonword processing from EEG

被引:7
|
作者
McMurray, Bob [1 ,2 ]
Sarrett, McCall E. [3 ]
Chiu, Samantha [4 ]
Black, Alexis K. [5 ]
Wang, Alice [6 ]
Canale, Rebecca [7 ]
Aslin, Richard N. [8 ,9 ,10 ]
机构
[1] Univ Iowa, Dept Psychol & Brain Sci, Dept Commun Sci & Disorders, Dept Linguist, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Otolaryngol, Iowa City, IA 52242 USA
[3] Univ Iowa, Interdisciplinary Grad Program Neurosci, Iowa City, IA USA
[4] Univ Iowa, Dept Psychol & Brain Sci, 278 PBSB, Iowa City, IA 52242 USA
[5] Univ British Columbia, Sch Audiol & Speech Sci, Haskins Labs, Vancouver, BC, Canada
[6] Univ Oregon, Haskins Labs, Dept Psychol, Eugene, OR 97403 USA
[7] Univ Connecticut, Dept Psychol Sci, Haskins Labs, Storrs, CT USA
[8] Yale Univ, Dept Psychol, Haskins Labs, New Haven, CT USA
[9] Yale Univ, Ctr Child Study, New Haven, CT 06520 USA
[10] Univ Connecticut, Dept Psychol, Storrs, CT USA
关键词
Spoken Word Recognition; Speech Decoding; EEG; Machine Learning; TIME-COURSE; LEXICAL COMPETITION; PATTERN-ANALYSIS; TRACE MODEL; RECOGNITION; PERCEPTION; INTEGRATION; TRACKING; SIGNAL; SOUND;
D O I
10.1016/j.neuroimage.2022.119457
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage ) or a similar sounding competitor ( badger ), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [1] The temporal dynamics of ambiguity resolution: Evidence from spoken-word recognition
    Dahan, Delphine
    Gaskell, M. Gareth
    JOURNAL OF MEMORY AND LANGUAGE, 2007, 57 (04) : 483 - 501
  • [2] The Temporal Dynamics of Spoken Word Recognition in Adverse Listening Conditions
    Susanne Brouwer
    Ann R. Bradlow
    Journal of Psycholinguistic Research, 2016, 45 : 1151 - 1160
  • [3] The Temporal Dynamics of Spoken Word Recognition in Adverse Listening Conditions
    Brouwer, Susanne
    Bradlow, Ann R.
    JOURNAL OF PSYCHOLINGUISTIC RESEARCH, 2016, 45 (05) : 1151 - 1160
  • [4] Decoding the temporal dynamics of affective scene processing
    Bo, Ke
    Cui, Lihan
    Yin, Siyang
    Hu, Zhenhong
    Hong, Xiangfei
    Kim, Sungkean
    Keil, Andreas
    Ding, Mingzhou
    NEUROIMAGE, 2022, 261
  • [5] Word-Decoding as a Function of Temporal Processing in the Visual System
    Holloway, Steven R.
    Naniez, Jose E., Sr.
    Seitz, Aaron R.
    PLOS ONE, 2013, 8 (12):
  • [6] ROLE OF THE SYLLABLE IN THE PROCESSING OF SPOKEN-ENGLISH - EVIDENCE FROM A NONWORD COMPARISON TASK
    BRUCK, M
    TREIMAN, R
    CARAVOLAS, M
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1995, 21 (03) : 469 - 479
  • [7] PARALLEL PROCESSING IN A WORD-NONWORD CLASSIFICATION TASK
    NOVIK, N
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1974, 102 (06): : 1015 - 1020
  • [8] EEG Evidence for a Three-Phase Recurrent Process during Spoken Word Processing
    Zhao, Bin
    Dong, Jianwu
    Zhang, Gaoyan
    2016 10TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2016,
  • [9] Anterior temporal lobe is necessary for efficient lateralised processing of spoken word identity
    Cope, Thomas E.
    Shtyrov, Yury
    MacGregor, Lucy J.
    Holland, Rachel
    Pulvermueller, Friedemann
    Rowe, James B.
    Patterson, Karalyn
    CORTEX, 2020, 126 : 107 - 118
  • [10] The Temporal Dynamics of Scene Processing: A Multifaceted EEG Investigation
    Harel, Assaf
    Groen, Iris I. A.
    Kravitz, Dwight J.
    Deouell, Leon Y.
    Baker, Chris I.
    ENEURO, 2016, 3 (05)