Decoding the temporal dynamics of spoken word and nonword processing from EEG

被引:7
|
作者
McMurray, Bob [1 ,2 ]
Sarrett, McCall E. [3 ]
Chiu, Samantha [4 ]
Black, Alexis K. [5 ]
Wang, Alice [6 ]
Canale, Rebecca [7 ]
Aslin, Richard N. [8 ,9 ,10 ]
机构
[1] Univ Iowa, Dept Psychol & Brain Sci, Dept Commun Sci & Disorders, Dept Linguist, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Otolaryngol, Iowa City, IA 52242 USA
[3] Univ Iowa, Interdisciplinary Grad Program Neurosci, Iowa City, IA USA
[4] Univ Iowa, Dept Psychol & Brain Sci, 278 PBSB, Iowa City, IA 52242 USA
[5] Univ British Columbia, Sch Audiol & Speech Sci, Haskins Labs, Vancouver, BC, Canada
[6] Univ Oregon, Haskins Labs, Dept Psychol, Eugene, OR 97403 USA
[7] Univ Connecticut, Dept Psychol Sci, Haskins Labs, Storrs, CT USA
[8] Yale Univ, Dept Psychol, Haskins Labs, New Haven, CT USA
[9] Yale Univ, Ctr Child Study, New Haven, CT 06520 USA
[10] Univ Connecticut, Dept Psychol, Storrs, CT USA
关键词
Spoken Word Recognition; Speech Decoding; EEG; Machine Learning; TIME-COURSE; LEXICAL COMPETITION; PATTERN-ANALYSIS; TRACE MODEL; RECOGNITION; PERCEPTION; INTEGRATION; TRACKING; SIGNAL; SOUND;
D O I
10.1016/j.neuroimage.2022.119457
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage ) or a similar sounding competitor ( badger ), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] The neural systems of spoken and written word processing
    Price, C
    JOURNAL OF PSYCHOPHYSIOLOGY, 2003, 17 (04) : 235 - 235
  • [32] Electrophysiological evidence for the efficiency of spoken word processing
    O'Rourke, TB
    Holcomb, PJ
    BIOLOGICAL PSYCHOLOGY, 2002, 60 (2-3) : 121 - 150
  • [33] Decoding word and category-specific spatiotemporal representations from MEG and EEG
    Chan, Alexander M.
    Halgren, Eric
    Marinkovic, Ksenija
    Cash, Sydney S.
    NEUROIMAGE, 2011, 54 (04) : 3028 - 3039
  • [34] Processing of written word and nonword visual information by individuals with prelingual deafness
    Miller, P
    JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2004, 47 (05): : 990 - 1000
  • [35] SPEECH ARTIFACT REMOVAL FROM EEG RECORDINGS OF SPOKEN WORD PRODUCTION WITH TENSOR DECOMPOSITION
    Lovenia, Holy
    Tanaka, Hiroki
    Sakti, Sakriani
    Purwarianti, Ayu
    Nakamura, Satoshi
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1115 - 1119
  • [36] From the spoken to the written word
    Dutau, G
    REVUE FRANCAISE D ALLERGOLOGIE ET D IMMUNOLOGIE CLINIQUE, 2004, 44 (05): : 435 - 435
  • [37] Reconsidering the role of temporal order in spoken word recognition
    Joseph C. Toscano
    Nathaniel D. Anderson
    Bob McMurray
    Psychonomic Bulletin & Review, 2013, 20 : 981 - 987
  • [38] Reconsidering the role of temporal order in spoken word recognition
    Toscano, Joseph C.
    Anderson, Nathaniel D.
    McMurray, Bob
    PSYCHONOMIC BULLETIN & REVIEW, 2013, 20 (05) : 981 - 987
  • [39] From the spoken to the written word
    Casalis, S
    A N A E-APPROCHE NEUROPSYCHOLOGIQUE DES APPRENTISSAGES CHEZ L ENFANT, 1997, 9 (03): : 119 - 120
  • [40] Subliminal Word Processing: EEG Detects Word Processing Below Conscious Awareness
    Pavlevchev, Samuil
    Chang, Minah
    Floeck, Alessandra Natascha
    Walla, Peter
    BRAIN SCIENCES, 2022, 12 (04)