Decoding Part-of-Speech from Human EEG Signals

被引:0
|
作者
Murphy, Alex [1 ]
Bohnet, Bernd [2 ]
McDonald, Ryan [3 ]
Noppeney, Uta [4 ]
机构
[1] Univ Birmingham, Birmingham, W Midlands, England
[2] Google Res, Mountain View, CA USA
[3] ASAPP, New York, NY USA
[4] Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
关键词
MULTIVARIATE PATTERN-ANALYSIS; CLOSED-CLASS WORDS; BRAIN POTENTIALS; FREQUENCY; LENGTH; RESPONSES; LANGUAGE; TIME;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work explores techniques to predict Part-of-Speech (PoS) tags from neural signals measured at millisecond resolution with electroencephalography (EEG) during text reading. We show that information about word length, frequency and word class is encoded by the brain at different poststimulus latencies. We then demonstrate that pretraining on averaged EEG data and data augmentation techniques boost PoS single-trial EEG decoding accuracy for Transformers (but not linear SVMs). Applying optimised temporally-resolved decoding techniques we show that Transformers outperform linear SVMs on PoS tagging of unigram and bigram data more strongly when information requires integration across longer time windows.
引用
收藏
页码:2201 / 2210
页数:10
相关论文
共 50 条
  • [1] Using articulated speech EEG signals for imagined speech decoding
    Bras, Chris
    Patel, Tanvina
    Scharenborg, Odette
    INTERSPEECH 2024, 2024, : 407 - 411
  • [2] Part-of-speech persistence: The influence of part-of-speech information on lexical processes
    Melinger, Alissa
    Koenig, Jean-Pierre
    JOURNAL OF MEMORY AND LANGUAGE, 2007, 56 (04) : 472 - 489
  • [3] Part-of-speech tagging
    Martinez, Angel R.
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2012, 4 (01): : 107 - 113
  • [4] The Role of Artificial Intelligence in Decoding Speech from EEG Signals: A Scoping Review
    Shah, Uzair
    Alzubaidi, Mahmood
    Mohsen, Farida
    Abd-Alrazaq, Alaa
    Alam, Tanvir
    Househ, Mowafa
    SENSORS, 2022, 22 (18)
  • [5] ADVERBIAL PART-OF-SPEECH
    CERVONI, J
    LANGUE FRANCAISE, 1990, (88): : 5 - 11
  • [6] ADT Network: A Novel Nonlinear Method for Decoding Speech Envelopes From EEG Signals
    Liu, Ruixiang
    Liu, Chang
    Cui, Dan
    Zhang, Huan
    Xu, Xinmeng
    Duan, Yuxin
    Chao, Yihu
    Sha, Xianzheng
    Sun, Limin
    Ma, Xiulan
    Li, Shuo
    Chang, Shijie
    TRENDS IN HEARING, 2024, 28
  • [7] Toward Fully-End-to-End Listened Speech Decoding from EEG Signals
    Lee, Jihwan
    Kommineni, Aditya
    Feng, Tiantian
    Avramidis, Kleanthis
    Shi, Xuan
    Kadiri, Sudarsana Reddy
    Narayanan, Shrikanth
    INTERSPEECH 2024, 2024, : 1500 - 1504
  • [8] A Universal Part-of-Speech Tagset
    Petrov, Slav
    Das, Dipanjan
    McDonald, Ryan
    LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2012, : 2089 - 2096
  • [9] Part-of-speech tagging for Swedish
    Prütz, K
    PARALLEL CORPORA, PARALLEL WORLDS, 2002, (43): : 201 - 206
  • [10] Part-of-Speech Induction for Vietnamese
    Phuong Le-Hong
    Thi Minh Huyen Nguyen
    KNOWLEDGE AND SYSTEMS ENGINEERING (KSE 2013), VOL 2, 2014, 245 : 261 - 272