Decoding Part-of-Speech from Human EEG Signals

被引:0
|
作者
Murphy, Alex [1 ]
Bohnet, Bernd [2 ]
McDonald, Ryan [3 ]
Noppeney, Uta [4 ]
机构
[1] Univ Birmingham, Birmingham, W Midlands, England
[2] Google Res, Mountain View, CA USA
[3] ASAPP, New York, NY USA
[4] Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
来源
PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS) | 2022年
关键词
MULTIVARIATE PATTERN-ANALYSIS; CLOSED-CLASS WORDS; BRAIN POTENTIALS; FREQUENCY; LENGTH; RESPONSES; LANGUAGE; TIME;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work explores techniques to predict Part-of-Speech (PoS) tags from neural signals measured at millisecond resolution with electroencephalography (EEG) during text reading. We show that information about word length, frequency and word class is encoded by the brain at different poststimulus latencies. We then demonstrate that pretraining on averaged EEG data and data augmentation techniques boost PoS single-trial EEG decoding accuracy for Transformers (but not linear SVMs). Applying optimised temporally-resolved decoding techniques we show that Transformers outperform linear SVMs on PoS tagging of unigram and bigram data more strongly when information requires integration across longer time windows.
引用
收藏
页码:2201 / 2210
页数:10
相关论文
共 50 条
  • [41] TnT - A statistical part-of-speech tagger
    Brants, T
    6TH APPLIED NATURAL LANGUAGE PROCESSING CONFERENCE/1ST MEETING OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE AND PROCEEDINGS OF THE ANLP-NAACL 2000 STUDENT RESEARCH WORKSHOP, 2000, : 224 - 231
  • [42] Joint part-of-speech and dependency projection from multiple sources
    Johannsen, Anders
    Agic, Zeljko
    Sogaard, Anders
    PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2016), VOL 2, 2016, : 561 - 566
  • [43] Advances in brain-computer interface for decoding speech imagery from EEG signals: a systematic review
    Rahman, Nimra
    Khan, Danish Mahmood
    Masroor, Komal
    Arshad, Mehak
    Rafiq, Amna
    Fahim, Syeda Maham
    COGNITIVE NEURODYNAMICS, 2024, : 3565 - 3583
  • [44] Decoding of perceptual decisions from early EEG signals
    Bode, Stefan
    Forte, Jason
    Lilburn, Simon
    Sewell, David
    Smith, Philip
    Stahl, Jutta
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2012, 47 : 582 - 582
  • [45] Decoding Individual Finger Movements from One Hand Using Human EEG Signals
    Liao, Ke
    Xiao, Ran
    Gonzalez, Jania
    Ding, Lei
    PLOS ONE, 2014, 9 (01):
  • [46] Augmenting Bug Localization with Part-of-Speech and Invocation
    Zhou, Yu
    Tong, Yanxiang
    Chen, Taolue
    Han, Jin
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2017, 27 (06) : 925 - 949
  • [47] IMPROVING SENTIMENT ANALYSIS WITH PART-OF-SPEECH WEIGHTING
    Nicholls, Chris
    Song, Fei
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 1592 - 1597
  • [48] Part-of-speech tagging with recurrent neural networks
    Pérez-Ortiz, JA
    Forcada, ML
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1588 - 1592
  • [49] Semi-supervised Part-of-speech Tagging in Speech Applications
    Dufour, Richard
    Favre, Benoit
    11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2, 2010, : 1373 - 1376
  • [50] Decoding Speech With Integrated Hybrid Signals Recorded From the Human Ventral Motor Cortex
    Ibayashi, Kenji
    Kunii, Naoto
    Matsuo, Takeshi
    Ishishita, Yohei
    Shimada, Seijiro
    Kawai, Kensuke
    Saito, Nobuhito
    FRONTIERS IN NEUROSCIENCE, 2018, 12