Decoding kinetic features of hand motor preparation from single-trial EEG using convolutional neural networks

被引:6
|
作者
Gatti, Ramiro [1 ,2 ]
Atum, Yanina [2 ]
Schiaffino, Luciano [2 ]
Jochumsen, Mads [3 ]
Biurrun Manresa, Jose [1 ,2 ,4 ]
机构
[1] UNER, CONICET, Inst Res & Dev Bioengn & Bioinformat IBB, Route 11 Km 10, Oro Verde, Entre Rios, Argentina
[2] Natl Univ Entre Rios, Fac Engn, Lab Rehabil Engn & Neuromuscular & Sensor Res LIR, Oro Verde, Argentina
[3] Aalborg Univ, Ctr Sensory Motor Interact SMI, Aalborg, Denmark
[4] Aalborg Univ, Ctr Neuroplast & Pain CNAP, Aalborg, Denmark
基金
新加坡国家研究基金会;
关键词
brain computer interface; deep learning; movement prediction; multi-class classification; neural engineering; MOVEMENT-RELATED POTENTIALS; BRAIN-COMPUTER INTERFACES; CLASSIFICATION; SELECTION; INTENTION;
D O I
10.1111/ejn.14936
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Building accurate movement decoding models from brain signals is crucial for many biomedical applications. Predicting specific movement features, such as speed and force, before movement execution may provide additional useful information at the expense of increasing the complexity of the decoding problem. Recent attempts to predict movement speed and force from the electroencephalogram (EEG) achieved classification accuracies at or slightly above chance levels, highlighting the need for more accurate prediction strategies. Thus, the aims of this study were to accurately predict hand movement speed and force from single-trial EEG signals and to decode neurophysiological information of motor preparation from the prediction strategies. To these ends, a decoding model based on convolutional neural networks (ConvNets) was implemented and compared against other state-of-the-art prediction strategies, such as support vector machines and decision trees. ConvNets outperformed the other prediction strategies, achieving an overall accuracy of 84% in the classification of two different levels of speed and force (four-class classification) from pre-movement single-trial EEG (100 ms and up to 1,600 ms prior to movement execution). Furthermore, an analysis of the ConvNet architectures suggests that the network performs a complex spatiotemporal integration of EEG data to optimize classification accuracy. These results show that movement speed and force can be accurately predicted from single-trial EEG, and that the prediction strategies may provide useful neurophysiological information about motor preparation.
引用
收藏
页码:556 / 570
页数:15
相关论文
共 50 条
  • [1] Single-trial EEG classification of motor imagery using deep convolutional neural networks
    Tang, Zhichuan
    Li, Chao
    Sun, Shouqian
    [J]. OPTIK, 2017, 130 : 11 - 18
  • [2] Single-Trial EEG RSVP Classification using Convolutional Neural Networks
    Shamwell, Jared
    Lee, Yungtae
    Kwon, Heesung
    Marathe, Amar R.
    Lawhern, Vernon
    Nothwang, William
    [J]. MICRO- AND NANOTECHNOLOGY SENSORS, SYSTEMS, AND APPLICATIONS VIII, 2016, 9836
  • [3] PREDICTION OF THE SIDE OF HAND MOVEMENTS FROM SINGLE-TRIAL MULTICHANNEL EEG DATA USING NEURAL NETWORKS
    PFURTSCHELLER, G
    FLOTZINGER, D
    MOHL, W
    PELTORANTA, M
    [J]. ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1992, 82 (04): : 313 - 315
  • [4] Single-trial decoding of intention from EEG
    Ramaswamy, V
    Furstenberg, A.
    Breska, A.
    Deouell, L.
    Sompolinsky, H.
    [J]. JOURNAL OF MOLECULAR NEUROSCIENCE, 2013, 51 : S96 - S96
  • [5] Detecting Syntactic Violations from Single-trial EEG using Recurrent Neural Networks
    Motomura, Shunnosuke
    Tanaka, Hiroki
    Nakamura, Satoshi
    [J]. ICMI'19: ADJUNCT OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019,
  • [6] Convolutional Neural Network for Target Face Detection using Single-trial EEG Signal
    Wang, Haofei
    Shi, Bertram E.
    Wang, Yiwen
    [J]. 2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 2008 - 2011
  • [7] Interpretable deep neural networks for single-trial EEG classification
    Sturm, Irene
    Lapuschkin, Sebastian
    Samek, Wojciech
    Mueller, Klaus-Robert
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2016, 274 : 141 - 145
  • [8] Decoding the Performance of a Memory Task Using Single-trial Intracranial EEG
    Lee, Hyung-Tak
    Jun, Soyeon
    Kim, June Sic
    Chung, Chun Kee
    Hwang, Han-Jeong
    [J]. 10TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI2022), 2022,
  • [9] Single-trial decoding of stimulus pitch from EEG-FFR
    Ho, Letitia
    Veillette, John
    Nusbaum, Howard
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2023, 153 (03):
  • [10] TOWARDS DECODING SELECTIVE ATTENTION FROM SINGLE-TRIAL EEG DATA IN COCHLEAR IMPLANT USERS BASED ON DEEP NEURAL NETWORKS
    Nogueira, Waldo
    Dolhopiatenko, Hanna
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8708 - 8712