Deep-learning-based motor imagery EEG classification by exploiting the functional connectivity of cortical source imaging

被引:0
|
作者
Bian, Doudou [1 ]
Ma, Yue [1 ]
Huang, Jiayin [1 ]
Xu, Dongyang [2 ]
Wang, Zhi [2 ,3 ]
Cai, Shengsheng [2 ,4 ]
Wang, Jiajun [1 ]
Hu, Nan [1 ]
机构
[1] Soochow Univ, Sch Elect & Informat Engn, Suzhou 215006, Peoples R China
[2] Zhejiang Univ, Huzhou Inst, Ctr Intelligent Acoust & Signal Proc, Huzhou 313000, Peoples R China
[3] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[4] Suzhou Melodicare Med Technol Co Ltd, Suzhou 215151, Peoples R China
关键词
Motor imagery EEG; Brain functional connectivity; Electrophysiological source imaging; Temporal convolutional network; Graph convolutional network; CONVOLUTIONAL NEURAL-NETWORKS; BRAIN-COMPUTER INTERFACE; WINDOW; CNN;
D O I
10.1007/s11760-023-02965-6
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Motor imagery (MI) is a commonly used brain-computer interface paradigm, and decoding the MI-EEG signals has been an active research area in recent years. The existing methods involved various feature extraction and machine learning schemes, while classification accuracy and inter-individual model adaptation still need to be improved. To address these issues, a novel source-domain MI-EEG classification algorithm is proposed in this paper. First, the Champagne algorithm with noise self-learning, is adopted to achieve high-spatial-resolution denoised electrophysiological source imaging (ESI) on the cortex. Second, a kind of brain functional connectivity metric, imaginary coherence (iCOH), is used to exploit the source spatial features in the motor cortex. The iCOH in the motor cortex is calculated to form the graph structure of motor cortical source space during MI, by which graph convolutional networks (GCNs) are constructed to extract the spatial features. Multi-scale temporal features are also derived by temporal convolutional network (TCN) along with multi-head attention mechanism, and spatial attention based on GCN is also used for the interaction of spatio-temporal features. Finally, all the extracted features are combined to give the ultimate classification result. The MI-EEG classification performance of the proposed algorithm is evaluated on the PhysioNet EEG Motor Movement/Imagery Datasetis superior, both for the results of intra-subject fivefold cross validation experiments and subject-specific model training experiments.
引用
收藏
页码:2991 / 3007
页数:17
相关论文
共 50 条
  • [1] Deep-learning-based motor imagery EEG classification by exploiting the functional connectivity of cortical source imaging
    Doudou Bian
    Yue Ma
    Jiayin Huang
    Dongyang Xu
    Zhi Wang
    Shengsheng Cai
    Jiajun Wang
    Nan Hu
    [J]. Signal, Image and Video Processing, 2024, 18 : 2991 - 3007
  • [2] A Deep Learning Method for Classification of EEG Data Based on Motor Imagery
    An, Xiu
    Kuang, Deping
    Guo, Xiaojiao
    Zhao, Yilu
    He, Lianghua
    [J]. INTELLIGENT COMPUTING IN BIOINFORMATICS, 2014, 8590 : 203 - 210
  • [3] Deep learning for motor imagery EEG-based classification: A review
    Al-Saegh, Ali
    Dawwd, Shefa A.
    Abdul-Jabbar, Jassim M.
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
  • [4] Motor Imagery EEG Signal Classification based on Deep Transfer Learning
    Wei, Mingnan
    Yang, Rui
    Huang, Mengjie
    [J]. 2021 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2021, : 85 - 90
  • [5] TD-LSTM: a time distributed and deep-learning-based architecture for classification of motor imagery and execution in EEG signals
    Karimian-Kelishadrokhi, Morteza
    Safi-Esfahani, Faramarz
    [J]. Neural Computing and Applications, 2024, 36 (25) : 15843 - 15868
  • [6] Classification of Motor Imagery EEG Signals with Deep Learning Models
    Shen, Yurun
    Lu, Hongtao
    Jia, Jie
    [J]. INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING, ISCIDE 2017, 2017, 10559 : 181 - 190
  • [7] EEG-Based Motor Imagery Classification with Deep Multi-Task Learning
    Song, Yaguang
    Wang, Danli
    Yue, Kang
    Zheng, Nan
    Shen, Zuo-Jun Max
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [8] A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification
    Huang, Xiuyu
    Zhou, Nan
    Choi, Kup-Sze
    [J]. FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [9] EEG Classification of Motor Imagery Using a Novel Deep Learning Framework
    Dai, Mengxi
    Zheng, Dezhi
    Na, Rui
    Wang, Shuai
    Zhang, Shuailei
    [J]. SENSORS, 2019, 19 (03)
  • [10] EEG Motor Imagery Classification With Sparse Spectrotemporal Decomposition and Deep Learning
    Sun, Biao
    Zhao, Xing
    Zhang, Han
    Bai, Ruifeng
    Li, Ting
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 541 - 551