SincNet-Based Hybrid Neural Network for Motor Imagery EEG Decoding

被引:31
|
作者
Liu, Chang [1 ]
Jin, Jing [2 ]
Daly, Ian [3 ]
Li, Shurui [1 ]
Sun, Hao [1 ]
Huang, Yitao [1 ]
Wang, Xingyu [1 ]
Cichocki, Andrzej [4 ,5 ,6 ]
机构
[1] East China Univ Sci & Technol, Minist Educ, Key Lab Smart Mfg Energy Chem Proc, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Shenzhen Res Inst, Minist Educ, Key Lab Smart Mfg Energy Chem Proc, Shanghai 200237, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Brain Comp Interfacing & Neural Engn Lab, Wivenhoe Pk, Colchester CO4 3SQ, Essex, England
[4] Skolkovo Inst Sci & Technol SKOLTECH, Moscow 143026, Russia
[5] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
[6] Nicolaus Copernicus Univ, Dept Informat, PL-87100 Torun, Poland
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Convolution; Kernel; Convolutional neural networks; Filter banks; Task analysis; Brain-computer interface; motor imagery; SincNet; neural network; gated recurrent unit; BRAIN-COMPUTER-INTERFACE;
D O I
10.1109/TNSRE.2022.3156076
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
It is difficult to identify optimal cut-off frequencies for filters used with the common spatial pattern (CSP) method in motor imagery (MI)-based brain-computer interfaces (BCIs). Most current studies choose filter cut-frequencies based on experience or intuition, resulting in sub-optimal use of MI-related spectral information in the electroencephalography (EEG). To improve information utilization, we propose a SincNet-based hybrid neural network (SHNN) for MI-based BCIs. First, raw EEG is segmented into different time windows and mapped into the CSP feature space. Then, SincNets are used as filter bank band-pass filters to automatically filter the data. Next, we used squeeze-and-excitation modules to learn a sparse representation of the filtered data. The resulting sparse data were fed into convolutional neural networks to learn deep feature representations. Finally, these deep features were fed into a gated recurrent unit module to seek sequential relations, and a fully connected layer was used for classification. We used the BCI competition IV datasets 2a and 2b to verify the effectiveness of our SHNN method. The mean classification accuracies (kappa values) of our SHNN method are 0.7426 (0.6648) on dataset 2a and 0.8349 (0.6697) on dataset 2b, respectively. The statistical test results demonstrate that our SHNN can significantly outperform other state-of-the-art methods on these datasets.
引用
收藏
页码:540 / 549
页数:10
相关论文
共 50 条
  • [1] Hybrid deep neural network using transfer learning for EEG motor imagery decoding
    Zhang, Ruilong
    Zong, Qun
    Dou, Liqian
    Zhao, Xinyi
    Tang, Yifan
    Li, Zhiyu
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
  • [2] Compact convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
    Izzuddin, Tarmizi Ahmad
    Safri, Norlaili Mat
    Othman, Mohd Afzan
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2021, 41 (04) : 1629 - 1645
  • [3] A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding
    Zhi, Hongyi
    Yu, Zhuliang
    Yu, Tianyou
    Gu, Zhenghui
    Yang, Jian
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 3988 - 3998
  • [4] Conditional Adversarial Domain Adaptation Neural Network for Motor Imagery EEG Decoding
    Tang, Xingliang
    Zhang, Xianrui
    [J]. ENTROPY, 2020, 22 (01) : 96
  • [5] Improving EEG-Based Motor Imagery Classification Using Hybrid Neural Network
    Li, Cong
    Yang, Honghong
    Wu, Xia
    Zhang, Yumei
    [J]. 2021 IEEE 9TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION AND NETWORKS (ICICN 2021), 2021, : 486 - 489
  • [6] EEG Emotion Classification Using an Improved SincNet-Based Deep Learning Model
    Zeng, Hong
    Wu, Zhenhua
    Zhang, Jiaming
    Yang, Chen
    Zhang, Hua
    Dai, Guojun
    Kong, Wanzeng
    [J]. BRAIN SCIENCES, 2019, 9 (11)
  • [7] Motor Imagery Decoding Enhancement Based on Hybrid EEG-fNIRS Signals
    Xu, Tao
    Zhou, Zhengkang
    Yang, Yuliang
    Li, Yu
    Li, Junhua
    Bezerianos, Anastasios
    Wang, Hongtao
    [J]. IEEE ACCESS, 2023, 11 : 65277 - 65288
  • [8] Improved Decoding of EEG-Based Motor Imagery Using Convolutional Neural Network and Data Space Adaptation
    Chua, Shawn
    Tao, Yang
    So, Rosa Q.
    [J]. 2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
  • [9] A Channel Selection Approach Based on Convolutional Neural Network for Multi-Channel EEG Motor Imagery Decoding
    Mzurikwao, Deogratias
    Samuel, Oluwarotimi Williams
    Asogbon, Mojisola Grace
    Li, Xiangxin
    Li, Guanglin
    Yeo, Woon-Hong
    Efstratiou, Christos
    Ang, Chee Siang
    [J]. 2019 IEEE SECOND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND KNOWLEDGE ENGINEERING (AIKE), 2019, : 195 - 202
  • [10] Interpretable SincNet-based Deep Learning for Emotion Recognition from EEG brain activity
    Mayor-Torres, Juan Manuel
    Ravanelli, Mirco
    Medina-DeVilliers, Sara E.
    Lerner, Matthew D.
    Riccardi, Giuseppe
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 412 - 415