Enhancing Motor Imagery Classification with Residual Graph Convolutional Networks and Multi-Feature Fusion

被引:0
|
作者
Xu, Fangzhou [1 ]
Shi, Weiyou [1 ]
Lv, Chengyan [1 ]
Sun, Yuan [1 ]
Guo, Shuai [2 ]
Feng, Chao [1 ]
Zhang, Yang [3 ]
Jung, Tzyy-Ping [4 ]
Leng, Jiancai [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Int Sch Optoelect Engn, Jinan 250353, Peoples R China
[2] Shandong Univ, Qilu Hosp, Rehabil Ctr, Jinan 250012, Peoples R China
[3] Shandong Univ Tradit Chinese Med, Affiliated Hosp, Rehabil & Phys Therapy Dept, Jinan 250011, Peoples R China
[4] Univ Calif San Diego, Inst Neural Computat, Swartz Ctr Computat Neurosci, La Jolla, CA USA
基金
中国国家自然科学基金;
关键词
Brain network; modified residual graph convolutional network; modified <italic>S</italic>-transform; self-attention mechanism; stroke; BRAIN-COMPUTER-INTERFACE; SPECTRUM; STROKE;
D O I
10.1142/S0129065724500692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stroke, an abrupt cerebrovascular ailment resulting in brain tissue damage, has prompted the adoption of motor imagery (MI)-based brain-computer interface (BCI) systems in stroke rehabilitation. However, analyzing electroencephalogram (EEG) signals from stroke patients poses challenges. To address the issues of low accuracy and efficiency in EEG classification, particularly involving MI, the study proposes a residual graph convolutional network (M-ResGCN) framework based on the modified S-transform (MST), and introduces the self-attention mechanism into residual graph convolutional network (ResGCN). This study uses MST to extract EEG time-frequency domain features, derives spatial EEG features by calculating the absolute Pearson correlation coefficient (aPcc) between channels, and devises a method to construct the adjacency matrix of the brain network using aPcc to measure the strength of the connection between channels. Experimental results involving 16 stroke patients and 16 healthy subjects demonstrate significant improvements in classification quality and robustness across tests and subjects. The highest classification accuracy reached 94.91% and a Kappa coefficient of 0.8918. The average accuracy and F1 scores from 10 times 10-fold cross-validation are 94.38% and 94.36%, respectively. By validating the feasibility and applicability of brain networks constructed using the aPcc in EEG signal analysis and feature encoding, it was established that the aPcc effectively reflects overall brain activity. The proposed method presents a novel approach to exploring channel relationships in MI-EEG and improving classification performance. It holds promise for real-time applications in MI-based BCI systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Adaptive Multi-Feature Fusion Graph Convolutional Network for Hyperspectral Image Classification
    Liu, Jie
    Guan, Renxiang
    Li, Zihao
    Zhang, Jiaxuan
    Hu, Yaowen
    Wang, Xueyong
    REMOTE SENSING, 2023, 15 (23)
  • [2] A Multi-feature Fusion Transformer Neural Network for Motor Imagery EEG Signal Classification
    Hu, Zhangfang
    He, Lingxiao
    Wu, Haoze
    ENGINEERING LETTERS, 2023, 31 (04) : 1822 - 1831
  • [3] Multi-Feature Fusion in Graph Convolutional Networks for Data Network Propagation Path Tracing
    Jing, Dongsheng
    Yang, Yu
    Gu, Zhimin
    Feng, Renjun
    Li, Yan
    Jiang, Haitao
    ELECTRONICS, 2024, 13 (17)
  • [4] Densely Feature Fusion Based on Convolutional Neural Networks for Motor Imagery EEG Classification
    Li, Donglin
    Wang, Jianhui
    Xu, Jiacan
    Fang, Xiaoke
    IEEE ACCESS, 2019, 7 : 132720 - 132730
  • [5] Hyperspectral Images Classification Based on Multi-Feature Fusion and Hybrid Convolutional Neural Networks
    Feng Fan
    Wang Shuangting
    Zhang Jin
    Wang Chunyang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (08)
  • [6] Multi-feature fusion of convolutional neural networks for Fine-Grained ship classification
    Huang, Sizhe
    Xu, Huosheng
    Xia, Xuezhi
    Yang, Fan
    Zou, Fuhao
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 37 (01) : 125 - 135
  • [7] Adaptive Spatiotemporal Graph Convolutional Networks for Motor Imagery Classification
    Sun, Biao
    Zhang, Han
    Wu, Zexu
    Zhang, Yunyan
    Li, Ting
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 219 - 223
  • [8] Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification
    Amin, Syed Umar
    Alsulaiman, Mansour
    Muhammad, Ghulam
    Bencherif, Mohamed A.
    Hossain, M. Shamim
    IEEE ACCESS, 2019, 7 : 18940 - 18950
  • [9] Variable length particle swarm optimization and multi-feature deep fusion for motor imagery EEG classification
    Li, Hongli
    Guo, Wei
    Zhang, Ronghua
    Xiu, Chunbo
    BIOCHEMICAL AND BIOPHYSICAL RESEARCH COMMUNICATIONS, 2021, 571 : 131 - 136
  • [10] Convolutional neural network and multi-feature fusion for automatic modulation classification
    Wu, Hao
    Li, Yaxing
    Zhou, Liang
    Meng, Jin
    ELECTRONICS LETTERS, 2019, 55 (16) : 895 - +