Enhancing Motor Imagery Classification with Residual Graph Convolutional Networks and Multi-Feature Fusion

被引:0
|
作者
Xu, Fangzhou [1 ]
Shi, Weiyou [1 ]
Lv, Chengyan [1 ]
Sun, Yuan [1 ]
Guo, Shuai [2 ]
Feng, Chao [1 ]
Zhang, Yang [3 ]
Jung, Tzyy-Ping [4 ]
Leng, Jiancai [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Int Sch Optoelect Engn, Jinan 250353, Peoples R China
[2] Shandong Univ, Qilu Hosp, Rehabil Ctr, Jinan 250012, Peoples R China
[3] Shandong Univ Tradit Chinese Med, Affiliated Hosp, Rehabil & Phys Therapy Dept, Jinan 250011, Peoples R China
[4] Univ Calif San Diego, Inst Neural Computat, Swartz Ctr Computat Neurosci, La Jolla, CA USA
基金
中国国家自然科学基金;
关键词
Brain network; modified residual graph convolutional network; modified <italic>S</italic>-transform; self-attention mechanism; stroke; BRAIN-COMPUTER-INTERFACE; SPECTRUM; STROKE;
D O I
10.1142/S0129065724500692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stroke, an abrupt cerebrovascular ailment resulting in brain tissue damage, has prompted the adoption of motor imagery (MI)-based brain-computer interface (BCI) systems in stroke rehabilitation. However, analyzing electroencephalogram (EEG) signals from stroke patients poses challenges. To address the issues of low accuracy and efficiency in EEG classification, particularly involving MI, the study proposes a residual graph convolutional network (M-ResGCN) framework based on the modified S-transform (MST), and introduces the self-attention mechanism into residual graph convolutional network (ResGCN). This study uses MST to extract EEG time-frequency domain features, derives spatial EEG features by calculating the absolute Pearson correlation coefficient (aPcc) between channels, and devises a method to construct the adjacency matrix of the brain network using aPcc to measure the strength of the connection between channels. Experimental results involving 16 stroke patients and 16 healthy subjects demonstrate significant improvements in classification quality and robustness across tests and subjects. The highest classification accuracy reached 94.91% and a Kappa coefficient of 0.8918. The average accuracy and F1 scores from 10 times 10-fold cross-validation are 94.38% and 94.36%, respectively. By validating the feasibility and applicability of brain networks constructed using the aPcc in EEG signal analysis and feature encoding, it was established that the aPcc effectively reflects overall brain activity. The proposed method presents a novel approach to exploring channel relationships in MI-EEG and improving classification performance. It holds promise for real-time applications in MI-based BCI systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] EEG Emotion Classification Based on Multi-Feature Fusion
    Liang, Mingjing
    Wang, Lu
    Wen, Xin
    Cao, Rui
    Computer Engineering and Applications, 2024, 59 (05) : 155 - 159
  • [42] Eye State Classification Based on Multi-feature fusion
    Dong, Wenhui
    Qu, Peishu
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 231 - 234
  • [43] Acoustic Scene Classification using Convolutional Neural Networks and Multi-Scale Multi-Feature Extraction
    Dang, An
    Vu, Toan H.
    Wang, Jia-Ching
    2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2018,
  • [44] Multi-feature fusion stock prediction based on knowledge graph
    Liu, Zhenghao
    Qian, Yuxing
    Lv, Wenlong
    Fang, Yanbin
    Liu, Shenglan
    ELECTRONIC LIBRARY, 2024, 42 (03): : 455 - 482
  • [45] Motor Imagery Multi-classification based on Canonical Correlation Analysis Feature Fusion
    Yang, Zhouyuan
    Guo, Sitong
    Hong, Yunqi
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 3334 - 3339
  • [46] Rural Tourist Attractions Recommendation Model Based on Multi-Feature Fusion Graph Neural Networks
    Zhang, Xiangrong
    Wang, Xueying
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2025, 24 (01)
  • [47] Spatio-Spectral Feature Representation for Motor Imagery Classification Using Convolutional Neural Networks
    Bang, Ji-Seon
    Lee, Min-Ho
    Fazli, Siamac
    Guan, Cuntai
    Lee, Seong-Whan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) : 3038 - 3049
  • [48] Multi-Task Convolutional Networks for Motor Imagery Classification Based on EEG and fNIRS
    Feng, Lufeng
    He, Qun
    Xu, Xiangyuan
    Jiang, Guoqian
    Xie, Ping
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2021, 168 : S199 - S199
  • [49] A Multi-Feature Fusion Model Based on Denoising Convolutional Neural Network and Attention Mechanism for Image Classification
    Zhang, Jingsi
    Yu, Xiaosheng
    Lei, Xiaoliang
    Wu, Chengdong
    INTERNATIONAL JOURNAL OF SWARM INTELLIGENCE RESEARCH, 2023, 14 (02)
  • [50] Enhancing Music Emotion Classification Using Multi-Feature Approach
    Ara, Affreen
    Rekha, V
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (09) : 794 - 803