Enhancing Motor Imagery Classification with Residual Graph Convolutional Networks and Multi-Feature Fusion

被引:0
|
作者
Xu, Fangzhou [1 ]
Shi, Weiyou [1 ]
Lv, Chengyan [1 ]
Sun, Yuan [1 ]
Guo, Shuai [2 ]
Feng, Chao [1 ]
Zhang, Yang [3 ]
Jung, Tzyy-Ping [4 ]
Leng, Jiancai [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Int Sch Optoelect Engn, Jinan 250353, Peoples R China
[2] Shandong Univ, Qilu Hosp, Rehabil Ctr, Jinan 250012, Peoples R China
[3] Shandong Univ Tradit Chinese Med, Affiliated Hosp, Rehabil & Phys Therapy Dept, Jinan 250011, Peoples R China
[4] Univ Calif San Diego, Inst Neural Computat, Swartz Ctr Computat Neurosci, La Jolla, CA USA
基金
中国国家自然科学基金;
关键词
Brain network; modified residual graph convolutional network; modified <italic>S</italic>-transform; self-attention mechanism; stroke; BRAIN-COMPUTER-INTERFACE; SPECTRUM; STROKE;
D O I
10.1142/S0129065724500692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stroke, an abrupt cerebrovascular ailment resulting in brain tissue damage, has prompted the adoption of motor imagery (MI)-based brain-computer interface (BCI) systems in stroke rehabilitation. However, analyzing electroencephalogram (EEG) signals from stroke patients poses challenges. To address the issues of low accuracy and efficiency in EEG classification, particularly involving MI, the study proposes a residual graph convolutional network (M-ResGCN) framework based on the modified S-transform (MST), and introduces the self-attention mechanism into residual graph convolutional network (ResGCN). This study uses MST to extract EEG time-frequency domain features, derives spatial EEG features by calculating the absolute Pearson correlation coefficient (aPcc) between channels, and devises a method to construct the adjacency matrix of the brain network using aPcc to measure the strength of the connection between channels. Experimental results involving 16 stroke patients and 16 healthy subjects demonstrate significant improvements in classification quality and robustness across tests and subjects. The highest classification accuracy reached 94.91% and a Kappa coefficient of 0.8918. The average accuracy and F1 scores from 10 times 10-fold cross-validation are 94.38% and 94.36%, respectively. By validating the feasibility and applicability of brain networks constructed using the aPcc in EEG signal analysis and feature encoding, it was established that the aPcc effectively reflects overall brain activity. The proposed method presents a novel approach to exploring channel relationships in MI-EEG and improving classification performance. It holds promise for real-time applications in MI-based BCI systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] SAR image classification based on multi-feature fusion decision convolutional neural network
    Guo, Liang
    IET IMAGE PROCESSING, 2022, 16 (01) : 1 - 10
  • [22] Feature Fusion via Deep Residual Graph Convolutional Network for Hyperspectral Image Classification
    Chen, Rong
    Guanghui, Li
    Dai, Chenglong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [23] Feature Fusion via Deep Residual Graph Convolutional Network for Hyperspectral Image Classification
    Chen, Rong
    Guanghui, Li
    Dai, Chenglong
    IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [24] RNN-combined graph convolutional network with multi-feature fusion for tuberculosis cavity segmentation
    Zhitao Xiao
    Xiaomeng Zhang
    Yanbei Liu
    Lei Geng
    Jun Wu
    Wen Wang
    Fang Zhang
    Signal, Image and Video Processing, 2023, 17 : 2297 - 2303
  • [25] RNN-combined graph convolutional network with multi-feature fusion for tuberculosis cavity segmentation
    Xiao, Zhitao
    Zhang, Xiaomeng
    Liu, Yanbei
    Geng, Lei
    Wu, Jun
    Wang, Wen
    Zhang, Fang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2297 - 2303
  • [26] Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification
    Ding, Yao
    Zhang, Zhili
    Zhao, Xiaofeng
    Hong, Danfeng
    Cai, Wei
    Yu, Chengguo
    Yang, Nengjun
    Cai, Weiwei
    NEUROCOMPUTING, 2022, 501 : 246 - 257
  • [27] Automated detection of kidney abnormalities using multi-feature fusion convolutional neural networks
    Wu, Yu
    Yi, Zhang
    KNOWLEDGE-BASED SYSTEMS, 2020, 200
  • [28] Algorithm Research Based on Multi-Feature Fusion of EEG Signals with Convolutional Neural Networks
    Song, Shilin
    Zhang, Xuejun
    Computer Engineering and Applications, 2024, 60 (08) : 148 - 155
  • [29] Classification of multi-feature fusion ultrasound images of breast tumor within category 4 using convolutional neural networks
    Xu, Pengfei
    Zhao, Jing
    Wan, Mingxi
    Song, Qing
    Su, Qiang
    Wang, Diya
    MEDICAL PHYSICS, 2024, 51 (06) : 4243 - 4257
  • [30] Classification of satellite cloud imagery based on multi-feature texture analysis and neural networks
    Christodoulou, CI
    Michaelides, SC
    Pattichis, CS
    Kyriakou, K
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2001, : 497 - 500