Enhancing Motor Imagery Classification with Residual Graph Convolutional Networks and Multi-Feature Fusion

被引:0
|
作者
Xu, Fangzhou [1 ]
Shi, Weiyou [1 ]
Lv, Chengyan [1 ]
Sun, Yuan [1 ]
Guo, Shuai [2 ]
Feng, Chao [1 ]
Zhang, Yang [3 ]
Jung, Tzyy-Ping [4 ]
Leng, Jiancai [1 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Int Sch Optoelect Engn, Jinan 250353, Peoples R China
[2] Shandong Univ, Qilu Hosp, Rehabil Ctr, Jinan 250012, Peoples R China
[3] Shandong Univ Tradit Chinese Med, Affiliated Hosp, Rehabil & Phys Therapy Dept, Jinan 250011, Peoples R China
[4] Univ Calif San Diego, Inst Neural Computat, Swartz Ctr Computat Neurosci, La Jolla, CA USA
基金
中国国家自然科学基金;
关键词
Brain network; modified residual graph convolutional network; modified <italic>S</italic>-transform; self-attention mechanism; stroke; BRAIN-COMPUTER-INTERFACE; SPECTRUM; STROKE;
D O I
10.1142/S0129065724500692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stroke, an abrupt cerebrovascular ailment resulting in brain tissue damage, has prompted the adoption of motor imagery (MI)-based brain-computer interface (BCI) systems in stroke rehabilitation. However, analyzing electroencephalogram (EEG) signals from stroke patients poses challenges. To address the issues of low accuracy and efficiency in EEG classification, particularly involving MI, the study proposes a residual graph convolutional network (M-ResGCN) framework based on the modified S-transform (MST), and introduces the self-attention mechanism into residual graph convolutional network (ResGCN). This study uses MST to extract EEG time-frequency domain features, derives spatial EEG features by calculating the absolute Pearson correlation coefficient (aPcc) between channels, and devises a method to construct the adjacency matrix of the brain network using aPcc to measure the strength of the connection between channels. Experimental results involving 16 stroke patients and 16 healthy subjects demonstrate significant improvements in classification quality and robustness across tests and subjects. The highest classification accuracy reached 94.91% and a Kappa coefficient of 0.8918. The average accuracy and F1 scores from 10 times 10-fold cross-validation are 94.38% and 94.36%, respectively. By validating the feasibility and applicability of brain networks constructed using the aPcc in EEG signal analysis and feature encoding, it was established that the aPcc effectively reflects overall brain activity. The proposed method presents a novel approach to exploring channel relationships in MI-EEG and improving classification performance. It holds promise for real-time applications in MI-based BCI systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] A multi-feature fusion decoding study for unilateral upper-limb fine motor imagery
    Yang, Liangyu
    Shi, Tianyu
    Lv, Jidong
    Liu, Yan
    Dai, Yakang
    Zou, Ling
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 2482 - 2500
  • [32] Electroencephalogram-Based Motor Imagery Classification Using Deep Residual Convolutional Networks
    Huang, Jing-Shan
    Liu, Wan-Shan
    Yao, Bin
    Wang, Zhan-Xiang
    Chen, Si-Fang
    Sun, Wei-Fang
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [33] Multi-Feature Fusion for Enhancing Image Similarity Learning
    Lu, Jian
    Ma, Cheng-Xian
    Zhou, Yan-Ran
    Luo, Mao-Xin
    Zhang, Kai-Bing
    IEEE ACCESS, 2019, 7 : 167547 - 167556
  • [34] Analysis and intention recognition of motor imagery EEG signals based on multi-feature convolutional neural network
    He Q.
    Shao D.
    Wang Y.
    Zhang Y.
    Xie P.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2020, 41 (01): : 138 - 146
  • [35] Crops Fine Classification in Airborne Hyperspectral Imagery Based on Multi-Feature Fusion and Deep Learning
    Wei, Lifei
    Wang, Kun
    Lu, Qikai
    Liang, Yajing
    Li, Haibo
    Wang, Zhengxiang
    Wang, Run
    Cao, Liqin
    REMOTE SENSING, 2021, 13 (15)
  • [36] Enhancing Fake News Detection by Multi-Feature Classification
    Almarashy, Ahmed Hashim Jawad
    Feizi-Derakhshi, Mohammad-Reza
    Salehpour, Pedram
    IEEE ACCESS, 2023, 11 : 139601 - 139613
  • [37] Adaptive Multi-Feature Fusion for Underwater Diver Classification
    Yang Juan
    Xu Feng
    Wei Zhiheng
    An Xudong
    Liu Jia
    Ji Yongqiang
    Wen Tao
    2013 IEEE/OES ACOUSTICS IN UNDERWATER GEOSCIENCES SYMPOSIUM (RIO ACOUSTICS 2013), 2013,
  • [38] Image Multi-Feature Fusion for Clothing Style Classification
    Zhang, Yanrong
    He, Kemin
    Song, Rong
    IEEE ACCESS, 2023, 11 : 107843 - 107854
  • [39] Hyperspectral image classification using multi-feature fusion
    Li, Fang
    Wang, Jie
    Lan, Rushi
    Liu, Zhenbing
    Luo, Xiaonan
    OPTICS AND LASER TECHNOLOGY, 2019, 110 : 176 - 183
  • [40] Classification of Marine Vessels with Multi-Feature Structure Fusion
    Zhang, Erhu
    Wang, Kelu
    Lin, Guangfeng
    APPLIED SCIENCES-BASEL, 2019, 9 (10):