Adaptive Dual-Space Network With Multigraph Fusion for EEG-Based Emotion Recognition

被引:1
|
作者
Ye, Mengqing [1 ,2 ]
Chen, C. L. Philip [1 ,2 ]
Zheng, Wenming [3 ,4 ]
Zhang, Tong [1 ,2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510335, Peoples R China
[3] Southeast Univ, Minist Educ, Key Lab Child Dev & Learning Sci, Nanjing 210096, Peoples R China
[4] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
来源
关键词
Electroencephalography; Emotion recognition; Brain modeling; Brain; Feature extraction; Convolutional neural networks; Adaptation models; Attention mechanism; electroencephalogram (EEG)-based emotion recognition; graph convolutional network; graph fusion; CONVOLUTIONAL NEURAL-NETWORKS; GRAPH;
D O I
10.1109/TCSS.2024.3386621
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Most of the work on electroencephalogram (EEG)-based emotion recognition aims to extract the distinguishing features from high-dimensional EEG signals, ignoring the complementarity of information between EEG latent space and graph space. Furthermore, the influence of brain connectivity on emotions encompasses both physical structure and functional connectivity, which may have varying degrees of importance for different individuals. To address these issues, this article introduces an adaptive dual-space network (ADS-Net) with multigraph fusion aimed at capturing more comprehensive information by integrating dual-space representations. Specifically, ADS-Net models the spatial correlation of EEG channels in graph topological space, while exploring long-range dependencies and frequency relationships from EEG data in latent space. Subsequently, these representations are adaptively combined through an innovative gated fusion approach to extract complementary corepresentations. Moreover, drawing on the principles of brain connectivity theory, the proposed method constructs a multigraph to indicate the associativity of EEG channels. To further capture individual differences, an adaptive multigraph fusion mechanism is developed for the dynamic integration of physical and functional connectivity graphs. When compared to state-of-the-art methods, the superior experimental results underscore the effectiveness and broad applicability of the proposed method.
引用
收藏
页码:5763 / 5774
页数:12
相关论文
共 50 条
  • [41] Bi-CapsNet: A Binary Capsule Network for EEG-Based Emotion Recognition
    Liu, Yu
    Wei, Yi
    Li, Chang
    Cheng, Juan
    Song, Rencheng
    Chen, Xun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (03) : 1319 - 1330
  • [42] EEG-based emotion recognition via improved evolutionary convolutional neural network
    Guo, Lexiang
    Li, Nan
    Zhang, Tian
    INTERNATIONAL JOURNAL OF BIO-INSPIRED COMPUTATION, 2024, 23 (04) : 203 - 213
  • [43] A Transformer Convolutional Network With the Method of Image Segmentation for EEG-Based Emotion Recognition
    Zhang, Xinyiy
    Cheng, Xiankai
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 401 - 405
  • [44] TC-Net: A Transformer Capsule Network for EEG-based emotion recognition
    Wei, Yi
    Liu, Yu
    Li, Chang
    Cheng, Juan
    Song, Rencheng
    Chen, Xun
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 152
  • [45] Optimized Echo State Network with Intrinsic Plasticity for EEG-Based Emotion Recognition
    Fourati, Rahma
    Ammar, Boudour
    Aouiti, Chaouki
    Sanchez-Medina, Javier
    Alimi, Adel M.
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 718 - 727
  • [46] A Channel-Fused Dense Convolutional Network for EEG-Based Emotion Recognition
    Gao, Zhongke
    Wang, Xinmin
    Yang, Yuxuan
    Li, Yanli
    Ma, Kai
    Chen, Guanrong
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2021, 13 (04) : 945 - 954
  • [47] Hybrid Unsupervised Handcrafted and Deep Feature Characterization and Fusion for EEG-Based Emotion Recognition
    Liang, Zhen
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2021, 168 : S55 - S55
  • [48] EEG-based emotion recognition with autoencoder feature fusion and MSC-TimesNet model
    Yin, Jibin
    Qiao, Zhijian
    Han, Luyao
    Zhang, Xiangliang
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2025,
  • [49] Real-Time EEG-Based Emotion Recognition
    Yu, Xiangkun
    Li, Zhengjie
    Zang, Zhibang
    Liu, Yinhua
    SENSORS, 2023, 23 (18)
  • [50] Deep Learning for EEG-based Emotion Recognition: A Survey
    Li J.-Y.
    Du X.-B.
    Zhu Z.-L.
    Deng X.-M.
    Ma C.-X.
    Wang H.-A.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01): : 255 - 276