Adaptive Dual-Space Network With Multigraph Fusion for EEG-Based Emotion Recognition

被引:1
|
作者
Ye, Mengqing [1 ,2 ]
Chen, C. L. Philip [1 ,2 ]
Zheng, Wenming [3 ,4 ]
Zhang, Tong [1 ,2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510335, Peoples R China
[3] Southeast Univ, Minist Educ, Key Lab Child Dev & Learning Sci, Nanjing 210096, Peoples R China
[4] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
来源
关键词
Electroencephalography; Emotion recognition; Brain modeling; Brain; Feature extraction; Convolutional neural networks; Adaptation models; Attention mechanism; electroencephalogram (EEG)-based emotion recognition; graph convolutional network; graph fusion; CONVOLUTIONAL NEURAL-NETWORKS; GRAPH;
D O I
10.1109/TCSS.2024.3386621
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Most of the work on electroencephalogram (EEG)-based emotion recognition aims to extract the distinguishing features from high-dimensional EEG signals, ignoring the complementarity of information between EEG latent space and graph space. Furthermore, the influence of brain connectivity on emotions encompasses both physical structure and functional connectivity, which may have varying degrees of importance for different individuals. To address these issues, this article introduces an adaptive dual-space network (ADS-Net) with multigraph fusion aimed at capturing more comprehensive information by integrating dual-space representations. Specifically, ADS-Net models the spatial correlation of EEG channels in graph topological space, while exploring long-range dependencies and frequency relationships from EEG data in latent space. Subsequently, these representations are adaptively combined through an innovative gated fusion approach to extract complementary corepresentations. Moreover, drawing on the principles of brain connectivity theory, the proposed method constructs a multigraph to indicate the associativity of EEG channels. To further capture individual differences, an adaptive multigraph fusion mechanism is developed for the dynamic integration of physical and functional connectivity graphs. When compared to state-of-the-art methods, the superior experimental results underscore the effectiveness and broad applicability of the proposed method.
引用
收藏
页码:5763 / 5774
页数:12
相关论文
共 50 条
  • [31] Familiarity effects in EEG-based emotion recognition
    Thammasan N.
    Moriyama K.
    Fukui K.-I.
    Numao M.
    Brain Informatics, 2017, 4 (1) : 39 - 50
  • [32] Efficient approach for EEG-based emotion recognition
    Senguer, D.
    Siuly, S.
    ELECTRONICS LETTERS, 2020, 56 (25) : 1361 - 1364
  • [33] EEG-based Emotion Recognition in the Investment Activities
    Razi, Nurul Izzati Mat
    Othman, Marini
    Yaacob, Hamwira
    2016 6TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY FOR THE MUSLIM WORLD (ICT4M), 2016, : 325 - 329
  • [34] EEG-based Emotion-adaptive Advertising
    Liu, Yisi
    Sourina, Olga
    Hafiyyandi, Mohammad Rizqi
    2013 HUMAINE ASSOCIATION CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2013, : 843 - 848
  • [35] A Novel Dual-Task Model for EEG-Based Emotion and Cognition Recognition
    Jia, Zhe
    Ouyang, Yu
    Kong, Xinni
    Guo, Yaru
    Li, Zhongzheng
    Zeng, Hong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [36] Adaptive construction of critical brain functional networks for EEG-based emotion recognition
    Zhao, Ying
    He, Hong
    Bi, Xiaoying
    Lu, Yue
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (06)
  • [37] EESCN: A novel spiking neural network method for EEG-based emotion recognition
    Xu, Feifan
    Pan, Deng
    Zheng, Haohao
    Ouyang, Yu
    Jia, Zhe
    Zeng, Hong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 243
  • [38] EEG-Based Emotion Recognition by Using Convolutional Echo-State Network
    Chao H.
    Ma Q.
    Liu Y.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2022, 45 (02): : 36 - 43
  • [39] Nuclear Norm Regularized Deep Neural Network for EEG-Based Emotion Recognition
    Liang, Shuang
    Yin, Mingbo
    Huang, Yecheng
    Dai, Xiubin
    Wang, Qiong
    FRONTIERS IN PSYCHOLOGY, 2022, 13
  • [40] Hierarchical Dynamic Graph Convolutional Network With Interpretability for EEG-Based Emotion Recognition
    Ye, Mengqing
    Chen, C. L. Philip
    Zhang, Tong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, : 1 - 12