Adaptive Dual-Space Network With Multigraph Fusion for EEG-Based Emotion Recognition

被引:1
|
作者
Ye, Mengqing [1 ,2 ]
Chen, C. L. Philip [1 ,2 ]
Zheng, Wenming [3 ,4 ]
Zhang, Tong [1 ,2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510335, Peoples R China
[3] Southeast Univ, Minist Educ, Key Lab Child Dev & Learning Sci, Nanjing 210096, Peoples R China
[4] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
来源
关键词
Electroencephalography; Emotion recognition; Brain modeling; Brain; Feature extraction; Convolutional neural networks; Adaptation models; Attention mechanism; electroencephalogram (EEG)-based emotion recognition; graph convolutional network; graph fusion; CONVOLUTIONAL NEURAL-NETWORKS; GRAPH;
D O I
10.1109/TCSS.2024.3386621
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Most of the work on electroencephalogram (EEG)-based emotion recognition aims to extract the distinguishing features from high-dimensional EEG signals, ignoring the complementarity of information between EEG latent space and graph space. Furthermore, the influence of brain connectivity on emotions encompasses both physical structure and functional connectivity, which may have varying degrees of importance for different individuals. To address these issues, this article introduces an adaptive dual-space network (ADS-Net) with multigraph fusion aimed at capturing more comprehensive information by integrating dual-space representations. Specifically, ADS-Net models the spatial correlation of EEG channels in graph topological space, while exploring long-range dependencies and frequency relationships from EEG data in latent space. Subsequently, these representations are adaptively combined through an innovative gated fusion approach to extract complementary corepresentations. Moreover, drawing on the principles of brain connectivity theory, the proposed method constructs a multigraph to indicate the associativity of EEG channels. To further capture individual differences, an adaptive multigraph fusion mechanism is developed for the dynamic integration of physical and functional connectivity graphs. When compared to state-of-the-art methods, the superior experimental results underscore the effectiveness and broad applicability of the proposed method.
引用
收藏
页码:5763 / 5774
页数:12
相关论文
共 50 条
  • [21] Fractal Spiking Neural Network Scheme for EEG-Based Emotion Recognition
    Li, Wei
    Fang, Cheng
    Zhu, Zhihao
    Chen, Chuyi
    Song, Aiguo
    IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2024, 12 : 106 - 118
  • [22] An Efficient Approach to EEG-Based Emotion Recognition using LSTM Network
    Anubhav
    Nath, Debarshi
    Singh, Mrigank
    Sethia, Divyashikha
    Kalra, Diksha
    Indu, S.
    2020 16TH IEEE INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2020), 2020, : 88 - 92
  • [23] EEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork Nodes
    Yang, Yimin
    Wu, Q. M. Jonathan
    Zheng, Wei-Long
    Lu, Bao-Liang
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2018, 10 (02) : 408 - 419
  • [24] ASTDF-Net: Attention-Based Spatial-Temporal Dual-Stream Fusion Network for EEG-Based Emotion Recognition
    Gong, Peiliang
    Jia, Ziyu
    Wang, Pengpai
    Zhou, Yueying
    Zhang, Daoqiang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 883 - 892
  • [25] Graph Convolutional Network With Connectivity Uncertainty for EEG-Based Emotion Recognition
    Gao, Hongxiang
    Wang, Xingyao
    Chen, Zhenghua
    Wu, Min
    Cai, Zhipeng
    Zhao, Lulu
    Li, Jianqing
    Liu, Chengyu
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (10) : 5917 - 5928
  • [26] Fusion of EEG-Based Activation, Spatial, and Connection Patterns for Fear Emotion Recognition
    Pan, Jiahui
    Yang, Fuzhou
    Qiu, Lina
    Huang, Haiyun
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [27] A Semi-automatic Feature Fusion Model for EEG-based Emotion Recognition
    Zhang, Gaotian
    Li, Shiqian
    Wang, Jiabao
    Zhou, Yun
    Xu, Tao
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [28] EEG-based Emotion Recognition of Quran Listeners
    Fattouh, Anas
    Albidewi, Ibrahim
    Baterfi, Bader
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 1338 - 1342
  • [29] EEG-Based Emotion Recognition in Music Listening
    Lin, Yuan-Pin
    Wang, Chi-Hong
    Jung, Tzyy-Ping
    Wu, Tien-Lin
    Jeng, Shyh-Kang
    Duann, Jeng-Ren
    Chen, Jyh-Horng
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (07) : 1798 - 1806
  • [30] EEG-Based BCI Emotion Recognition: A Survey
    Torres, Edgar P.
    Torres, Edgar A.
    Hernandez-Alvarez, Myriam
    Yoo, Sang Guun
    SENSORS, 2020, 20 (18) : 1 - 36