Adaptive Dual-Space Network With Multigraph Fusion for EEG-Based Emotion Recognition

被引:1
|
作者
Ye, Mengqing [1 ,2 ]
Chen, C. L. Philip [1 ,2 ]
Zheng, Wenming [3 ,4 ]
Zhang, Tong [1 ,2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510335, Peoples R China
[3] Southeast Univ, Minist Educ, Key Lab Child Dev & Learning Sci, Nanjing 210096, Peoples R China
[4] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
来源
关键词
Electroencephalography; Emotion recognition; Brain modeling; Brain; Feature extraction; Convolutional neural networks; Adaptation models; Attention mechanism; electroencephalogram (EEG)-based emotion recognition; graph convolutional network; graph fusion; CONVOLUTIONAL NEURAL-NETWORKS; GRAPH;
D O I
10.1109/TCSS.2024.3386621
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Most of the work on electroencephalogram (EEG)-based emotion recognition aims to extract the distinguishing features from high-dimensional EEG signals, ignoring the complementarity of information between EEG latent space and graph space. Furthermore, the influence of brain connectivity on emotions encompasses both physical structure and functional connectivity, which may have varying degrees of importance for different individuals. To address these issues, this article introduces an adaptive dual-space network (ADS-Net) with multigraph fusion aimed at capturing more comprehensive information by integrating dual-space representations. Specifically, ADS-Net models the spatial correlation of EEG channels in graph topological space, while exploring long-range dependencies and frequency relationships from EEG data in latent space. Subsequently, these representations are adaptively combined through an innovative gated fusion approach to extract complementary corepresentations. Moreover, drawing on the principles of brain connectivity theory, the proposed method constructs a multigraph to indicate the associativity of EEG channels. To further capture individual differences, an adaptive multigraph fusion mechanism is developed for the dynamic integration of physical and functional connectivity graphs. When compared to state-of-the-art methods, the superior experimental results underscore the effectiveness and broad applicability of the proposed method.
引用
收藏
页码:5763 / 5774
页数:12
相关论文
共 50 条
  • [1] DECISION FUSION FOR EEG-BASED EMOTION RECOGNITION
    Wang, Shuai
    Du, Jiachen
    Xu, Ruifeng
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 883 - 889
  • [2] EEG-based Emotion Recognition with Feature Fusion Networks
    Gao, Qiang
    Yang, Yi
    Kang, Qiaoju
    Tian, Zekun
    Song, Yu
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (02) : 421 - 429
  • [3] EEG-based Emotion Recognition with Feature Fusion Networks
    Qiang Gao
    Yi Yang
    Qiaoju Kang
    Zekun Tian
    Yu Song
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 421 - 429
  • [4] STAFNet: an adaptive multi-feature learning network via spatiotemporal fusion for EEG-based emotion recognition
    Hu, Fo
    He, Kailun
    Qian, Mengyuan
    Liu, Xiaofeng
    Qiao, Zukang
    Zhang, Lekai
    Xiong, Junlong
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [5] EEG-Based Emotion Recognition with Similarity Learning Network
    Wang, Yixin
    Qiu, Shuang
    Li, Jinpeng
    Ma, Xuelin
    Liang, Zhiyue
    Li, Hui
    He, Huiguang
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 1209 - 1212
  • [6] Spatial-Temporal Feature Fusion Neural Network for EEG-Based Emotion Recognition
    Wang, Zhe
    Wang, Yongxiong
    Zhang, Jiapeng
    Hu, Chuanfei
    Yin, Zhong
    Song, Yu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Spatial-Temporal Feature Fusion Neural Network for EEG-Based Emotion Recognition
    Wang, Zhe
    Wang, Yongxiong
    Zhang, Jiapeng
    Hu, Chuanfei
    Yin, Zhong
    Song, Yu
    IEEE Transactions on Instrumentation and Measurement, 2022, 71
  • [8] Research of EEG-based emotion recognition for the deaf with feature fusion
    Mao, Zemin
    Zhao, Xuewen
    Song, Yu
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2024, 45 (03) : 216 - 236
  • [9] A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition
    Li, Rui
    Wang, Yiting
    Lu, Bao-Liang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5565 - 5573
  • [10] A Domain Generative Graph Network for EEG-Based Emotion Recognition
    Gu, Yun
    Zhong, Xinyue
    Qu, Cheng
    Liu, Chuanjun
    Chen, Bin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (05) : 2377 - 2386