EESCN: A novel spiking neural network method for EEG-based emotion recognition

被引:10
|
作者
Xu, Feifan [1 ]
Pan, Deng [1 ]
Zheng, Haohao [1 ]
Ouyang, Yu [1 ]
Jia, Zhe [1 ]
Zeng, Hong [1 ,2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
[2] Key Lab Brain Machine Collaborat Zhejiang Prov, Hangzhou, Zhejiang, Peoples R China
基金
美国国家科学基金会;
关键词
Convolutional neural network (CNN); EEG emotion recognition; Neuromorphic; Recurrent neural network (RNN); Spiking neural network (SNN); CLASSIFICATION; OPTIMIZATION;
D O I
10.1016/j.cmpb.2023.107927
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Although existing artificial neural networks have achieved good results in electroencephalograph (EEG) emotion recognition, further improvements are needed in terms of bio-interpretability and robustness. In this research, we aim to develop a highly efficient and high-performance method for emotion recognition based on EEG.Methods: We propose an Emo-EEGSpikeConvNet (EESCN), a novel emotion recognition method based on spiking neural network (SNN). It consists of a neuromorphic data generation module and a NeuroSpiking framework. The neuromorphic data generation module converts EEG data into 2D frame format as input to the NeuroSpiking framework, while the NeuroSpiking framework is used to extract spatio-temporal features of EEG for classification.Results: EESCN achieves high emotion recognition accuracies on DEAP and SEED-IV datasets, ranging from 94.56% to 94.81% on DEAP and a mean accuracy of 79.65% on SEED-IV. Compared to existing SNN methods, EESCN significantly improves EEG emotion recognition performance. In addition, it also has the advantages of faster running speed and less memory footprint.Conclusions: EESCN has shown excellent performance and efficiency in EEG-based emotion recognition with potential for practical applications requiring portability and resource constraints.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] SSTD: A Novel Spatio-Temporal Demographic Network for EEG-Based Emotion Recognition
    Li, Rui
    Ren, Chao
    Li, Chen
    Zhao, Nan
    Lu, Dawei
    Zhang, Xiaowei
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (01) : 376 - 387
  • [32] PNN for EEG-based Emotion Recognition
    Zhang, Jianhai
    Chen, Ming
    Hu, Sanqing
    Cao, Yu
    2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 2319 - 2323
  • [33] EEG-based Emotion Word Recognition
    Dong, Weiwei
    Wang, Panpan
    Zhang, Yazhou
    Wang, Tianshu
    Niu, Jiabin
    Zhang, Shengnan
    PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON ADVANCED CONTROL, AUTOMATION AND ARTIFICIAL INTELLIGENCE (ACAAI 2018), 2018, 155 : 121 - 124
  • [34] EEG-Based Emotion Classification Using Convolutional Neural Network
    Mei, Han
    Xu, Xiangmin
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 130 - 135
  • [35] Continuous Convolutional Neural Network with 3D Input for EEG-Based Emotion Recognition
    Yang, Yilong
    Wu, Qingfeng
    Fu, Yazhen
    Chen, Xiaowei
    NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VII, 2018, 11307 : 433 - 443
  • [36] A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation
    Gilakjani, Sareh Soleimani
    Al Osman, Hussein
    IEEE ACCESS, 2024, 12 : 113 - 130
  • [37] EEG-based emotion recognition using 4D convolutional recurrent neural network
    Shen, Fangyao
    Dai, Guojun
    Lin, Guang
    Zhang, Jianhai
    Kong, Wanzeng
    Zeng, Hong
    COGNITIVE NEURODYNAMICS, 2020, 14 (06) : 815 - 828
  • [38] Parallel Sequence-Channel Projection Convolutional Neural Network for EEG-Based Emotion Recognition
    Shen, Lili
    Zhao, Wei
    Shi, Yanan
    Qin, Tianyi
    Liu, Bingzheng
    IEEE ACCESS, 2020, 8 : 222966 - 222976
  • [39] EEG-based Emotion Recognition Under Convolutional Neural Network with Differential Entropy Feature Maps
    Li, Yifan
    Wong, Chi Man
    Zheng, Yudian
    Wan, Feng
    Mak, Peng Un
    Pun, Sio Hang
    Vai, Mang, I
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA 2019), 2019, : 6 - 10
  • [40] EEG-based emotion recognition using 4D convolutional recurrent neural network
    Fangyao Shen
    Guojun Dai
    Guang Lin
    Jianhai Zhang
    Wanzeng Kong
    Hong Zeng
    Cognitive Neurodynamics, 2020, 14 : 815 - 828