SparseDGCNN: Recognizing Emotion From Multichannel EEG Signals

被引:51
|
作者
Zhang, Guanhua [1 ]
Yu, Minjing [2 ]
Liu, Yong-Jin [1 ]
Zhao, Guozhen [3 ]
Zhang, Dan [4 ]
Zheng, Wenming [5 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, MOE Key Lab Pervas Comp, BNRist, Beijing 100084, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] CAS Key Lab Behav Sci, Inst Psychol, Beijing 100101, Peoples R China
[4] Tsinghua Univ, Dept Psychol, Beijing 100084, Peoples R China
[5] Southeast Univ, MOE Key Lab Child Dev & Learning Sci, Nanjing 211100, Peoples R China
关键词
Electroencephalography; Electrodes; Brain modeling; Emotion recognition; Feature extraction; Physiology; Convolution; multichannel EEG signals; graph convolutional neural network; sparse constraints; VERTEX-FREQUENCY ANALYSIS; AFFECTIVE NEUROSCIENCE; RECOGNITION; DATABASE; STIMULI; AROUSAL; MODEL;
D O I
10.1109/TAFFC.2021.3051332
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition from EEG signals has attracted much attention in affective computing. Recently, a novel dynamic graph convolutional neural network (DGCNN) model was proposed, which simultaneously optimized the network parameters and a weighted graph G characterizing the strength of functional relation between each pair of two electrodes in the EEG recording equipment. In this article, we propose a sparse DGCNN model which modifies DGCNN by imposing a sparseness constraint on G and improves the emotion recognition performance. Our work is based on an important observation: the tomography study reveals that different brain regions sampled by EEG electrodes may be related to different functions of the brain and then the functional relations among electrodes are possibly highly localized and sparse. However, introducing sparseness constraint into the graph G makes the loss function of sparse DGCNN non-differentiable at some singular points. To ensure that the training process of sparse DGCNN converges, we apply the forward-backward splitting method. To evaluate the performance of sparse DGCNN, we compare it with four representative recognition methods (SVM, DBN, GELM and DGCNN). In addition to comparing different recognition methods, our experiments also compare different features and spectral bands, including EEG features in time-frequency domain (DE, PSD, DASM, RASM, ASM and DCAU on different bands) extracted from four representative EEG datasets (SEED, DEAP, DREAMER, and CMEED). The results show that (1) sparse DGCNN has consistently better accuracy than representative methods and has a good scalability, and (2) DE, PSD, and ASM features on ? band convey most discriminative emotional information, and fusion of separate features and frequency bands can improve recognition performance.
引用
收藏
页码:537 / 548
页数:12
相关论文
共 50 条
  • [1] An Efficient LSTM Network for Emotion Recognition From Multichannel EEG Signals
    Du, Xiaobing
    Ma, Cuixia
    Zhang, Guanhua
    Li, Jinyao
    Lai, Yu-Kun
    Zhao, Guozhen
    Deng, Xiaoming
    Liu, Yong-Jin
    Wang, Hongan
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (03) : 1528 - 1540
  • [2] An Automated Framework for Human Emotion Detection From Multichannel EEG Signals
    Nalwaya, Aditya
    Das, Kritiprasanna
    Pachori, Ram Bilas
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (13) : 20920 - 20927
  • [3] A Comprehensive Interaction in Multiscale Multichannel EEG Signals for Emotion Recognition
    Guo, Yiquan
    Zhang, Bowen
    Fan, Xiaomao
    Shen, Xiaole
    Peng, Xiaojiang
    [J]. MATHEMATICS, 2024, 12 (08)
  • [4] Emotion recognition from multichannel EEG signals using K-nearest neighbor classification
    Li, Mi
    Xu, Hongpei
    Liu, Xingwang
    Lu, Shengfu
    [J]. TECHNOLOGY AND HEALTH CARE, 2018, 26 : S509 - S519
  • [5] A Feature-Fused Convolutional Neural Network for Emotion Recognition From Multichannel EEG Signals
    Yao, Qunli
    Gu, Heng
    Wang, Shaodi
    Li, Xiaoli
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (12) : 11954 - 11964
  • [6] Emotion Classification from EEG Signals
    Ralekar, Chetan
    Roy, Soumava Kumar
    Gandhi, Tapan K.
    [J]. PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 2543 - 2546
  • [7] Bi-hemisphere asymmetric attention network: recognizing emotion from EEG signals based on the transformer
    Xinyue Zhong
    Yun Gu
    Yutong Luo
    Xiaomei Zeng
    Guangyuan Liu
    [J]. Applied Intelligence, 2023, 53 : 15278 - 15294
  • [8] Bi-hemisphere asymmetric attention network: recognizing emotion from EEG signals based on the transformer
    Zhong, Xinyue
    Gu, Yun
    Luo, Yutong
    Zeng, Xiaomei
    Liu, Guangyuan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (12) : 15278 - 15294
  • [9] Entropy-Based Emotion Recognition from Multichannel EEG Signals Using Artificial Neural Network
    Aung, Si Thu
    Hassan, Mehedi
    Brady, Mark
    Mannan, Zubaer Ibna
    Azam, Sami
    Karim, Asif
    Zaman, Sadika
    Wongsawat, Yodchanan
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [10] Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals
    Chao, Hao
    Dong, Liang
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (02) : 2024 - 2034