SparseDGCNN: Recognizing Emotion From Multichannel EEG Signals

被引:51
|
作者
Zhang, Guanhua [1 ]
Yu, Minjing [2 ]
Liu, Yong-Jin [1 ]
Zhao, Guozhen [3 ]
Zhang, Dan [4 ]
Zheng, Wenming [5 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, MOE Key Lab Pervas Comp, BNRist, Beijing 100084, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] CAS Key Lab Behav Sci, Inst Psychol, Beijing 100101, Peoples R China
[4] Tsinghua Univ, Dept Psychol, Beijing 100084, Peoples R China
[5] Southeast Univ, MOE Key Lab Child Dev & Learning Sci, Nanjing 211100, Peoples R China
关键词
Electroencephalography; Electrodes; Brain modeling; Emotion recognition; Feature extraction; Physiology; Convolution; multichannel EEG signals; graph convolutional neural network; sparse constraints; VERTEX-FREQUENCY ANALYSIS; AFFECTIVE NEUROSCIENCE; RECOGNITION; DATABASE; STIMULI; AROUSAL; MODEL;
D O I
10.1109/TAFFC.2021.3051332
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition from EEG signals has attracted much attention in affective computing. Recently, a novel dynamic graph convolutional neural network (DGCNN) model was proposed, which simultaneously optimized the network parameters and a weighted graph G characterizing the strength of functional relation between each pair of two electrodes in the EEG recording equipment. In this article, we propose a sparse DGCNN model which modifies DGCNN by imposing a sparseness constraint on G and improves the emotion recognition performance. Our work is based on an important observation: the tomography study reveals that different brain regions sampled by EEG electrodes may be related to different functions of the brain and then the functional relations among electrodes are possibly highly localized and sparse. However, introducing sparseness constraint into the graph G makes the loss function of sparse DGCNN non-differentiable at some singular points. To ensure that the training process of sparse DGCNN converges, we apply the forward-backward splitting method. To evaluate the performance of sparse DGCNN, we compare it with four representative recognition methods (SVM, DBN, GELM and DGCNN). In addition to comparing different recognition methods, our experiments also compare different features and spectral bands, including EEG features in time-frequency domain (DE, PSD, DASM, RASM, ASM and DCAU on different bands) extracted from four representative EEG datasets (SEED, DEAP, DREAMER, and CMEED). The results show that (1) sparse DGCNN has consistently better accuracy than representative methods and has a good scalability, and (2) DE, PSD, and ASM features on ? band convey most discriminative emotional information, and fusion of separate features and frequency bands can improve recognition performance.
引用
收藏
页码:537 / 548
页数:12
相关论文
共 50 条
  • [21] Emotion Estimation from EEG Signals and Expected Subjective Evaluation
    Miyamoto, Kana
    Tanaka, Hiroki
    Nakamura, Satoshi
    [J]. 2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 68 - 73
  • [22] Enhancing Text Using Emotion Detected from EEG Signals
    Gupta, Akash
    Sahu, Harsh
    Nanecha, Nihal
    Kumar, Pradeep
    Roy, Partha Pratim
    Chang, Victor
    [J]. JOURNAL OF GRID COMPUTING, 2019, 17 (02) : 325 - 340
  • [23] Multimodal Emotion Recognition From EEG Signals and Facial Expressions
    Wang, Shuai
    Qu, Jingzi
    Zhang, Yong
    Zhang, Yidie
    [J]. IEEE ACCESS, 2023, 11 : 33061 - 33068
  • [24] A Comparative Analysis of Emotion Recognition from Stimulated EEG Signals
    Singh, Garima
    Jati, Arindam
    Khasnobish, Anwesha
    Bhattacharyya, Saugat
    Konar, Amit
    Tibarewala, D. N.
    Janarthanan, R.
    [J]. PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON SOFT COMPUTING FOR PROBLEM SOLVING (SOCPROS 2012), 2014, 236 : 1109 - 1115
  • [25] Emotion Recognition from Multiband EEG Signals Using CapsNet
    Chao, Hao
    Dong, Liang
    Liu, Yongli
    Lu, Baoyun
    [J]. SENSORS, 2019, 19 (09)
  • [26] Emotion Recognition from EEG Signals by Leveraging Stimulus Videos
    Gao, Zhen
    Wang, Shangfei
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2015, PT II, 2015, 9315 : 118 - 127
  • [27] Reservoir computing for emotion valence discrimination from EEG signals
    Bozhkov, Lachezar
    Koprinkova-Hristova, Petia
    Georgieva, Petia
    [J]. NEUROCOMPUTING, 2017, 231 : 28 - 40
  • [28] Separation between real and imaginary movements from multichannel EEG signals
    Grishina, Daria S.
    Pavlova, Olga N.
    Mohammad, Yasir Kh.
    Runnova, Anastasiya E.
    Pavlov, Alexey N.
    Hramov, Alexander E.
    [J]. SARATOV FALL MEETING 2018: COMPUTATIONS AND DATA ANALYSIS: FROM NANOSCALE TOOLS TO BRAIN FUNCTIONS, 2019, 11067
  • [29] Emotion Recognition by Analysis of EEG Signals
    Blaiech, Hayfa
    Neji, Mohamed
    Wali, Ali
    Alimi, Adel M.
    [J]. 2013 13TH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS (HIS), 2013, : 312 - 318
  • [30] Emotion Classification Using EEG Signals
    Dabas, Harsh
    Sethi, Chaitanya
    Dua, Chirag
    Dalawat, Mohit
    Sethia, Divyashikha
    [J]. PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 380 - 384