SparseDGCNN: Recognizing Emotion From Multichannel EEG Signals

被引:51
|
作者
Zhang, Guanhua [1 ]
Yu, Minjing [2 ]
Liu, Yong-Jin [1 ]
Zhao, Guozhen [3 ]
Zhang, Dan [4 ]
Zheng, Wenming [5 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, MOE Key Lab Pervas Comp, BNRist, Beijing 100084, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[3] CAS Key Lab Behav Sci, Inst Psychol, Beijing 100101, Peoples R China
[4] Tsinghua Univ, Dept Psychol, Beijing 100084, Peoples R China
[5] Southeast Univ, MOE Key Lab Child Dev & Learning Sci, Nanjing 211100, Peoples R China
关键词
Electroencephalography; Electrodes; Brain modeling; Emotion recognition; Feature extraction; Physiology; Convolution; multichannel EEG signals; graph convolutional neural network; sparse constraints; VERTEX-FREQUENCY ANALYSIS; AFFECTIVE NEUROSCIENCE; RECOGNITION; DATABASE; STIMULI; AROUSAL; MODEL;
D O I
10.1109/TAFFC.2021.3051332
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition from EEG signals has attracted much attention in affective computing. Recently, a novel dynamic graph convolutional neural network (DGCNN) model was proposed, which simultaneously optimized the network parameters and a weighted graph G characterizing the strength of functional relation between each pair of two electrodes in the EEG recording equipment. In this article, we propose a sparse DGCNN model which modifies DGCNN by imposing a sparseness constraint on G and improves the emotion recognition performance. Our work is based on an important observation: the tomography study reveals that different brain regions sampled by EEG electrodes may be related to different functions of the brain and then the functional relations among electrodes are possibly highly localized and sparse. However, introducing sparseness constraint into the graph G makes the loss function of sparse DGCNN non-differentiable at some singular points. To ensure that the training process of sparse DGCNN converges, we apply the forward-backward splitting method. To evaluate the performance of sparse DGCNN, we compare it with four representative recognition methods (SVM, DBN, GELM and DGCNN). In addition to comparing different recognition methods, our experiments also compare different features and spectral bands, including EEG features in time-frequency domain (DE, PSD, DASM, RASM, ASM and DCAU on different bands) extracted from four representative EEG datasets (SEED, DEAP, DREAMER, and CMEED). The results show that (1) sparse DGCNN has consistently better accuracy than representative methods and has a good scalability, and (2) DE, PSD, and ASM features on ? band convey most discriminative emotional information, and fusion of separate features and frequency bands can improve recognition performance.
引用
收藏
页码:537 / 548
页数:12
相关论文
共 50 条
  • [41] An effective optimized deep learning for emotion classification from EEG signals
    Sittiahgari Lokesh
    Tadipathri Sreenivasulu Reddy
    [J]. Signal, Image and Video Processing, 2023, 17 : 1631 - 1642
  • [42] Emotion Recognition from EEG Signals through One Electrode Device
    Sarikaya, Mehmet Ali
    Ince, Gokhan
    [J]. 2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [43] Emotion recognition from EEG signals using machine learning model
    Akshay, K. R.
    Sundar, Sumod
    Shanir, Muhammed P. P.
    [J]. 2022 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA, SIGNAL PROCESSING AND COMMUNICATION TECHNOLOGIES (IMPACT), 2022,
  • [44] Human Emotion Classification from EEG Signals using Multiwavelet Transform
    Bajaj, Varun
    Pachori, Ram Bilas
    [J]. 2014 INTERNATIONAL CONFERENCE ON MEDICAL BIOMETRICS (ICMB 2014), 2014, : 125 - 130
  • [45] HYPERCOMPLEX MULTIMODAL EMOTION RECOGNITION FROM EEG AND PERIPHERAL PHYSIOLOGICAL SIGNALS
    Lopez, Eleonora
    Chiarantano, Eleonora
    Grassucci, Eleonora
    Comminiello, Danilo
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [46] Emotion Recognition of Playing Musicians From EEG, ECG, and Acoustic Signals
    Turchet, Luca
    O'Sullivan, Barry
    Ortner, Rupert
    Guger, Christoph
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2024, 54 (05) : 619 - 629
  • [47] Emotion Recognition from EEG Signals by Using Empirical Mode Decomposition
    Degirmenci, Murside
    Ozdemir, Mehmet Akif
    Sadighzadeh, Reza
    Akan, Aydin
    [J]. 2018 MEDICAL TECHNOLOGIES NATIONAL CONGRESS (TIPTEKNO), 2018,
  • [48] Multichannel feature selection using information maximization with application to multichannel EEG signals
    Mohamed Deriche
    [J]. Journal of Communications Technology and Electronics, 2011, 56 : 838 - 846
  • [49] Multichannel Feature Selection Using Information Maximization with Application to Multichannel EEG Signals
    Deriche, Mohamed
    [J]. JOURNAL OF COMMUNICATIONS TECHNOLOGY AND ELECTRONICS, 2011, 56 (07) : 838 - 846
  • [50] Comprehensive Analysis of Feature Extraction Methods for Emotion Recognition from Multichannel EEG Recordings
    Yuvaraj, Rajamanickam
    Thagavel, Prasanth
    Thomas, John
    Fogarty, Jack
    Ali, Farhan
    [J]. SENSORS, 2023, 23 (02)