EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks

被引:706
|
作者
Song, Tengfei [1 ,2 ]
Zheng, Wenming [1 ,2 ]
Song, Peng [3 ]
Cui, Zhen [4 ]
机构
[1] Southeast Univ, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 210096, Peoples R China
[2] Southeast Univ, Sch Informat Sci & Engn, Nanjing 210096, Peoples R China
[3] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Emotion recognition; Brain modeling; Feature extraction; Convolutional neural networks; Convolution; Biological neural networks; EEG emotion recognition; adjacency matrix; graph convolutional neural networks (GCNN); dynamical convolutional neural networks (DGCNN); EXPRESSION;
D O I
10.1109/TAFFC.2018.2817622
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a multichannel EEG emotion recognition method based on a novel dynamical graph convolutional neural networks (DGCNN) is proposed. The basic idea of the proposed EEG emotion recognition method is to use a graph to model the multichannel EEG features and then perform EEG emotion classification based on this model. Different from the traditional graph convolutional neural networks (GCNN) methods, the proposed DGCNN method can dynamically learn the intrinsic relationship between different electroencephalogram (EEG) channels, represented by an adjacency matrix, via training a neural network so as to benefit for more discriminative EEG feature extraction. Then, the learned adjacency matrix is used to learn more discriminative features for improving the EEG emotion recognition. We conduct extensive experiments on the SJTU emotion EEG dataset (SEED) and DREAMER dataset. The experimental results demonstrate that the proposed method achieves better recognition performance than the state-of-the-art methods, in which the average recognition accuracy of 90.4 percent is achieved for subject dependent experiment while 79.95 percent for subject independent cross-validation one on the SEED database, and the average accuracies of 86.23, 84.54 and 85.02 percent are respectively obtained for valence, arousal and dominance classifications on the DREAMER database.
引用
收藏
页码:532 / 541
页数:10
相关论文
共 50 条
  • [41] Accurate emotion recognition using Bayesian model based EEG sources as dynamic graph convolutional neural network nodes
    Shiva Asadzadeh
    Tohid Yousefi Rezaii
    Soosan Beheshti
    Saeed Meshgini
    [J]. Scientific Reports, 12
  • [42] Synch-Graph: Multisensory Emotion Recognition Through Neural Synchrony via Graph Convolutional Networks
    Mansouri-Benssassi, Esma
    Ye, Juan
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1351 - 1358
  • [43] EEG emotion recognition using improved graph neural network with channel selection
    Lin, Xuefen
    Chen, Jielin
    Ma, Weifeng
    Tang, Wei
    Wang, Yuchen
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 231
  • [44] Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism
    Mountzouris, Konstantinos
    Perikos, Isidoros
    Hatzilygeroudis, Ioannis
    Corchado, Juan M.
    Iglesias, Carlos A.
    Kim, Byung-Gyu
    Mehmood, Rashid
    Ren, Fuji
    Lee, In
    [J]. ELECTRONICS, 2023, 12 (20)
  • [45] EEG based depression recognition using improved graph convolutional neural network
    Zhu, Jing
    Jiang, Changting
    Chen, Junhao
    Lin, Xiangbin
    Yu, Ruilan
    Li, Xiaowei
    Bin Hu
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [46] An interactive greeting system using convolutional neural networks for emotion recognition
    Lu, Ching-Ta
    Su, Chung-Wei
    Jiang, Hui-Ling
    Lu, Yen-Yu
    [J]. ENTERTAINMENT COMPUTING, 2022, 40
  • [47] Speech Emotion Recognition using Convolutional Recurrent Neural Networks and Spectrograms
    Qamhan, Mustafa A.
    Meftah, Ali H.
    Selouani, Sid-Ahmed
    Alotaibi, Yousef A.
    Zakariah, Mohammed
    Seddiq, Yasser Mohammad
    [J]. 2020 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2020,
  • [48] Speech Emotion Recognition using Convolution Neural Networks and Deep Stride Convolutional Neural Networks
    Wani, Taiba Majid
    Gunawan, Teddy Surya
    Qadri, Syed Asif Ahmad
    Mansor, Hasmah
    Kartiwi, Mira
    Ismail, Nanang
    [J]. PROCEEDING OF 2020 6TH INTERNATIONAL CONFERENCE ON WIRELESS AND TELEMATICS (ICWT), 2020,
  • [49] Emotion Recognition from EEG Signals Using Recurrent Neural Networks
    Chowdary, M. Kalpana
    Anitha, J.
    Hemanth, D. Jude
    [J]. ELECTRONICS, 2022, 11 (15)
  • [50] DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation
    Ghosal, Deepanway
    Majumder, Navonil
    Poria, Soujanya
    Chhaya, Niyati
    Gelbukh, Alexander
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 154 - 164