Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Multisource Transfer Learning for Cross-Subject EEG Emotion Recognition
    Li, Jinpeng
    Qiu, Shuang
    Shen, Yuan-Yuan
    Liu, Cheng-Lin
    He, Huiguang
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) : 3281 - 3293
  • [22] Interpretable Cross-Subject EEG-Based Emotion Recognition Using Channel-Wise Features†
    Jin, Longbin
    Kim, Eun Yi
    SENSORS, 2020, 20 (23) : 1 - 18
  • [23] Cross-subject emotion EEG signal recognition based on source microstate analysis
    Zhang, Lei
    Xiao, Di
    Guo, Xiaojing
    Li, Fan
    Liang, Wen
    Zhou, Bangyan
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [24] Evolutionary Ensemble Learning for EEG-Based Cross-Subject Emotion Recognition
    Zhang, Hanzhong
    Zuo, Tienyu
    Chen, Zhiyang
    Wang, Xin
    Sun, Poly Z. H.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (07) : 3872 - 3881
  • [25] Cross-Subject EEG-Based Emotion Recognition Using Deep Metric Learning and Adversarial Training
    Alameer, Hawraa Razzaq Abed
    Salehpour, Pedram
    Hadi Aghdasi, Seyyed
    Feizi-Derakhshi, Mohammad-Reza
    IEEE ACCESS, 2024, 12 : 130241 - 130252
  • [26] Cross-Subject Emotion Recognition Based on Domain Similarity of EEG Signal Transfer
    Ma, Yuliang
    Zhao, Weicheng
    Meng, Ming
    Zhang, Qizhong
    She, Qingshan
    Zhang, Jianhai
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 936 - 943
  • [27] Cross-subject emotion recognition in brain-computer interface based on frequency band attention graph convolutional adversarial neural networks
    Chen, Shinan
    Wang, Yuchen
    Lin, Xuefen
    Sun, Xiaoyong
    Li, Weihua
    Ma, Weifeng
    JOURNAL OF NEUROSCIENCE METHODS, 2024, 411
  • [28] Emotion Recognition Based On Electroencephalogram Signals Using Deep Learning Network
    Wu, Bin
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2023, 27 (01): : 1967 - 1974
  • [29] Cross-Subject Channel Selection Using Modified Relief and Simplified CNN-Based Deep Learning for EEG-Based Emotion Recognition
    Farokhah, Lia
    Sarno, Riyanarto
    Fatichah, Chastine
    IEEE ACCESS, 2023, 11 : 110136 - 110150
  • [30] ELECTROENCEPHALOGRAM-BASED EMOTION RECOGNITION USING A CONVOLUTIONAL NEURAL NETWORK
    Savinov, V. B.
    Botman, S. A.
    Sapunov, V. V.
    Petrov, V. A.
    Samusev, I. G.
    Shusharina, N. N.
    BULLETIN OF RUSSIAN STATE MEDICAL UNIVERSITY, 2019, (03): : 34 - 38