Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] A deep multi-source adaptation transfer network for cross-subject electroencephalogram emotion recognition
    Wang, Fei
    Zhang, Weiwei
    Xu, Zongfeng
    Ping, Jingyu
    Chu, Hao
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (15): : 9061 - 9073
  • [2] Cross-subject electroencephalogram emotion recognition based on maximum classifier discrepancy
    Cai, Ziliang
    Guo, Miaomiao
    Yang, Xinsheng
    Chen, Xintong
    Xu, Guizhi
    [J]. Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (03): : 455 - 462
  • [3] A deep multi-source adaptation transfer network for cross-subject electroencephalogram emotion recognition
    Fei Wang
    Weiwei Zhang
    Zongfeng Xu
    Jingyu Ping
    Hao Chu
    [J]. Neural Computing and Applications, 2021, 33 : 9061 - 9073
  • [4] Cross-Subject Emotion Recognition Using Deep Adaptation Networks
    Li, He
    Jin, Yi-Ming
    Zheng, Wei-Long
    Lu, Bao-Liang
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2018), PT V, 2018, 11305 : 403 - 413
  • [5] Cross-Subject EEG-Based Emotion Recognition with Deep Domain Confusion
    Zhang, Weiwei
    Wang, Fei
    Jiang, Yang
    Xu, Zongfeng
    Wu, Shichao
    Zhang, Yahui
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT I, 2019, 11740 : 558 - 570
  • [6] Cross-Subject EEG Emotion Recognition With Self-Organized Graph Neural Network
    Li, Jingcong
    Li, Shuqi
    Pan, Jiahui
    Wang, Fei
    [J]. FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [7] Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion
    Cimtay, Yucel
    Ekmekcioglu, Erhan
    Caglar-Ozhan, Seyma
    [J]. IEEE ACCESS, 2020, 8 : 168865 - 168878
  • [8] Temporal aware Mixed Attention-based Convolution and Transformer Network for cross-subject EEG emotion recognition
    Si, Xiaopeng
    Huang, Dong
    Liang, Zhen
    Sun, Yulin
    Huang, He
    Liu, Qile
    Yang, Zhuobin
    Ming, Dong
    [J]. Computers in Biology and Medicine, 2024, 181
  • [9] Comprehensive Multisource Learning Network for Cross-Subject Multimodal Emotion Recognition
    Chen, Chuangquan
    Li, Zhencheng
    Kou, Kit Ian
    Du, Jie
    Li, Chen
    Wang, Hongtao
    Vong, Chi-Man
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [10] A deep subdomain associate adaptation network for cross-session and cross-subject EEG emotion recognition
    Meng, Ming
    Hu, Jiahao
    Gao, Yunyuan
    Kong, Wanzeng
    Luo, Zhizeng
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 78