Cross-Subject Emotion Recognition Using Deep Adaptation Networks

被引:94
|
作者
Li, He [1 ]
Jin, Yi-Ming [1 ]
Zheng, Wei-Long [1 ]
Lu, Bao-Liang [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Ctr Brain Comp & Machine Intelligence, Dept Comp Sci & Engn, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Shanghai Educ Commiss Intelligent Interac, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Brain Sci & Technol Res Ctr, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Affective brain-computer interface; Emotion recognition; EEG; Deep neural network; Domain adaptation;
D O I
10.1007/978-3-030-04221-9_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Affective models based on EEG signals have been proposed in recent years. However, most of these models require subject-specific training and generalize worse when they are applied to new subjects. This is mainly caused by the individual differences across subjects. While, on the other hand, it is time-consuming and high cost to collect subject-specific training data for every new user. How to eliminate the individual differences in EEG signals for implementation of affective models is one of the challenges. In this paper, we apply Deep adaptation network (DAN) to solve this problem. The performance is evaluated on two publicly available EEG emotion recognition datasets, SEED and SEED-IV, in comparison with two baseline methods without domain adaptation and several other domain adaptation methods. The experimental results indicate that the performance of DAN is significantly superior to the existing methods.
引用
收藏
页码:403 / 413
页数:11
相关论文
共 50 条
  • [31] Cross-Subject Continuous Emotion Recognition using Speech and Body Motion in Dyadic Interactions
    Fatima, Syeda Narjis
    Erzin, Engin
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 1731 - 1735
  • [32] Cross-Subject EEG-Based Emotion Recognition via Semisupervised Multisource Joint Distribution Adaptation
    Jimenez-Guarneros, Magdiel
    Fuentes-Pineda, Gibran
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [33] CFDA-CSF: A Multi-Modal Domain Adaptation Method for Cross-Subject Emotion Recognition
    Jimenez-Guarneros, Magdiel
    Fuentes-Pineda, Gibran
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (03) : 1502 - 1513
  • [34] Cross-subject electroencephalogram emotion recognition based on maximum classifier discrepancy
    Cai Z.
    Guo M.
    Yang X.
    Chen X.
    Xu G.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2021, 38 (03): : 455 - 462
  • [35] Hybrid transfer learning strategy for cross-subject EEG emotion recognition
    Lu, Wei
    Liu, Haiyan
    Ma, Hua
    Tan, Tien-Ping
    Xia, Lingnan
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17
  • [36] MS-MDA: Multisource Marginal Distribution Adaptation for Cross-Subject and Cross-Session EEG Emotion Recognition
    Chen, Hao
    Jin, Ming
    Li, Zhunan
    Fan, Cunhang
    Li, Jinpeng
    He, Huiguang
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [37] Multi-source joint domain adaptation for cross-subject and cross-session emotion recognition from electroencephalography
    Liang, Shengjin
    Su, Lei
    Wu, Liping
    Fu, Yunfa
    FRONTIERS IN HUMAN NEUROSCIENCE, 2022, 16
  • [38] Joint EEG Feature Transfer and Semisupervised Cross-Subject Emotion Recognition
    Peng, Yong
    Liu, Honggang
    Kong, Wanzeng
    Nie, Feiping
    Lu, Bao-Liang
    Cichocki, Andrzej
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (07) : 8104 - 8115
  • [39] Comprehensive Multisource Learning Network for Cross-Subject Multimodal Emotion Recognition
    Chen, Chuangquan
    Li, Zhencheng
    Kou, Kit Ian
    Du, Jie
    Li, Chen
    Wang, Hongtao
    Vong, Chi-Man
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, : 1 - 16
  • [40] Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
    Shen, Xinke
    Liu, Xianggen
    Hu, Xin
    Zhang, Dan
    Song, Sen
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2496 - 2511