Deep Neural Network for Emotion Recognition Based on Meta-Transfer Learning

被引:5
|
作者
Tang, Hengyao [1 ]
Jiang, Guosong [1 ]
Wang, Qingdong [1 ]
机构
[1] Huanggang Normal Univ, Comp Sch, Huanggang 438000, Hubei, Peoples R China
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Brain modeling; Emotion recognition; Electroencephalography; Adaptation models; Feature extraction; Task analysis; Physiology; EEG signal; emotion recognition; transfer learning; meta-learning; EEG; CLASSIFICATION;
D O I
10.1109/ACCESS.2022.3193768
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, many EEG-based emotion recognition methods have been proposed, which can achieve good performance on single-subject data. However, when the models are applied to cross-subject scenarios, due to the existence of subject differences, these models are often difficult to accurately identify the emotions of new subjects, which is not conducive to the practical application of the models. Many transfer learning methods have been applied to cross-subject EEG emotion recognition tasks to reduce the effect of subject differences. Most of them need to be trained with source data of many subjects and calibrated with more data of target subjects to obtain better classification performance on target subjects. However, this process relies on a large amount of training data to guarantee the final effect. This paper proposed a meta-transfer learning model for emotion recognition. The model can reduce the amount of data required by the meta-learning optimization algorithm. Even if only a small amount of data is used for training, it can achieve good performance, thereby reducing the cost of EEG acquisition and labeling, and it is also conducive to the model for new subjects. Finally, this paper conducts cross-subject emotion recognition experiments based on two public datasets SEED and SEED-IV. The experimental results show that the performance of the proposed meta-transfer learning method is better than the baseline method, and can rapid adaptation to unknown subjects while reducing training data.
引用
收藏
页码:78114 / 78122
页数:9
相关论文
共 50 条
  • [1] Meta-transfer learning for emotion recognition
    Nguyen, Dung
    Nguyen, Duc Thanh
    Sridharan, Sridha
    Denman, Simon
    Nguyen, Thanh Thi
    Dean, David
    Fookes, Clinton
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (14): : 10535 - 10549
  • [2] Meta-transfer learning for emotion recognition
    Dung Nguyen
    Duc Thanh Nguyen
    Sridha Sridharan
    Simon Denman
    Thanh Thi Nguyen
    David Dean
    Clinton Fookes
    [J]. Neural Computing and Applications, 2023, 35 : 10535 - 10549
  • [3] Speech emotion recognition based on meta-transfer learning with domain adaption
    Liu, Zhen -Tao
    Wu, Bao-Han
    Han, Meng -Ting
    Cao, Wei -Hua
    Wu, Min
    [J]. APPLIED SOFT COMPUTING, 2023, 147
  • [4] Transfer Learning of Deep Neural Network for Speech Emotion Recognition
    Huang, Ying
    Hu, Mingqing
    Yu, Xianguo
    Wang, Tao
    Yang, Chen
    [J]. PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 721 - 729
  • [5] Cross-subject EEG emotion recognition combined with connectivity features and meta-transfer learning
    Li, Jinyu
    Hua, Haoqiang
    Xu, Zhihui
    Shu, Lin
    Xu, Xiangmin
    Kuang, Feng
    Wu, Shibin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 145
  • [6] Research on face emotion recognition algorithm based on deep learning neural network
    Chen, Yan
    Zhang, Mengzi
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [7] Speech Emotion Recognition Based on Deep Neural Network
    Zhu, Zijiang
    Hu, Yi
    Li, Junshan
    Li, Jianjun
    Wang, Junhua
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 154 - 154
  • [8] Time series forecasting with missing data using neural network and meta-transfer learning
    Maya, Mario
    Yu, Wen
    Li, Xiaoou
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [9] Meta-Transfer Learning for Code-Switched Speech Recognition
    Winata, Genta Indra
    Cahyawijaya, Samuel
    Lin, Zhaojiang
    Liu, Zihan
    Xu, Peng
    Fung, Pascale
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3770 - 3776
  • [10] Simulation of English speech emotion recognition based on transfer learning and CNN neural network
    Chen, Xuehua
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (02) : 2349 - 2360