Electroencephalogram-based emotion recognition using factorization temporal separable convolution network

被引:2
|
作者
Yang, Lijun [1 ,2 ]
Wang, Yixin [1 ]
Ouyang, Rujie [1 ]
Niu, Xiaolong [1 ]
Yang, Xiaohui [1 ,2 ]
Zheng, Chen [1 ,2 ]
机构
[1] Henan Univ, Henan Engn Res Ctr Artificial Intelligence Theory, Sch Math & Stat, Kaifeng 475004, Peoples R China
[2] Henan Univ, Ctr Appl Math Henan Prov, Zhengzhou 450046, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalogram; Emotion recognition; Temporal convolution network; Factorization machine;
D O I
10.1016/j.engappai.2024.108011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Temporal Convolutional Networks (TCNs) expand their receptive field through dilated convolutions, which is essential for capturing dependencies in longer sequences. This characteristic is especially critical for detecting long-term patterns in Electroencephalogram (EEG) data, making TCNs a suitable choice for EEG -based emotion recognition. In this study, to effectively capture the interaction between features, we incorporate Factorization Machines (FM) into the TCN model, proposing the Factorization Temporal Convolution Network (FTCN) for EEG -based emotion recognition. On one hand, the FTCN model enhances understanding of temporal dynamics by capturing long-term dependencies in time series data through TCN. On the other hand, it combines FM to increase the model's expression ability in the feature dimension, allowing for a more comprehensive understanding of EEG data. Building on this, separable convolutions are incorporated into the FTCN to develop the Factorization Temporal Separable Convolution Network (FTSCN). This approach reduces the model's parameter count by splitting standard convolutions into two simpler operations, thus accelerating training and inference. Experiments on the DEAP and SEED datasets demonstrate the effectiveness of these two models, showcasing competitive recognition accuracy compared to published methods. Specifically, on the DEAP dataset, the recognition accuracies for arousal and valence achieve 97.39% +/- 1.93 and 97.55% +/- 1.65. For the four -class task, the accuracy reaches 95.43% +/- 2.43 ; on the SEED dataset, the recognition accuracy can reach 89.13% +/- 4.49.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] ELECTROENCEPHALOGRAM-BASED EMOTION RECOGNITION USING A CONVOLUTIONAL NEURAL NETWORK
    Savinov, V. B.
    Botman, S. A.
    Sapunov, V. V.
    Petrov, V. A.
    Samusev, I. G.
    Shusharina, N. N.
    [J]. BULLETIN OF RUSSIAN STATE MEDICAL UNIVERSITY, 2019, (03): : 34 - 38
  • [2] Electroencephalogram-based Emotion Recognition with Hybrid Graph Convolutional Network Model
    Nahin, Rakibul Alam
    Islam, Md. Tahmidul
    Kabir, Abrar
    Afrin, Sadiya
    Chowdhury, Imtiaz Ahmed
    Rahman, Rafeed
    Alam, Md. Golam Rabiul
    [J]. 2023 IEEE 13TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE, CCWC, 2023, : 705 - 711
  • [3] SSDNet: A SEMISUPERVISED DEEP GENERATIVE ADVERSARIAL NETWORK FOR ELECTROENCEPHALOGRAM-BASED EMOTION RECOGNITION
    Xu, Juan
    Xu, Lijun
    Liu, Kai
    Yang, Qing
    Zheng, Yaxin
    [J]. JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (02)
  • [4] Joint Distribution Adaptation Network for Multi-source Electroencephalogram-based Emotion Recognition
    Tan, Ying
    Liu, Gan
    Chen, Lingfeng
    Sun, Zhe
    Duan, Feng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1077 - 1082
  • [5] Knowledge distillation based lightweight domain adversarial neural network for electroencephalogram-based emotion recognition
    Wang, Zhe
    Wang, Yongxiong
    Tang, Yiheng
    Pan, Zhiqun
    Zhang, Jiapeng
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [6] Electroencephalogram-Based Attention Level Classification Using Convolution Attention Memory Neural Network
    Toa, Chean Khim
    Sim, Kok Swee
    Tan, Shing Chiang
    [J]. IEEE ACCESS, 2021, 9 : 58870 - 58881
  • [7] Cerebral asymmetry representation learning-based deep subdomain adaptation network for electroencephalogram-based emotion recognition
    Wang, Zhe
    Wang, Yongxiong
    Wan, Xin
    Tang, Yiheng
    [J]. PHYSIOLOGICAL MEASUREMENT, 2024, 45 (03)
  • [8] A Lightweight Model Based on Separable Convolution for Speech Emotion Recognition
    Zhong, Ying
    Hu, Ying
    Huang, Hao
    Silamu, Wushour
    [J]. INTERSPEECH 2020, 2020, : 3331 - 3335
  • [9] Emotion Recognition Based On Electroencephalogram Signals Using Deep Learning Network
    Wu, Bin
    [J]. JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2023, 27 (01): : 1967 - 1974
  • [10] Emotion Recognition Based on Electroencephalogram Using Semisupervised Generative Adversarial Network
    Yu, Sung-Nien
    Liu, Yuan-Jhe
    Chang, Yu Ping
    [J]. 2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,