3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition

被引:96
|
作者
Liu, Shuaiqi [1 ,2 ]
Wang, Xu [3 ]
Zhao, Ling [3 ]
Li, Bing [2 ]
Hu, Weiming [2 ]
Yu, Jie [4 ,5 ]
Zhang, Yu-Dong [6 ]
机构
[1] Hebei Univ, Coll Elect & Informat Engn, Machine Vis Engn Res Ctr Hebei Prov, Baoding 071002, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit NLPR, Beijing 100190, Peoples R China
[3] Hebei Univ, Coll Elect & Informat Engn, Key Lab Digital Med Engn Hebei Prov, Baoding 071002, Peoples R China
[4] PLA Med Coll, Dept Intervent Ultrasound, Beijing 100853, Peoples R China
[5] Chinese Peoples Liberat Army Gen Hosp, Beijing 100853, Peoples R China
[6] Univ Leicester, Sch Informat, Leicester LE1 7RH, Leics, England
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Emotion recognition; Convolution; Brain modeling; Deep learning; Neural networks; 3D convolution attention neural network; dual attention learning; EEG emotion recognition; spatio-temporal feature; FEATURE-EXTRACTION; CLASSIFICATION;
D O I
10.1109/JBHI.2021.3083525
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Since electroencephalogram (EEG) signals can truly reflect human emotional state, emotion recognition based on EEG has turned into a critical branch in the field of artificial intelligence. Aiming at the disparity of EEG signals in various emotional states, we propose a new deep learning model named three-dimension convolution attention neural network (3DCANN) for EEG emotion recognition in this paper. The 3DCANN model is composed of spatio-temporal feature extraction module and EEG channel attention weight learning module, which can extract the dynamic relation well among multi-channel EEG signals and the internal spatial relation of multi-channel EEG signals during continuous period time. In this model, the spatio-temporal features are fused with the weights of dual attention learning, and the fused features are input into the softmax classifier for emotion classification. In addition, we utilize SJTU Emotion EEG Dataset (SEED) to appraise the feasibility and effectiveness of the proposed algorithm. Finally, experimental results display that the 3DCANN method has superior performance over the state-of-the-art models in EEG emotion recognition.
引用
收藏
页码:5321 / 5331
页数:11
相关论文
共 50 条
  • [1] HASTF: a hybrid attention spatio-temporal feature fusion network for EEG emotion recognition
    Hu, Fangzhou
    Wang, Fei
    Bi, Jinying
    An, Zida
    Chen, Chao
    Qu, Gangguo
    Han, Shuai
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [2] STCA: an action recognition network with spatio-temporal convolution and attention
    Tian, Qiuhong
    Miao, Weilun
    Zhang, Lizao
    Yang, Ziyu
    Yu, Yang
    Zhao, Yanying
    Yao, Lan
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2025, 14 (01)
  • [3] Spatio-temporal graph Bert network for EEG emotion recognition
    Yan, Jingjie
    Du, Chengkun
    Li, Na
    Zhou, Xiaoyang
    Liu, Ying
    Wei, Jinsheng
    Yang, Yuan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 104
  • [4] EEG Emotion Recognition via Graph-based Spatio-Temporal Attention Neural Networks
    Sartipi, Shadi
    Torkamani-Azar, Mastaneh
    Cetin, Mujdat
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 571 - 574
  • [5] Convolution spatial-temporal attention network for EEG emotion recognition
    Cao, Lei
    Yu, Binlong
    Dong, Yilin
    Liu, Tianyu
    Li, Jie
    PHYSIOLOGICAL MEASUREMENT, 2024, 45 (12)
  • [6] Attention-based Spatio-Temporal Graphic LSTM for EEG Emotion Recognition
    Li, Xiaoxu
    Zheng, Wenming
    Zong, Yuan
    Chang, Hongli
    Lu, Cheng
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] Spatio-Temporal Convolution-Attention Video Network
    Diba, Ali
    Sharma, Vivek
    Arzani, Mohammad. M.
    Van Gool, Luc
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 859 - 869
  • [8] Deep Spatio-Temporal Mutual Learning for EEG Emotion Recognition
    Ye, Wenqing
    Li, Xinyu
    Zhang, Haokun
    Zhu, Zhuolin
    Li, Dongdong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [9] SSTD: A Novel Spatio-Temporal Demographic Network for EEG-Based Emotion Recognition
    Li, Rui
    Ren, Chao
    Li, Chen
    Zhao, Nan
    Lu, Dawei
    Zhang, Xiaowei
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (01) : 376 - 387
  • [10] EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution
    Zhu, Xiaoliang
    Liu, Chen
    Zhao, Liang
    Wang, Shengming
    SENSORS, 2024, 24 (11)