EEG-based Emotion Recognition via Transformer Neural Architecture Search

被引:55
|
作者
Li, Chang [1 ,2 ]
Zhang, Zhongzhen [1 ,2 ]
Zhang, Xiaodong [3 ]
Huang, Guoning [4 ]
Liu, Yu [1 ,2 ]
Chen, Xun [5 ,6 ]
机构
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Sch Instrument Sci & Optoelect Engn, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Chongqing Key Lab Human Embryo Engn, Chongqing 400010, Peoples R China
[4] Reprod & Genet Inst, Chongqing Hlth Ctr Women & Children, Chongqing 400010, Peoples R China
[5] Univ Sci & Technol China, Affiliated Hosp USTC 1, Dept Neurosurg, Div Life Sci & Med, Hefei 230001, Peoples R China
[6] Univ Sci & Technol China, Inst Adv Technol, USTC IAT Huami Joint Lab Brain Machine Intelligenc, Hefei 230088, Peoples R China
基金
中国国家自然科学基金;
关键词
Emotion recognition; Electroencephalography; Transformers; Feature extraction; Brain modeling; Task analysis; Computer architecture; Deep learning (DL); electroencephalogram (EEG); Index Terms; emotion recognition; transformer neural architecture search (TNAS); MODELS;
D O I
10.1109/TII.2022.3170422
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Emotion recognition based on electroencephalogram (EEG) plays an increasingly important role in the field of brain-computer interfaces. Recently, deep learning has been widely applied to EEG decoding owning to its excellent capabilities in automatic feature extraction. Transformer holds great superiority in processing time-series signals due to its long-term dependencies extraction ability. However, most existing transformer architectures are designed manually by human experts, which is a time-consuming and resource-intensive process. In this article, we propose an automatic transformer neural architectures search (TNAS) framework based on multiobjective evolution algorithm (MOEA) for the EEG-based emotion recognition. The proposed TNAS conducts the MOEA strategy that considers both accuracy and model size to discover the optimal model from well-trained supernet for the emotion recognition. We conducted extensive experiments to evaluate the performance of the proposed TNAS on the DEAP and DREAMER datasets. The experimental results showed that the proposed TNAS outperforms the state-of-the-art methods.
引用
收藏
页码:6016 / 6025
页数:10
相关论文
共 50 条
  • [41] Nuclear Norm Regularized Deep Neural Network for EEG-Based Emotion Recognition
    Liang, Shuang
    Yin, Mingbo
    Huang, Yecheng
    Dai, Xiubin
    Wang, Qiong
    FRONTIERS IN PSYCHOLOGY, 2022, 13
  • [42] Data Augmentation for EEG-Based Emotion Recognition with Deep Convolutional Neural Networks
    Wang, Fang
    Zhong, Sheng-hua
    Peng, Jianfeng
    Jiang, Jianmin
    Liu, Yan
    MULTIMEDIA MODELING, MMM 2018, PT II, 2018, 10705 : 82 - 93
  • [43] A GPSO-optimized convolutional neural networks for EEG-based emotion recognition
    Gao, Zhongke
    Li, Yanli
    Yang, Yuxuan
    Wang, Xinmin
    Dong, Na
    Chiang, Hsiao-Dong
    NEUROCOMPUTING, 2020, 380 (380) : 225 - 235
  • [44] EEG-Based Emotion Recognition via Knowledge-Integrated Interpretable Method
    Zhang, Ying
    Cui, Chen
    Zhong, Shenghua
    MATHEMATICS, 2023, 11 (06)
  • [45] EEG-based emotion recognition using multi-scale dynamic CNN and gated transformer
    Cheng, Zhuoling
    Bu, Xuekui
    Wang, Qingnan
    Yang, Tao
    Tu, Jihui
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [46] Efficient neural architecture search for emotion recognition
    Verma, Monu
    Mandal, Murari
    Reddy, Satish Kumar
    Meedimale, Yashwanth Reddy
    Vipparthi, Santosh Kumar
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 224
  • [47] NEURAL ARCHITECTURE SEARCH FOR SPEECH EMOTION RECOGNITION
    Wu, Xixin
    Hu, Shoukang
    Wu, Zhiyong
    Liu, Xunying
    Meng, Helen
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6902 - 6906
  • [48] Real-Time EEG-Based Emotion Recognition
    Yu, Xiangkun
    Li, Zhengjie
    Zang, Zhibang
    Liu, Yinhua
    SENSORS, 2023, 23 (18)
  • [49] Deep Learning for EEG-based Emotion Recognition: A Survey
    Li J.-Y.
    Du X.-B.
    Zhu Z.-L.
    Deng X.-M.
    Ma C.-X.
    Wang H.-A.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01): : 255 - 276
  • [50] A review on EEG-based multimodal learning for emotion recognition
    Pillalamarri, Rajasekhar
    Shanmugam, Udhayakumar
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (05)