DAMTRNN: A Delta Attention-Based Multi-task RNN for Intention Recognition

被引:13
|
作者
Chen, Weitong [1 ]
Yue, Lin [2 ]
Li, Bohan [3 ]
Wang, Can [4 ]
Sheng, Quan Z. [5 ]
机构
[1] Univ Queensland, Brisbane, Qld, Australia
[2] Northeast Normal Univ, Changchun, Jilin, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Nanjing, Jiangsu, Peoples R China
[4] Griffith Univ, Gold Coast, Qld, Australia
[5] Macquarie Univ, Sydney, NSW, Australia
基金
中国博士后科学基金;
关键词
Attention network; Multi-task learning; Human intention recognition; EEG; CLASSIFICATION; MU;
D O I
10.1007/978-3-030-35231-8_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recognizing human intentions from electroencephalographic (EEG) signals is attracting extraordinary attention from the artificial intelligence community because of its promise in providing non-muscular forms of communication and control to those with disabilities. So far, studies have explored correlations between specific segments of an EEG signal and an associated intention. However, there are still challenges to be overcome on the road ahead. Among these, vector representations suffer from the enormous amounts of noise that characterize EEG signals. Identifying the correlations between signals from adjacent sensors on a headset is still difficult. Further, research not yet reached the point where learning models can accept decomposed EEG signals to capture the unique biological significance of the six established frequency bands. In pursuit of a more effective intention recognition method, we developed DAMTRNN, a delta attention-based multi-task recurrent neural network, for human intention recognition. The framework accepts divided EEG signals as inputs, and each frequency range is modeled separately but concurrently with a series of LSTMs. A delta attention network fuses the spatial and temporal interactions across different tasks into high-impact features, which captures correlations over longer time spans and further improves recognition accuracy. Comparative evaluations between DAMTRNN and 14 state-of-the-art methods and baselines show DAMTRNN with a record-setting performance of 98.87% accuracy.
引用
收藏
页码:373 / 388
页数:16
相关论文
共 50 条
  • [1] Attention-based LSTM with Multi-task Learning for Distant Speech Recognition
    Zhang, Yu
    Zhang, Pengyuan
    Yan, Yonghong
    [J]. 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3857 - 3861
  • [2] Attention-Based Multi-Task Learning in Pharmacovigilance
    Zhang, Shinan
    Dev, Shantanu
    Voyles, Joseph
    Rao, Anand S.
    [J]. PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 2324 - 2328
  • [3] Attention-based Multi-task Learning for Sensor Analytics
    Chen, Yujing
    Rangwala, Huzefa
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2187 - 2196
  • [4] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Ren, Lu
    Xu, Bo
    Lin, Hongfei
    Yang, Liang
    [J]. SOFT COMPUTING, 2021, 25 (22) : 14109 - 14118
  • [5] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Lu Ren
    Bo Xu
    Hongfei Lin
    Liang Yang
    [J]. Soft Computing, 2021, 25 : 14109 - 14118
  • [6] Orthogonal channel attention-based multi-task learning for multi-view facial expression recognition
    Chen, Jingying
    Yang, Lei
    Tan, Lei
    Xu, Ruyi
    [J]. PATTERN RECOGNITION, 2022, 129
  • [7] Multi-Task Reinforcement Learning With Attention-Based Mixture of Experts
    Cheng, Guangran
    Dong, Lu
    Cai, Wenzhe
    Sun, Changyin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3811 - 3818
  • [8] MMA-RNN: A multi-level multi-task attention-based recurrent neural network for discrimination and localization of atrial fibrillation
    Sun, Yifan
    Shen, Jingyan
    Jiang, Yunfan
    Huang, Zhaohui
    Hao, Minsheng
    Zhang, Xuegong
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89
  • [9] Poster Abstract: Speech Emotion Recognition via Attention-based DNN from Multi-Task Learning
    Ma, Fei
    Gu, Weixi
    Zhang, Wei
    Ni, Shiguang
    Huang, Shao-Lun
    Zhang, Lin
    [J]. SENSYS'18: PROCEEDINGS OF THE 16TH CONFERENCE ON EMBEDDED NETWORKED SENSOR SYSTEMS, 2018, : 363 - 364
  • [10] ATTENTION-BASED MULTI-TASK LEARNING FOR FINE-GRAINED IMAGE CLASSIFICATION
    Liu, Dichao
    Wang, Yu
    Mase, Kenji
    Kato, Jien
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1499 - 1503