AHRNN: Attention-Based Hybrid Robust Neural Network for emotion recognition

被引:3
|
作者
Xu, Ke [1 ,2 ]
Liu, Bin [2 ]
Tao, Jianhua [1 ,2 ,3 ]
Lv, Zhao [1 ]
Fan, Cunhang [2 ]
Song, Leichao [2 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[2] Chinese Acad Sci, Inst Automat, NLPR, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
affective computing; artificial intelligence; artificial neural networks;
D O I
10.1049/ccs2.12038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to solve the problem that the existing methods cannot effectively capture the semantic emotion of the sentence when faced with the lack of cross-language corpus, it is difficult to effectively perform cross-language sentiment analysis, we propose a neural network architecture called the Attention-Based Hybrid Robust Neural Network. The proposed architecture includes pre-trained word embedding with fine-tuning training to obtain prior semantic information, two sub-networks and attention mechanism to capture the global semantic emotional information in the text, and a fully connected layer and softmax function to jointly perform final emotional classification. The Convolutional Neural Networks sub-network captures the local semantic emotional information of the text, the BiLSTM sub-network captures the contextual semantic emotional information of the text, and the attention mechanism dynamically integrates the semantic emotional information to obtain key emotional information. We conduct experiments on Chinese (International Conference on Natural Language Processing and Chinese Computing) and English (SST) datasets. The experiment is divided into three subtasks to evaluate the superiority of our method. It improves the recognition accuracy of single sentence positive/negative classification from 79% to 86% in the single-language emotion recognition task. The recognition performance of fine-grained emotional tags is also improved by 9.6%. The recognition accuracy of cross-language emotion recognition tasks has also been improved by 1.5%. Even in the face of faulty data, the performance of our model is not significantly reduced when the error rate is less than 20%. These experimental results prove the superiority of our method.
引用
收藏
页码:85 / 95
页数:11
相关论文
共 50 条
  • [31] DEEP CONVOLUTIONAL RECURRENT NEURAL NETWORK WITH ATTENTION MECHANISM FOR ROBUST SPEECH EMOTION RECOGNITION
    Huang, Che-Wei
    Narayanan, Shrikanth
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 583 - 588
  • [32] Hierarchical-attention-based neural network for gait emotion recognition
    Zhang, Sainan
    Zhang, Jun
    Song, Weiguo
    Yang, Longnan
    Zhao, Xuedan
    [J]. PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2024, 637
  • [33] Attention-based recurrent neural network for automatic behavior laying hen recognition
    Laleye, Frejus A. A.
    Mousse, Mikael A.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (22) : 62443 - 62458
  • [34] Attention-Based Deep Neural Network and Its Application to Scene Text Recognition
    He, Haizhen
    Li, Jiehan
    [J]. 2019 IEEE 11TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2019), 2019, : 672 - 677
  • [35] A Hybrid Attention-Based Deep Neural Network for Simultaneous Multi-Sensor Pruning and Human Activity Recognition
    Zhou, Yu
    Yang, Zhuodi
    Zhang, Xiao
    Wang, Yufan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24): : 25363 - 25372
  • [36] Underwater acoustic target recognition using attention-based deep neural network
    Xiao, Xu
    Wang, Wenbo
    Ren, Qunyan
    Gerstoft, Peter
    Ma, Li
    [J]. JASA EXPRESS LETTERS, 2021, 1 (10):
  • [37] Speech Emotion Recognition with Hybrid Neural Network
    Wei, Chuanzheng
    Sun, Xiao
    Tian, Fang
    Ren, Fuji
    [J]. 5TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM 2019), 2019, : 298 - 302
  • [38] Attention-based convolutional neural network deep learning approach for robust malware classification
    Ravi, Vinayakumar
    Alazab, Mamoun
    [J]. COMPUTATIONAL INTELLIGENCE, 2023, 39 (01) : 145 - 168
  • [39] Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification
    Gao, Kai
    Xu, Hua
    Gao, Chengliang
    Hao, Hanyong
    Deng, Junhui
    Sun, Xiaomin
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [40] Speech emotion recognition based on convolutional neural network with attention-based bidirectional long short-term memory network and multi-task learning
    Liu, Zhen-Tao
    Han, Meng-Ting
    Wu, Bao-Han
    Rehman, Abdul
    [J]. APPLIED ACOUSTICS, 2023, 202