Context-and Sentiment-Aware Networks for Emotion Recognition in Conversation

被引:35
|
作者
Tu G. [1 ]
Wen J. [1 ]
Liu C. [1 ]
Jiang D. [1 ]
Cambria E. [2 ]
机构
[1] Shantou University, Department of Computer Science, Shantou
[2] Nanyang Technological University, School of Computer Science and Engineering, Singapore
来源
基金
中国国家自然科学基金;
关键词
Common-sense knowledge graph; dialogue transformer (DT); emotion recognition; graph attention network;
D O I
10.1109/TAI.2022.3149234
中图分类号
学科分类号
摘要
Emotion recognition in conversation (ERC) has promising potential in many fields, such as recommendation systems, man-machine interaction, and medical care. In contrast to other emotion identification tasks, conversation is essentially a process of dynamic interaction in which people often convey emotional messages relying on context and common-sense knowledge. In this article, we propose a context-and sentiment-aware framework, termed Sentic GAT, to solve this challenge. In Sentic GAT, common-sense knowledge is dynamically represented by the context-and sentiment-aware graph attention mechanism based on sentimental consistency, and context information is captured by the dialogue transformer (DT) with hierarchical multihead attention (HMAT), where HMAT is used to obtain the dependency of historical utterances on themselves and other utterances for better context representation. Additionally, we explore a contrastive loss to discriminate context-free and context-sensitive utterances in emotion identification to enhance context representation in straightforward conversations that directly express ideas. The experimental results show that context and sentimental information can promote the representation of common-sense knowledge, and the intra-and inter-dependency of contextual utterances effectively improve the performance of Sentic GAT. Moreover, our Sentic GAT using emotional intensity outperforms the most advanced model on the tested datasets. © 2020 IEEE.
引用
收藏
页码:699 / 708
页数:9
相关论文
共 50 条
  • [41] A sentiment-aware deep learning approach for personality detection from text
    Ren, Zhancheng
    Shen, Qiang
    Diao, Xiaolei
    Xu, Hao
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (03)
  • [42] Towards Sentiment-Aware Multi-Modal Dialogue Policy Learning
    Tulika Saha
    Sriparna Saha
    Pushpak Bhattacharyya
    Cognitive Computation, 2022, 14 : 246 - 260
  • [43] SENTIMENT-AWARE DISTILLATION FOR BITCOIN TREND FORECASTING UNDER PARTIAL OBSERVABILITY
    Panagiotatos, Georgios
    Passalis, Nikolaos
    Tsantekidis, Avraam
    Tefas, Anastasios
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3898 - 3902
  • [44] CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION
    Ramet, Gaetan
    Garner, Philip N.
    Baeriswyl, Michael
    Lazaridis, Alexandros
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 126 - 131
  • [45] Towards Contrastive Context-Aware Conversational Emotion Recognition
    Zhang, Hanqing
    Song, Dawei
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (04) : 1879 - 1891
  • [46] CONTEXT-AWARE AFFECTIVE GRAPH REASONING FOR EMOTION RECOGNITION
    Zhang, Minghui
    Liang, Yumeng
    Ma, Huadong
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 151 - 156
  • [47] Personalized Travel Recommendation Based on Sentiment-Aware Multimodal Topic Model
    Shao, Xi
    Tang, Guijin
    Bao, Bing-Kun
    IEEE ACCESS, 2019, 7 : 113043 - 113052
  • [48] Speaker-Aware Interactive Graph Attention Network for Emotion Recognition in Conversation
    Jia, Zhaohong
    Shi, Yunwei
    Liu, Weifeng
    Huang, Zhenhua
    Sun, Xiao
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (12)
  • [49] Cross-domain Aspect/Sentiment-aware Abstractive Review Summarization
    Yang, Min
    Qu, Qiang
    Zhu, Jia
    Shen, Ying
    Zhao, Zhou
    CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 1531 - 1534
  • [50] A Sentiment-Aware Topic Model for Extracting Failures from Product Reviews
    Tutubalina, Elena
    TEXT, SPEECH, AND DIALOGUE, 2016, 9924 : 37 - 45