Context-and Sentiment-Aware Networks for Emotion Recognition in Conversation

被引:35
|
作者
Tu G. [1 ]
Wen J. [1 ]
Liu C. [1 ]
Jiang D. [1 ]
Cambria E. [2 ]
机构
[1] Shantou University, Department of Computer Science, Shantou
[2] Nanyang Technological University, School of Computer Science and Engineering, Singapore
来源
基金
中国国家自然科学基金;
关键词
Common-sense knowledge graph; dialogue transformer (DT); emotion recognition; graph attention network;
D O I
10.1109/TAI.2022.3149234
中图分类号
学科分类号
摘要
Emotion recognition in conversation (ERC) has promising potential in many fields, such as recommendation systems, man-machine interaction, and medical care. In contrast to other emotion identification tasks, conversation is essentially a process of dynamic interaction in which people often convey emotional messages relying on context and common-sense knowledge. In this article, we propose a context-and sentiment-aware framework, termed Sentic GAT, to solve this challenge. In Sentic GAT, common-sense knowledge is dynamically represented by the context-and sentiment-aware graph attention mechanism based on sentimental consistency, and context information is captured by the dialogue transformer (DT) with hierarchical multihead attention (HMAT), where HMAT is used to obtain the dependency of historical utterances on themselves and other utterances for better context representation. Additionally, we explore a contrastive loss to discriminate context-free and context-sensitive utterances in emotion identification to enhance context representation in straightforward conversations that directly express ideas. The experimental results show that context and sentimental information can promote the representation of common-sense knowledge, and the intra-and inter-dependency of contextual utterances effectively improve the performance of Sentic GAT. Moreover, our Sentic GAT using emotional intensity outperforms the most advanced model on the tested datasets. © 2020 IEEE.
引用
收藏
页码:699 / 708
页数:9
相关论文
共 50 条
  • [1] Sentiment-Aware Word Embedding for Emotion Classification
    Mao, Xingliang
    Chang, Shuai
    Shi, Jinjing
    Li, Fangfang
    Shi, Ronghua
    APPLIED SCIENCES-BASEL, 2019, 9 (07):
  • [2] SENTIMENT-AWARE AUTOMATIC SPEECH RECOGNITION PRE-TRAINING FOR ENHANCED SPEECH EMOTION RECOGNITION
    Ghriss, Ayoub
    Yang, Bo
    Rozgic, Viktor
    Shriberg, Elizabeth
    Wang, Chao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7347 - 7351
  • [3] Context-Aware Emotion Recognition Networks
    Lee, Jiyoung
    Kim, Seungryong
    Kim, Sunok
    Park, Jungin
    Sohn, Kwanghoon
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10142 - 10151
  • [4] Sentiment-aware Classifier for Out-of-Context Caption Detection
    Alkaddour, Muhannad
    Dhall, Abhinav
    Tariq, Usman
    Al Nashash, Hasan
    Al-Shargie, Fares
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7180 - 7184
  • [5] Sentiment-aware volatility forecasting
    Xing, Frank Z.
    Cambria, Erik
    Zhang, Yue
    KNOWLEDGE-BASED SYSTEMS, 2019, 176 : 68 - 76
  • [6] Sentiment-aware jump forecasting
    Li, Shaoyu
    Ning, Kaixuan
    Zhang, Teng
    KNOWLEDGE-BASED SYSTEMS, 2021, 228
  • [7] Sentiment-Aware Deep Recommender System With Neural Attention Networks
    Da'u, Aminu
    Salim, Naomie
    IEEE ACCESS, 2019, 7 : 45472 - 45484
  • [8] Attenuated sentiment-aware sequential recommendation
    Zhou, Donglin
    Zhang, Zhihong
    Zheng, Yangxin
    Zou, Zhenting
    Zheng, Lin
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023, 16 (02) : 271 - 283
  • [9] Convolutional Transformer with Sentiment-aware Attention for Sentiment Analysis
    Li, Pengfei
    Zhong, Peixiang
    Zhang, Jiaheng
    Mao, Kezhi
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Towards a Sentiment-Aware Conversational Agent
    Dias, Isabel
    Rei, Ricardo
    Pereira, Patricia
    Coheur, Luisa
    PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS, IVA 2022, 2022,