A graph neural network with context filtering and feature correction for conversational emotion recognition

被引:6
|
作者
Gan, Chenquan [1 ,2 ]
Zheng, Jiahao [1 ]
Zhu, Qingyi [2 ]
Kumar, Deepak [3 ,4 ]
Struc, Vitomir [5 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Cyber Secur & Informat Law, Chongqing 400065, Peoples R China
[3] Dalian Univ Technol, Sch Artificial Intelligence, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[4] Symbiosis Int Univ, Symbiosis Inst Technol, Pune 412115, India
[5] Univ Ljubljana, Fac Elect Engn, Trzaska Cesta 25, SI-1000 Ljubljana, Slovenia
关键词
Conversational emotion recognition; Context filter; Feature correction; Graph network; SENTIMENT; MODEL;
D O I
10.1016/j.ins.2023.120017
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Conversational emotion recognition represents an important machine-learning problem with a wide variety of deployment possibilities. The key challenge in this area is how to properly capture the key conversational aspects that facilitate reliable emotion recognition, including utterance semantics, temporal order, informative contextual cues, speaker interactions as well as other relevant factors. In this paper, we present a novel Graph Neural Network approach for conversational emotion recognition at the utterance level. Our method addresses the outlined challenges and represents conversations in the form of graph structures that naturally encode temporal order, speaker dependencies, and even long-distance context. To efficiently capture the semantic content of the conversations, we leverage the zero-shot feature-extraction capabilities of pre-trained large-scale language models and then integrate two key contributions into the graph neural network to ensure competitive recognition results. The first is a novel context filter that establishes meaningful utterance dependencies for the graph construction procedure and removes low-relevance and uninformative utterances from being used as a source of contextual information for the recognition task. The second contribution is a feature-correction procedure that adjusts the information content in the generated feature representations through a gating mechanism to improve their discriminative power and reduce emotion-prediction errors. We conduct extensive experiments on four commonly used conversational datasets, i.e., IEMOCAP, MELD, Dailydialog, and EmoryNLP, to demonstrate the capabilities of the developed graph neural network with context filtering and error-correction capabilities. The results of the experiments point to highly promising performance, especially when compared to state-of-the-art competitors from the literature.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] A graph neural network with context filtering and feature correction for conversational emotion recognition
    Gan, Chenquan
    Zheng, Jiahao
    Zhu, Qingyi
    Jain, Deepak Kumar
    Štruc, Vitomir
    Information Sciences, 2024, 658
  • [2] DECN: Dialogical emotion correction network for conversational emotion recognition
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    Liu, Bin, 1600, Elsevier B.V. (454): : 483 - 495
  • [3] DECN: Dialogical emotion correction network for conversational emotion recognition
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    NEUROCOMPUTING, 2021, 454 : 483 - 495
  • [4] Directed Acyclic Graph Network for Conversational Emotion Recognition
    Shen, Weizhou
    Wu, Siyue
    Yang, Yunyi
    Quan, Xiaojun
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 1551 - 1560
  • [5] Quantum-inspired Neural Network for Conversational Emotion Recognition
    Li, Qiuchi
    Gkoumas, Dimitris
    Sordoni, Alessandro
    Nie, Jian-Yun
    Melucci, Massimo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13270 - 13278
  • [6] Causal Graph Convolutional Neural Network for Emotion Recognition
    Kong, Wanzeng
    Qiu, Min
    Li, Menghang
    Jin, Xuanyu
    Zhu, Li
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 1686 - 1693
  • [7] Multi-loop graph convolutional network for multimodal conversational emotion recognition
    Ren, Minjie
    Huang, Xiangdong
    Li, Wenhui
    Liu, Jing
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 94
  • [8] Feature Recognition based on Graph decomposition and Neural Network
    Yi RongQing
    Li WenHui
    Duo, Wang
    Hua, Yuan
    THIRD 2008 INTERNATIONAL CONFERENCE ON CONVERGENCE AND HYBRID INFORMATION TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 864 - 868
  • [9] Conversational Emotion Recognition Using Self-Attention Mechanisms and Graph Neural Networks
    Lian, Zheng
    Tao, Jianhua
    Liu, Bin
    Huang, Jian
    Yang, Zhanlei
    Li, Rongjun
    INTERSPEECH 2020, 2020, : 2347 - 2351
  • [10] SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for incomplete multimodal learning in conversational emotion recognition
    Fu, Fangze
    Ai, Wei
    Yang, Fan
    Shou, Yuntao
    Meng, Tao
    Li, Keqin
    KNOWLEDGE-BASED SYSTEMS, 2025, 309