LR-GCN: Latent Relation-Aware Graph Convolutional Network for Conversational Emotion Recognition

被引:20
|
作者
Ren, Minjie [1 ,2 ]
Huang, Xiangdong [1 ]
Li, Wenhui [1 ]
Song, Dan [1 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation; Emotion recognition; Task analysis; Context modeling; Computer architecture; Transformers; Social networking (online); Emotion recognition in conversations; multi-head attention; graph convolutional network;
D O I
10.1109/TMM.2021.3117062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an intersection of artificial intelligence and human communication analysis, Emotion Recognition in Conversation (ERC) has attracted much research attention in recent years. Existing studies, however, are limited in adequately exploiting latent relations among the constituent utterances. In this paper, we address this issue by proposing a novel approach named Latent Relation-Aware Graph Convolutional Network (LR-GCN), where both speaker dependency of the interlocutors is leveraged and latent correlations among the utterances are captured for ERC. Specifically, we first establish a graph model to incorporate the context information and speaker dependency of the conversation. Afterward, the multi-head attention mechanism is introduced to explore the latent correlations among the utterances and generate a set of all-linked graphs. Here, aiming to simultaneously exploit the original modeled speaker dependency and the explored correlation information, we introduce a dense connection layer to capture more structural information of the generated graphs. Through a multi-branch graph network, we achieve a unified representation of each utterance for final prediction. Detailed evaluations on two benchmark datasets demonstrate LR-GCN outperforms the state-of-the-art approaches.
引用
收藏
页码:4422 / 4432
页数:11
相关论文
共 50 条
  • [21] Relation-Aware Heterogeneous Graph Neural Network for Fraud Detection
    Li, Enxia
    Ouyang, Jin
    Xiang, Sheng
    Qin, Lu
    Chen, Ling
    WEB AND BIG DATA, APWEB-WAIM 2024, PT III, 2024, 14963 : 240 - 255
  • [22] RGRN: Relation-aware graph reasoning network for object detection
    Jianjun Zhao
    Jun Chu
    Lu Leng
    Chaolin Pan
    Tao Jia
    Neural Computing and Applications, 2023, 35 : 16671 - 16688
  • [23] Relation-aware graph convolutional network for waste battery inspection based on X-ray images
    Li, Yangke
    Zhang, Xinman
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2024, 63
  • [24] A mutually enhanced multi-scale relation-aware graph convolutional network for argument pair extraction
    Xiaofei Zhu
    Yidan Liu
    Zhuo Chen
    Xu Chen
    Jiafeng Guo
    Stefan Dietze
    Journal of Intelligent Information Systems, 2024, 62 : 555 - 574
  • [25] A mutually enhanced multi-scale relation-aware graph convolutional network for argument pair extraction
    Zhu, Xiaofei
    Liu, Yidan
    Chen, Zhuo
    Chen, Xu
    Guo, Jiafeng
    Dietze, Stefan
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2024, 62 (02) : 555 - 574
  • [26] GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
    Chen, Feilong
    Chen, Xiuyi
    Meng, Fandong
    Li, Peng
    Zhou, Jie
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 230 - 243
  • [27] CR-GCN: Channel-Relationships-Based Graph Convolutional Network for EEG Emotion Recognition
    Jia, Jingjing
    Zhang, Bofeng
    Lv, Hehe
    Xu, Zhikang
    Hu, Shengxiang
    Li, Haiyan
    BRAIN SCIENCES, 2022, 12 (08)
  • [28] AST-GCN: Augmented Spatial Temporal Graph Convolutional Neural Network for Gait Emotion Recognition
    Chen, Chuang
    Sun, Xiao
    Tu, Zhengzheng
    Wang, Meng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4581 - 4595
  • [29] C-GCN: Correlation Based Graph Convolutional Network for Audio-Video Emotion Recognition
    Nie, Weizhi
    Ren, Minjie
    Nie, Jie
    Zhao, Sicheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 3793 - 3804
  • [30] Context- and Knowledge-Aware Graph Convolutional Network for Multimodal Emotion Recognition
    Fu, Yahui
    Okada, Shogo
    Wang, Longbiao
    Guo, Lili
    Song, Yaodong
    Liu, Jiaxing
    Dang, Jianwu
    IEEE MULTIMEDIA, 2022, 29 (03) : 91 - 99