LR-GCN: Latent Relation-Aware Graph Convolutional Network for Conversational Emotion Recognition

被引:16
|
作者
Ren, Minjie [1 ,2 ]
Huang, Xiangdong [1 ]
Li, Wenhui [1 ]
Song, Dan [1 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation; Emotion recognition; Task analysis; Context modeling; Computer architecture; Transformers; Social networking (online); Emotion recognition in conversations; multi-head attention; graph convolutional network;
D O I
10.1109/TMM.2021.3117062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an intersection of artificial intelligence and human communication analysis, Emotion Recognition in Conversation (ERC) has attracted much research attention in recent years. Existing studies, however, are limited in adequately exploiting latent relations among the constituent utterances. In this paper, we address this issue by proposing a novel approach named Latent Relation-Aware Graph Convolutional Network (LR-GCN), where both speaker dependency of the interlocutors is leveraged and latent correlations among the utterances are captured for ERC. Specifically, we first establish a graph model to incorporate the context information and speaker dependency of the conversation. Afterward, the multi-head attention mechanism is introduced to explore the latent correlations among the utterances and generate a set of all-linked graphs. Here, aiming to simultaneously exploit the original modeled speaker dependency and the explored correlation information, we introduce a dense connection layer to capture more structural information of the generated graphs. Through a multi-branch graph network, we achieve a unified representation of each utterance for final prediction. Detailed evaluations on two benchmark datasets demonstrate LR-GCN outperforms the state-of-the-art approaches.
引用
收藏
页码:4422 / 4432
页数:11
相关论文
共 50 条
  • [1] DER-GCN: Dialog and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialog Emotion Recognition
    Ai, Wei
    Shou, Yuntao
    Meng, Tao
    Li, Keqin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 14
  • [2] Neighbor Relation-Aware Graph Convolutional Network for Recommendation
    Sun, Aijing
    Wang, Guoqing
    [J]. Computer Engineering and Applications, 2023, 59 (09): : 112 - 122
  • [3] Relation-Aware Pedestrian Attribute Recognition with Graph Convolutional Networks
    Tan, Zichang
    Yan, Yang
    Wan, Jun
    Guo, Guodong
    Li, Stan Z.
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12055 - 12062
  • [4] A relation-aware heterogeneous graph convolutional network for relationship prediction
    Mo, Xian
    Tang, Rui
    Liu, Hao
    [J]. INFORMATION SCIENCES, 2023, 623 : 311 - 323
  • [5] Relation-aware Graph Convolutional Networks for Multi-relational Network Alignment
    Fang, Yujie
    Li, Xin
    Ye, Rui
    Tan, Xiaoyan
    Zhao, Peiyao
    Wang, Mingzhong
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (02)
  • [6] Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations
    Ishiwatari, Taichi
    Yasuda, Yuki
    Miyazaki, Taro
    Goto, Jun
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 7360 - 7370
  • [7] Automatic Relation-aware Graph Network Proliferation
    Cai, Shaofei
    Li, Liang
    Han, Xinzhe
    Luo, Jiebo
    Zha, Zheng-Jun
    Huang, Qingming
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10853 - 10863
  • [8] Multi-loop graph convolutional network for multimodal conversational emotion recognition
    Ren, Minjie
    Huang, Xiangdong
    Li, Wenhui
    Liu, Jing
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 94
  • [9] Person Re-Identification Using Local Relation-Aware Graph Convolutional Network
    Lian, Yu
    Huang, Wenmin
    Liu, Shuang
    Guo, Peng
    Zhang, Zhong
    Durrani, Tariq S.
    [J]. SENSORS, 2023, 23 (19)
  • [10] Residual Relation-Aware Attention Deep Graph-Recurrent Model for Emotion Recognition in Conversation
    Duong, Anh-Quang
    Ho, Ngoc-Huynh
    Pant, Sudarshan
    Kim, Seungwon
    Kim, Soo-Hyung
    Yang, Hyung-Jeong
    [J]. IEEE ACCESS, 2024, 12 : 2349 - 2360