LR-GCN: Latent Relation-Aware Graph Convolutional Network for Conversational Emotion Recognition

被引:20
|
作者
Ren, Minjie [1 ,2 ]
Huang, Xiangdong [1 ]
Li, Wenhui [1 ]
Song, Dan [1 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation; Emotion recognition; Task analysis; Context modeling; Computer architecture; Transformers; Social networking (online); Emotion recognition in conversations; multi-head attention; graph convolutional network;
D O I
10.1109/TMM.2021.3117062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an intersection of artificial intelligence and human communication analysis, Emotion Recognition in Conversation (ERC) has attracted much research attention in recent years. Existing studies, however, are limited in adequately exploiting latent relations among the constituent utterances. In this paper, we address this issue by proposing a novel approach named Latent Relation-Aware Graph Convolutional Network (LR-GCN), where both speaker dependency of the interlocutors is leveraged and latent correlations among the utterances are captured for ERC. Specifically, we first establish a graph model to incorporate the context information and speaker dependency of the conversation. Afterward, the multi-head attention mechanism is introduced to explore the latent correlations among the utterances and generate a set of all-linked graphs. Here, aiming to simultaneously exploit the original modeled speaker dependency and the explored correlation information, we introduce a dense connection layer to capture more structural information of the generated graphs. Through a multi-branch graph network, we achieve a unified representation of each utterance for final prediction. Detailed evaluations on two benchmark datasets demonstrate LR-GCN outperforms the state-of-the-art approaches.
引用
收藏
页码:4422 / 4432
页数:11
相关论文
共 50 条
  • [31] TT-GCN: Temporal-Tightly Graph Convolutional Network for Emotion Recognition From Gaits
    Zhang, Tong
    Chen, Yelin
    Li, Shuzhen
    Hu, Xiping
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (03) : 4300 - 4314
  • [32] ReAHGN: Adaptive Heterogeneous Graph Neural Network With Relation-Aware Embedding
    Zhu, Xiaoyu
    Yu, Xinzhe
    Zha, Enze
    Lin, Shiyang
    IEEE ACCESS, 2025, 13 : 44951 - 44962
  • [33] Relation-aware dynamic attributed graph attention network for stocks recommendation
    Feng, Shibo
    Xu, Chen
    Zuo, Yu
    Chen, Guo
    Lin, Fan
    XiaHou, Jianbing
    PATTERN RECOGNITION, 2022, 121
  • [34] Relation-Aware Graph Attention Network for Multi-Behavior Recommendation
    Wu, Ming
    Ni, Qiufen
    Wu, Jigang
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [35] Relation R-CNN: A Graph Based Relation-Aware Network for Object Detection
    Chen, Shengjia
    Li, Zhixin
    Tang, Zhenjun
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1680 - 1684
  • [36] RF-GCN: Residual fused-graph convolutional network using multimodalities for facial emotion recognition
    Sakthi, D. Vishnu
    Ezhumalai, P.
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (09):
  • [37] Causal Graph Convolutional Neural Network for Emotion Recognition
    Kong, Wanzeng
    Qiu, Min
    Li, Menghang
    Jin, Xuanyu
    Zhu, Li
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 1686 - 1693
  • [38] Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation Extraction
    Hong, Yin
    Liu, Yanxia
    Yang, Suizhu
    Zhang, Kaiwen
    Wen, Aiqing
    Hu, Jianjun
    IEEE ACCESS, 2020, 8 : 51315 - 51323
  • [39] LRA-GNN: Latent Relation-Aware Graph Neural Network with initial and Dynamic Residual for facial age estimation
    Zhang, Yiping
    Shou, Yuntao
    Ai, Wei
    Meng, Tao
    Li, Keqin
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273
  • [40] Revisiting Homophily Ratio: A Relation-Aware Graph Neural Network for Homophily and Heterophily
    Huang, Wei
    Guan, Xiangshuo
    Liu, Desheng
    ELECTRONICS, 2023, 12 (04)