LR-GCN: Latent Relation-Aware Graph Convolutional Network for Conversational Emotion Recognition

被引:20
|
作者
Ren, Minjie [1 ,2 ]
Huang, Xiangdong [1 ]
Li, Wenhui [1 ]
Song, Dan [1 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation; Emotion recognition; Task analysis; Context modeling; Computer architecture; Transformers; Social networking (online); Emotion recognition in conversations; multi-head attention; graph convolutional network;
D O I
10.1109/TMM.2021.3117062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an intersection of artificial intelligence and human communication analysis, Emotion Recognition in Conversation (ERC) has attracted much research attention in recent years. Existing studies, however, are limited in adequately exploiting latent relations among the constituent utterances. In this paper, we address this issue by proposing a novel approach named Latent Relation-Aware Graph Convolutional Network (LR-GCN), where both speaker dependency of the interlocutors is leveraged and latent correlations among the utterances are captured for ERC. Specifically, we first establish a graph model to incorporate the context information and speaker dependency of the conversation. Afterward, the multi-head attention mechanism is introduced to explore the latent correlations among the utterances and generate a set of all-linked graphs. Here, aiming to simultaneously exploit the original modeled speaker dependency and the explored correlation information, we introduce a dense connection layer to capture more structural information of the generated graphs. Through a multi-branch graph network, we achieve a unified representation of each utterance for final prediction. Detailed evaluations on two benchmark datasets demonstrate LR-GCN outperforms the state-of-the-art approaches.
引用
收藏
页码:4422 / 4432
页数:11
相关论文
共 50 条
  • [41] SERC-GCN: SPEECH EMOTION RECOGNITION IN CONVERSATION USING GRAPH CONVOLUTIONAL NETWORKS
    Chandola, Deeksha
    Altarawneh, Enas
    Jenkin, Michael
    Papagelis, Manos
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 76 - 80
  • [42] Graph4Web: A relation-aware graph attention network for web service classification
    Zhao, Kunsong
    Liu, Jin
    Xu, Zhou
    Liu, Xiao
    Xue, Lei
    Xie, Zhiwen
    Zhou, Yuxuan
    Wang, Xin
    JOURNAL OF SYSTEMS AND SOFTWARE, 2022, 190
  • [43] MOBA Game Item Recommendation via Relation-aware Graph Attention Network
    Duan, Lijuan
    Li, Shuxin
    Zhang, Wenbo
    Wang, Wenjian
    2022 IEEE CONFERENCE ON GAMES, COG, 2022, : 338 - 344
  • [44] Affect-GCN: a multimodal graph convolutional network for multi-emotion with intensity recognition and sentiment analysis in dialogues
    Mauajama Firdaus
    Gopendra Vikram Singh
    Asif Ekbal
    Pushpak Bhattacharyya
    Multimedia Tools and Applications, 2023, 82 : 43251 - 43272
  • [45] Affect-GCN: a multimodal graph convolutional network for multi-emotion with intensity recognition and sentiment analysis in dialogues
    Firdaus, Mauajama
    Singh, Gopendra Vikram
    Ekbal, Asif
    Bhattacharyya, Pushpak
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (28) : 43251 - 43272
  • [46] A semantic relation-aware deep neural network model for end-to-end conversational recommendation
    Wu, Jiajin
    Yang, Bo
    Li, Dongsheng
    Deng, Lihui
    APPLIED SOFT COMPUTING, 2023, 132
  • [47] MSFR-GCN: A Multi-Scale Feature Reconstruction Graph Convolutional Network for EEG Emotion and Cognition Recognition
    Pan, Deng
    Zheng, Haohao
    Xu, Feifan
    Ouyang, Yu
    Jia, Zhe
    Wang, Chu
    Zeng, Hong
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 3245 - 3254
  • [48] Adaptive Hierarchical Graph Convolutional Network for EEG Emotion Recognition
    Xue, Yunlong
    Zheng, Wenming
    Zong, Yuan
    Chang, Hongli
    Jiang, Xingxun
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [49] An adaptive graph convolutional network with residual attention for emotion recognition
    Gao, Dongrui
    Zheng, Qingyuan
    Li, Pengrui
    Wang, Manqing
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2025,
  • [50] An improved graph convolutional neural network for EEG emotion recognition
    Xu, Bingyue
    Zhang, Xin
    Zhang, Xiu
    Sun, Baiwei
    Wang, Yujie
    Neural Computing and Applications, 2024, 36 (36) : 23049 - 23060