Transformer-Based Potential Emotional Relation Mining Network for Emotion Recognition in Conversation

被引:0
|
作者
Shi, Yunwei [1 ]
Sun, Xiao [2 ,3 ]
机构
[1] Anhui Univ, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, Hefei, Anhui, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Hefei, Anhui, Peoples R China
关键词
Emotion recognition in conversation; Transformer encoder; Natural language processing;
D O I
10.1007/978-981-99-2401-1_22
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Emotion recognition in conversation (ERC) has attracted much attention due to its widespread applications in the field of human communication analysis. Compared with the vanilla sentiment analysis of the single utterance, the ERC task which aims to judge the emotion labels of utterances in the conversation requiresmodeling both the contextual information and the speaker dependency. However, previous models are limited in exploring the potential emotional relation of the utterances. To address the problem, we propose a novel transformer-based potential emotion relation mining network (TPERMN) to better explore the potential emotional relation and integrate the emotional clues. First, we utilize the global gated recurrence unit to extract the situation-level emotion vector. Then, different speakerGRU are assigned to different speakers to capture the intra-speaker dependency of the utterances and obtain the speaker-level emotion vector. Second, a potential relation mining transformer called PERformer is devised to extract the potential emotional relation and integrate emotional clues for the situation-level and speaker-level emotion vector. In PERformer, we combine graph attention and multi-head attention mechanism to explore the deep semantic information and potential emotional relation. And an emotion augment block is designed to enhance and complement the inherent characteristics. After multi-layer accumulation, the updated representation is obtained for emotion classification. Detailed experiments on two public ERC datasets demonstrate our model outperforms the state-of-the-art models.
引用
收藏
页码:238 / 251
页数:14
相关论文
共 50 条
  • [21] MusicEmo: transformer-based intelligent approach towards music emotion generation and recognition
    Xin Y.
    Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (08) : 3107 - 3117
  • [22] Transformer-Based Multimodal Emotional Perception for Dynamic Facial Expression Recognition in the Wild
    Zhang, Xiaoqin
    Li, Min
    Lin, Sheng
    Xu, Hang
    Xiao, Guobao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3192 - 3203
  • [23] An emotion-driven, transformer-based network for multimodal fake news detection
    Yadav, Ashima
    Gupta, Anika
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (01)
  • [24] An emotion-driven, transformer-based network for multimodal fake news detection
    Ashima Yadav
    Anika Gupta
    International Journal of Multimedia Information Retrieval, 2024, 13
  • [25] End to end transformer-based contextual speech recognition based on pointer network
    Lin, Binghuai
    Wang, Liyuan
    INTERSPEECH 2021, 2021, : 2087 - 2091
  • [26] A Transformer-Based Deep Learning Network for Underwater Acoustic Target Recognition
    Feng, Sheng
    Zhu, Xiaoqian
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [27] Transformer-Based Self-Supervised Multimodal Representation Learning for Wearable Emotion Recognition
    Wu, Yujin
    Daoudi, Mohamed
    Amad, Ali
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (01) : 157 - 172
  • [28] Transformer-Based Multilingual Speech Emotion Recognition Using Data Augmentation and Feature Fusion
    Al-onazi, Badriyya B.
    Nauman, Muhammad Asif
    Jahangir, Rashid
    Malik, Muhmmad Mohsin
    Alkhammash, Eman H.
    Elshewey, Ahmed M.
    APPLIED SCIENCES-BASEL, 2022, 12 (18):
  • [29] Transformer-based Dual Relation Graph for Multi-label Image Recognition
    Zhao, Jiawei
    Yan, Ke
    Zhao, Yifan
    Guo, Xiaowei
    Huang, Feiyue
    Li, Jia
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 163 - 172
  • [30] Multi-Label Multimodal Emotion Recognition With Transformer-Based Fusion and Emotion-Level Representation Learning
    Le, Hoai-Duy
    Lee, Guee-Sang
    Kim, Soo-Hyung
    Kim, Seungwon
    Yang, Hyung-Jeong
    IEEE ACCESS, 2023, 11 : 14742 - 14751