Transformer-Based Potential Emotional Relation Mining Network for Emotion Recognition in Conversation

被引:0
|
作者
Shi, Yunwei [1 ]
Sun, Xiao [2 ,3 ]
机构
[1] Anhui Univ, Hefei, Anhui, Peoples R China
[2] Hefei Univ Technol, Hefei, Anhui, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Hefei, Anhui, Peoples R China
关键词
Emotion recognition in conversation; Transformer encoder; Natural language processing;
D O I
10.1007/978-981-99-2401-1_22
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Emotion recognition in conversation (ERC) has attracted much attention due to its widespread applications in the field of human communication analysis. Compared with the vanilla sentiment analysis of the single utterance, the ERC task which aims to judge the emotion labels of utterances in the conversation requiresmodeling both the contextual information and the speaker dependency. However, previous models are limited in exploring the potential emotional relation of the utterances. To address the problem, we propose a novel transformer-based potential emotion relation mining network (TPERMN) to better explore the potential emotional relation and integrate the emotional clues. First, we utilize the global gated recurrence unit to extract the situation-level emotion vector. Then, different speakerGRU are assigned to different speakers to capture the intra-speaker dependency of the utterances and obtain the speaker-level emotion vector. Second, a potential relation mining transformer called PERformer is devised to extract the potential emotional relation and integrate emotional clues for the situation-level and speaker-level emotion vector. In PERformer, we combine graph attention and multi-head attention mechanism to explore the deep semantic information and potential emotional relation. And an emotion augment block is designed to enhance and complement the inherent characteristics. After multi-layer accumulation, the updated representation is obtained for emotion classification. Detailed experiments on two public ERC datasets demonstrate our model outperforms the state-of-the-art models.
引用
收藏
页码:238 / 251
页数:14
相关论文
共 50 条
  • [41] TIRec: Transformer-based Invoice Text Recognition
    Chen, Yanlan
    2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, : 175 - 180
  • [42] BertSRC: transformer-based semantic relation classification
    Lee, Yeawon
    Son, Jinseok
    Song, Min
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2022, 22 (01)
  • [43] Transformer-Based Turkish Automatic Speech Recognition
    Tasar, Davut Emre
    Koruyan, Kutan
    Cilgin, Cihan
    ACTA INFOLOGICA, 2024, 8 (01): : 1 - 10
  • [44] SmokerViT: A Transformer-Based Method for Smoker Recognition
    Khan, Ali
    Khan, Somaiya
    Hassan, Bilal
    Khan, Rizwan
    Zheng, Zhonglong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (01): : 403 - 424
  • [45] BertSRC: transformer-based semantic relation classification
    Yeawon Lee
    Jinseok Son
    Min Song
    BMC Medical Informatics and Decision Making, 22
  • [46] Detecting Sarcasm in Conversation Context Using Transformer-Based Models
    Avvaru, Adithya
    Vobilisetty, Sanath
    Mamidi, Radhika
    FIGURATIVE LANGUAGE PROCESSING, 2020, : 98 - 103
  • [47] A Transformer-Based Framework for Scene Text Recognition
    Selvam, Prabu
    Koilraj, Joseph Abraham Sundar
    Tavera Romero, Carlos Andres
    Alharbi, Meshal
    Mehbodniya, Abolfazl
    Webber, Julian L.
    Sengan, Sudhakar
    IEEE ACCESS, 2022, 10 : 100895 - 100910
  • [48] Improving multimodal fusion with Main Modal Transformer for emotion recognition in conversation
    Zou, ShiHao
    Huang, Xianying
    Shen, XuDong
    Liu, Hankai
    KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [49] Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation
    Zou, Shihao
    Huang, Xianying
    Shen, Xudong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5994 - 6003
  • [50] Interactive Multimodal Attention Network for Emotion Recognition in Conversation
    Ren, Minjie
    Huang, Xiangdong
    Shi, Xiaoqi
    Nie, Weizhi
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1046 - 1050