Dual Learning for Conversational Emotion Recognition and Emotional Response Generation

被引:0
|
作者
Zhang, Shuhe [1 ]
Hu, Haifeng [1 ]
Xing, Songlong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
Conversational AI; dialogue system; dual learning; emotion recognition; human-machine interaction;
D O I
10.1109/TAFFC.2023.3332631
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in conversation (ERC) and emotional response generation (ERG) are two important NLP tasks. ERC aims to detect the utterance-level emotion from a dialogue, while ERG focuses on expressing a desired emotion. Essentially, ERC is a classification task, with its input and output domains being the utterance text and emotion labels, respectively. On the other hand, ERG is a generation task with its input and output domains being the opposite. These two tasks are highly related, but surprisingly, they are addressed independently without making use of their duality in prior works. Therefore, in this article, we propose to solve these two tasks in a dual learning framework. Our contributions are fourfold: (1) We propose a dual learning framework for ERC and ERG. (2) Within the proposed framework, two models can be trained jointly, so that the duality between them can be utilised. (3) Instead of a symmetric framework that deals with two tasks of the same data domain, we propose a dual learning framework that performs on a pair of asymmetric input and output spaces, i.e., the natural language space and the emotion labels. (4) Experiments are conducted on benchmark datasets to demonstrate the effectiveness of our framework.
引用
收藏
页码:1241 / 1252
页数:12
相关论文
共 50 条
  • [31] Dual variational generative model and auxiliary retrieval for empathetic response generation by conversational robot
    Fu, Yahui
    Inoue, Koji
    Lala, Divesh
    Yamamoto, Kenta
    Chu, Chenhui
    Kawahara, Tatsuya
    ADVANCED ROBOTICS, 2023, 37 (21) : 1406 - 1418
  • [32] Adaptive Graph Learning for Multimodal Conversational Emotion Detection
    Tu, Geng
    Xie, Tian
    Liang, Bin
    Wang, Hongpeng
    Xu, Ruifeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 19089 - 19097
  • [33] Learning Emotional Representations from Imbalanced Speech Data for Speech Emotion Recognition and Emotional Text-to-Speech
    Wang, Shijun
    Gudnason, Jon
    Borth, Damian
    INTERSPEECH 2023, 2023, : 351 - 355
  • [34] Fusion of deep learning features with mixture of brain emotional learning for audio-visual emotion recognition
    Farhoudi, Zeinab
    Setayeshi, Saeed
    SPEECH COMMUNICATION, 2021, 127 : 92 - 103
  • [35] Application of Emotion Recognition and Modification for Emotional Telugu Speech Recognition
    Vishnu Vidyadhara Raju Vegesna
    Krishna Gurugubelli
    Anil Kumar Vuppala
    Mobile Networks and Applications, 2019, 24 : 193 - 201
  • [36] Application of Emotion Recognition and Modification for Emotional Telugu Speech Recognition
    Vegesna, Vishnu Vidyadhara Raju
    Gurugubelli, Krishna
    Vuppala, Anil Kumar
    MOBILE NETWORKS & APPLICATIONS, 2019, 24 (01): : 193 - 201
  • [37] EMOTIONAL TRAITS AND RECOGNITION OF FACIAL EXPRESSION OF EMOTION
    TONER, HL
    GATES, GR
    JOURNAL OF NONVERBAL BEHAVIOR, 1985, 9 (01) : 48 - 66
  • [38] Exploiting emotional concepts for image emotion recognition
    Yang, Hansen
    Fan, Yangyu
    Lv, Guoyun
    Liu, Shiya
    Guo, Zhe
    VISUAL COMPUTER, 2023, 39 (05): : 2177 - 2190
  • [39] Exploiting emotional concepts for image emotion recognition
    Hansen Yang
    Yangyu Fan
    Guoyun Lv
    Shiya Liu
    Zhe Guo
    The Visual Computer, 2023, 39 : 2177 - 2190
  • [40] Emotional metaphors for emotion recognition in Chinese text
    Huang, XX
    Yang, Y
    Zhou, CL
    AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, PROCEEDINGS, 2005, 3784 : 319 - 325