Dual Learning for Conversational Emotion Recognition and Emotional Response Generation

被引:0
|
作者
Zhang, Shuhe [1 ]
Hu, Haifeng [1 ]
Xing, Songlong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
Conversational AI; dialogue system; dual learning; emotion recognition; human-machine interaction;
D O I
10.1109/TAFFC.2023.3332631
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in conversation (ERC) and emotional response generation (ERG) are two important NLP tasks. ERC aims to detect the utterance-level emotion from a dialogue, while ERG focuses on expressing a desired emotion. Essentially, ERC is a classification task, with its input and output domains being the utterance text and emotion labels, respectively. On the other hand, ERG is a generation task with its input and output domains being the opposite. These two tasks are highly related, but surprisingly, they are addressed independently without making use of their duality in prior works. Therefore, in this article, we propose to solve these two tasks in a dual learning framework. Our contributions are fourfold: (1) We propose a dual learning framework for ERC and ERG. (2) Within the proposed framework, two models can be trained jointly, so that the duality between them can be utilised. (3) Instead of a symmetric framework that deals with two tasks of the same data domain, we propose a dual learning framework that performs on a pair of asymmetric input and output spaces, i.e., the natural language space and the emotion labels. (4) Experiments are conducted on benchmark datasets to demonstrate the effectiveness of our framework.
引用
收藏
页码:1241 / 1252
页数:12
相关论文
共 50 条
  • [41] Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction
    Wei, Wei
    Liu, Jiayi
    Mao, Xianling
    Guo, Guibing
    Zhu, Feida
    Zhou, Pan
    Hu, Yuchong
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 1401 - 1410
  • [42] Neural Emotional Response Generation via Adversarial Transfer Learning
    Gu, Xiusen
    Xu, Weiran
    Zhang, Chao
    3RD INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE (ICIAI 2019), 2019, : 106 - 110
  • [43] Deep learning-based dimensional emotion recognition for conversational agent-based cognitive behavioral therapy
    Striegl, Julian
    Richter, Jordan Wenzel
    Grossmann, Leoni
    Brastad, Bjorn
    Gotthardt, Marie
    Ruck, Christian
    Wallert, John
    Loitsch, Claudia
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [44] Chinese Emotional Dialogue Response Generation via Reinforcement Learning
    Lan, Rushi
    Wang, Jing
    Huang, Wenming
    Deng, Zhenrong
    Sun, Xiyan
    Chen, Zhuo
    Luo, Xiaonan
    ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2021, 21 (04)
  • [45] Emotion Recognition of Conversational Affective Speech Using Temporal Course Modeling
    Lin, Jen-Chun
    Wu, Chung-Hsien
    Wei, Wen-Li
    14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 1335 - 1339
  • [46] Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition
    Li, Bobo
    Fei, Hao
    Liao, Lizi
    Zhao, Yu
    Teng, Chong
    Chua, Tat-Seng
    Ji, Donghong
    Li, Fei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5923 - 5934
  • [47] Performance analysis of acoustic emotion recognition for in-car conversational interfaces
    Jones, Christian Martyn
    Jonsson, Ing-Marie
    Universal Access in Human-Computer Interaction: Ambient Interaction, Pt 2, Proceedings, 2007, 4555 : 411 - 420
  • [48] Response to "uncertainty in emotion recognition"
    Gabriels, Katleen
    JOURNAL OF INFORMATION COMMUNICATION & ETHICS IN SOCIETY, 2019, 17 (03): : 295 - 298
  • [49] Deep learning based response generation using emotion feature extraction
    Lee, Young-Jun
    Choi, Ho-Jin
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 255 - 262
  • [50] Learning Polynomial Function Based Neutral-Emotion GMM Transformation for Emotional Speaker Recognition
    Shan, Zhenyu
    Yang, Yingchun
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 1822 - 1825