Dual Learning for Conversational Emotion Recognition and Emotional Response Generation

被引:0
|
作者
Zhang, Shuhe [1 ]
Hu, Haifeng [1 ]
Xing, Songlong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510275, Peoples R China
基金
中国国家自然科学基金;
关键词
Conversational AI; dialogue system; dual learning; emotion recognition; human-machine interaction;
D O I
10.1109/TAFFC.2023.3332631
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition in conversation (ERC) and emotional response generation (ERG) are two important NLP tasks. ERC aims to detect the utterance-level emotion from a dialogue, while ERG focuses on expressing a desired emotion. Essentially, ERC is a classification task, with its input and output domains being the utterance text and emotion labels, respectively. On the other hand, ERG is a generation task with its input and output domains being the opposite. These two tasks are highly related, but surprisingly, they are addressed independently without making use of their duality in prior works. Therefore, in this article, we propose to solve these two tasks in a dual learning framework. Our contributions are fourfold: (1) We propose a dual learning framework for ERC and ERG. (2) Within the proposed framework, two models can be trained jointly, so that the duality between them can be utilised. (3) Instead of a symmetric framework that deals with two tasks of the same data domain, we propose a dual learning framework that performs on a pair of asymmetric input and output spaces, i.e., the natural language space and the emotion labels. (4) Experiments are conducted on benchmark datasets to demonstrate the effectiveness of our framework.
引用
收藏
页码:1241 / 1252
页数:12
相关论文
共 50 条
  • [1] Emotion Recognition with Conversational Generation Transfer
    Ma, Hongchao
    Wang, Zhongqing
    Zhou, Xiabing
    Zhou, Guodong
    Zhou, Qinglei
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (04)
  • [2] Conversational transfer learning for emotion recognition
    Hazarika, Devamanyu
    Poria, Soujanya
    Zimmermann, Roger
    Mihalcea, Rada
    INFORMATION FUSION, 2021, 65 : 1 - 12
  • [3] Conversational Emotion Recognition Incorporating Knowledge Graph and Curriculum Learning
    Du J.
    Sun Y.
    Lin H.
    Yang L.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (05): : 1299 - 1309
  • [4] MALN: Multimodal Adversarial Learning Network for Conversational Emotion Recognition
    Ren, Minjie
    Huang, Xiangdong
    Liu, Jing
    Liu, Ming
    Li, Xuanya
    Liu, An-An
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6965 - 6980
  • [5] CDL: Curriculum Dual Learning for Emotion-Controllable Response Generation
    Shen, Lei
    Feng, Yang
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 556 - 566
  • [6] Emotional Climate Recognition in Interactive Conversational Speech Using Deep Learning
    Alhussein, Ghada
    Alkhodari, Mohanad
    Khandokher, Ahsan
    Hadjileontiadis, Leontios J.
    2022 IEEE INTERNATIONAL CONFERENCE ON DIGITAL HEALTH (IEEE ICDH 2022), 2022, : 96 - 103
  • [7] Using learning automata in brain emotional learning for speech emotion recognition
    Farhoudi Z.
    Setayeshi S.
    Rabiee A.
    International Journal of Speech Technology, 2017, 20 (3) : 553 - 562
  • [8] DECN: Dialogical emotion correction network for conversational emotion recognition
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    Liu, Bin, 1600, Elsevier B.V. (454): : 483 - 495
  • [9] EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition
    Li, Zaijing
    Tang, Fengxiao
    Zhao, Ming
    Zhu, Yusen
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 1610 - 1618
  • [10] DECN: Dialogical emotion correction network for conversational emotion recognition
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    NEUROCOMPUTING, 2021, 454 : 483 - 495