Do You Know My Emotion? Emotion-Aware Strategy Recognition Towards a Persuasive Dialogue System

被引:0
|
作者
Peng, Wei [1 ,2 ]
Hu, Yue [1 ,2 ]
Xing, Luxi [1 ,2 ]
Xie, Yuqiang [1 ,2 ]
Sun, Yajing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Persuasive dialogue; Emotional feedback; Strategy recognition;
D O I
10.1007/978-3-031-26390-3_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Persuasive strategy recognition task requires the system to recognize the adopted strategy of the persuader according to the conversation. However, previous methods mainly focus on the contextual information, little is known about incorporating the psychological feedback, i.e. emotion of the persuadee, to predict the strategy. In this paper, we propose a Cross-channel Feedback memOry Network (CFO-Net) to leverage the emotional feedback to iteratively measure the potential benefits of strategies and incorporate them into the contextual-aware dialogue information. Specifically, CFO-Net designs a feedback memory module, including strategy pool and feedback pool, to obtain emotion-aware strategy representation. The strategy pool aims to store historical strategies and the feedback pool is to obtain updated strategy weight based on feedback emotional information. Furthermore, a cross-channel fusion predictor is developed to make a mutual interaction between the emotion-aware strategy representation and the contextual-aware dialogue information for strategy recognition. Experimental results on PersuasionForGood confirm that the proposed model CFO-Net is effective to improve the performance on M-F1 from 61.74 to 65.41.
引用
收藏
页码:724 / 739
页数:16
相关论文
共 50 条
  • [41] Let IoT Know You Better: User Identification and Emotion Recognition Through Millimeter-Wave Sensing
    Yin, Huanpu
    Yu, Shuhui
    Zhang, Yingshuo
    Zhou, Anfu
    Wang, Xin
    Liu, Liang
    Ma, Huadong
    Liu, Jianhua
    Yang, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (02): : 1149 - 1161
  • [42] MPAF-CNN: Multiperspective aware and fine-grained fusion strategy for speech emotion recognition
    Li, Guoyan
    Hou, Junjie
    Liu, Yi
    Wei, Jianguo
    APPLIED ACOUSTICS, 2023, 214
  • [43] Smart Affect Monitoring With Wearables in the Wild: An Unobtrusive Mood-Aware Emotion Recognition System
    Can, Yekta Said
    Ersoy, Cem
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 2851 - 2863
  • [44] I Enjoy Writing and Playing, Do You?: A Personalized and Emotion Grounded Dialogue Agent Using Generative Adversarial Network
    Firdaus, Mauajama
    Thangavelu, Naveen
    Ekbal, Asif
    Bhattacharyya, Pushpak
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2127 - 2138
  • [45] Emotions 'In the Wild' of Emergency Cali Center Callers: Towards a Speech Emotion Recognition System
    Devillers, Laurence
    Deschamps-Berger, Theo
    Lamel, Lori
    LANGAGES, 2024, (234) : 117 - +
  • [46] Emotion recognition using bio-sensors: First steps towards an automatic system
    Haag, A
    Goronzy, S
    Schaich, P
    Williams, J
    AFFECTIVE DIALOGUE SYSTEMS, PROCEEDINGS, 2004, 3068 : 36 - 48
  • [47] Towards a Multimodal Emotion Recognition Framework to Be Integrated in a Computer Based Speech Therapy System
    Schipor, Ovidiu-Andrei
    Pentiuc, Stefan-Gheorghe
    Schipor, Maria-Doina
    2011 6TH CONFERENCE ON SPEECH TECHNOLOGY AND HUMAN-COMPUTER DIALOGUE (SPED), 2011,
  • [48] Combining Electrodermal Activity and Speech Analysis towards a more Accurate Emotion Recognition System
    Greco, Alberto
    Marzi, Claudia
    Lanata, Antonio
    Scilingo, Enzo Pasquale
    Vanello, Nicola
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 229 - 232
  • [49] Can you smell my stress? Influence of stress chemosignals on empathy and emotion recognition in depressed individuals and healthy controls
    Wunder, Annkatrin
    Ludwig, Janina
    Haertl, Tobias
    Arnhardt, Sally
    Schwinn, Leo
    Chellapandian, Deepak Charles
    Weinmair, Elisabeth
    Muehle, Christiane
    Thuerauf, Norbert
    Kornhuber, Johannes
    Rohleder, Nicolas
    Loos, Helene M.
    Freiherr, Jessica
    PHYSIOLOGY & BEHAVIOR, 2023, 270
  • [50] Troi: Towards Understanding Users Perspectives to Mobile Automatic Emotion Recognition System in Their Natural Setting
    Dissanayake V.
    Tang V.
    Elvitigala D.S.
    Wen E.
    Wu M.
    Nanayakkara S.
    Proceedings of the ACM on Human-Computer Interaction, 2022, 6 (MHCI)