Dialogue summarization enhanced response generation for multi-domain task-oriented dialogue systems

被引:4
|
作者
Wang, Lifang [1 ]
Zhao, Meng [1 ]
Ji, Hongru [1 ]
Jiang, Zejun [1 ]
Li, Ronghan [1 ]
Hu, Zhongtian [2 ]
Lu, Xinyu [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian, Peoples R China
关键词
Task-oriented dialogue system; Dialogue summarization; Response generation; Pre-trained language model;
D O I
10.1016/j.ipm.2024.103668
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Task -oriented dialogue systems (TOD) are blossoming with the advances in pre -trained language models (PrLM). Recently, research on PrLM-based multi -domain TOD has arisen with many outstanding outcomes. However, three challenges still need to be thoroughly studied. First, most current works regard dialogue state tracking as a generative problem supervised by concatenated slot -value sequences, impairing the models' domain adaption because of the discrepancy between PrLM's natural text inputs and spliced slot -value spans. Second, most existing works seldom specifically consider how to deal with long and involved dialogue history caused by multiple task domains. Third, few studies are concerned with enhancing the model's reasoning ability to handle intricate contexts. To alleviate these issues, we propose a dialogue summarization enhanced response generation framework for multi -domain TOD. Specifically, we offer a novel summarization model that employs the query and the generated summarization from the previous turn to obtain beneficial information for the current turn, which is then combined with the entire dialogue history to produce the final summary. Then, the generated dialogue summarization is fed to the response decoder as dialogue states and key dialogue histories through the designed dynamic fusion mechanism to yield responses. Experimental results indicate that the proposed model for response generation task outperforms the baseline models in both automatic and human evaluations on two public datasets.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Mutually improved response generation and dialogue summarization for multi-domain task-oriented dialogue systems
    Zhao, Meng
    Wang, Lifang
    Ji, Hongru
    Jiang, Zejun
    Li, Ronghan
    Lu, Xinyu
    Hu, Zhongtian
    KNOWLEDGE-BASED SYSTEMS, 2023, 279
  • [2] Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems
    Wu, Chien-Sheng
    Madotto, Andrea
    Hosseini-Asl, Ehsan
    Xiong, Caiming
    Socher, Richard
    Fung, Pascale
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 808 - 819
  • [3] Multi-task learning with graph attention networks for multi-domain task-oriented dialogue systems
    Zhao, Meng
    Wang, Lifang
    Jiang, Zejun
    Li, Ronghan
    Lu, Xinyu
    Hu, Zhongtian
    KNOWLEDGE-BASED SYSTEMS, 2023, 259
  • [4] Advances and Challenges in Multi-Domain Task-Oriented Dialogue Policy Optimization
    Rohmatillah, Mahdin
    Chien, Jen-Tzung
    APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2023, 12 (01)
  • [5] Multi-domain Language Understanding of Task-Oriented Dialogue Based on Intent Enhancement
    Yu, Feng
    Zheng, Dequan
    Zhao, Xiaotian
    2020 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2020), 2020, : 221 - 228
  • [6] MDKB-Bot: A Practical Framework for Multi-Domain Task-Oriented Dialogue System
    Lao, Yadi
    Liu, Weijie
    Gao, Sheng
    Li, Si
    DATA INTELLIGENCE, 2019, 1 (02) : 176 - 186
  • [7] MDKB-Bot: A Practical Framework for Multi-Domain Task-Oriented Dialogue System
    Yadi Lao
    Weijie Liu
    Sheng Gao
    Si Li
    Data Intelligence, 2019, 1 (02) : 176 - 186
  • [8] MatDC: A Multi-turn Multi-domain Annotated Task-oriented Dialogue Dataset in Chinese
    Tseng, Yu-Hsiang
    Hsieh, Shu-Kai
    Lian, Richard
    Chiang, Chiung-Yu
    Chang, Yu-Lin
    Chang, Li-Ping
    Hsieh, Ji-Lung
    2020 25TH INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2020), 2020, : 165 - 170
  • [9] Intention Reasoning Network for Multi-Domain End-to-end Task-Oriented Dialogue
    Ma, Zhiyuan
    Li, Jianjun
    Zhang, Zezheng
    Li, Guohui
    Cheng, Yongjing
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 2273 - 2285
  • [10] RETRIEVAL ENHANCED SEGMENT GENERATION NEURAL NETWORK FOR TASK-ORIENTED DIALOGUE SYSTEMS
    Chen, Miaoxin
    Lin, Zibo
    Sun, Rongyi
    Ouyang, Kai
    Zheng, Hai-Tao
    Xie, Rui
    Wu, Wei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6592 - 6596