A New Multi-level Knowledge Retrieval Model for Task-Oriented Dialogue

被引:0
|
作者
Dong, Xuelian [1 ]
Chen, Jiale [1 ]
Weng, Heng [2 ]
Chen, Zili [3 ]
Wang, Fu Lee [4 ]
Hao, Tianyong [1 ,5 ]
机构
[1] South China Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[2] Guangzhou Univ Chinese Med, Affiliated Hosp 2, Guangzhou, Peoples R China
[3] Hong Kong Polytech Univ, Coll Profess & Continuing Educ, Hong Kong, Peoples R China
[4] Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China
[5] Guangzhou WisTalk Informat Technol Co Ltd, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge retrieval; Task-oriented dialogue; Large language model;
D O I
10.1007/978-981-97-7007-6_4
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
One of the main challenges in task-oriented dialogue systems is how to retrieve accurate knowledge from external knowledge bases. Existing methods usually retrieve knowledge and entire entity by utilizing dialogue context, while the correlations between dialogue context and entity attributes are overlook, leading suboptimal knowledge retrieval. Therefore, we introduce a Multi-Level knowledge retrieval model for Task-Oriented Dialogue (MLTOD) consisted of an entity retriever, an attribute retriever, a ranker and a response generator. The entity retriever retrieved entities from knowledge bases and the attribute retriever extracts relevant attributes respectively. The ranker dynamically combines the results from the retrievers to select the most relevant knowledge entities. Then the response generator generates final system response based on the ranking result. In addition, this paper introduces a novel multi-level retrieval mechanism. It considers both entity level and attribute level relevance for coarse to fine knowledge retrieval. Experiments on two publicly available datasets show that our MLTOD model outperforms existing state-of-the-art baseline approaches, validating its effectiveness for task-oriented dialogue.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 50 条
  • [21] Prompting, Retrieval, Training: An exploration of different approaches for task-oriented dialogue generation
    Raposo, Goncalo
    Coheur, Luisa
    Martins, Bruno
    24TH MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE, SIGDIAL 2023, 2023, : 400 - 412
  • [22] RETRIEVAL ENHANCED SEGMENT GENERATION NEURAL NETWORK FOR TASK-ORIENTED DIALOGUE SYSTEMS
    Chen, Miaoxin
    Lin, Zibo
    Sun, Rongyi
    Ouyang, Kai
    Zheng, Hai-Tao
    Xie, Rui
    Wu, Wei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6592 - 6596
  • [23] From Retrieval to Generation: A Simple and Unified Generative Model for End-to-End Task-Oriented Dialogue
    Ding, Zeyuan
    Yang, Zhihao
    Luo, Ling
    Sun, Yuanyuan
    Lin, Hongfei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 17907 - 17914
  • [24] FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue
    Zeng, Weihao
    He, Keqing
    Wang, Yejie
    Zeng, Chen
    Wang, Jingang
    Xian, Yunsen
    Xu, Weiran
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 6532 - 6546
  • [25] A Task-Oriented Multi-turn Dialogue Mechanism for the Smart Cockpit
    Yang, Xiaoyu
    Sheng, Xinyi
    Gu, Jinguang
    WEB AND BIG DATA, PT II, APWEB-WAIM 2023, 2024, 14332 : 316 - 330
  • [26] Research on Models for Multi-turn Task-oriented Dialogue Systems
    Qiu, Jie
    Wang, Peng
    Gou, Jianguo
    Qiu, Junying
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5439 - 5444
  • [27] A multi-agent collaborative algorithm for task-oriented dialogue systems
    Sun, Jingtao
    Kou, Jiayin
    Shi, Weipeng
    Hou, Wenyan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025, 16 (03) : 2009 - 2022
  • [28] Multi-Level Memory for Task Oriented Dialogs
    Reddy, Revanth
    Contractor, Danish
    Raghu, Dinesh
    Joshi, Sachindra
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 3744 - 3754
  • [29] Incorporating Specific Knowledge into End-to-End Task-oriented Dialogue Systems
    Wang, Qingyue
    Cao, Yanan
    Jiang, Junyan
    Wang, Yafang
    Tong, Lingling
    Guo, Li
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [30] A rich task-oriented dialogue corpus in Vietnamese
    Tho Chi Luong
    Phuong Le-Hong
    Oanh Thi Tran
    LANGUAGE RESOURCES AND EVALUATION, 2023, 57 (04) : 1767 - 1786