Building knowledge-grounded dialogue systems with graph-based semantic modelling

被引:0
|
作者
Yang, Yizhe [1 ,2 ,3 ]
Huang, Heyan [1 ,2 ,3 ]
Gao, Yang [1 ,3 ]
Li, Jiawei [1 ,3 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Southeast Acad Informat Technol, Putian 351100, Fujian, Peoples R China
[3] Beijing Engn Res Ctr High Volume Language Informat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge-grounded dialogue; Knowledge acquisition; Knowledge fusion; Natural language generation;
D O I
10.1016/j.knosys.2024.111943
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The knowledge -grounded dialogue task aims to generate responses that convey information from given knowledge documents. However, it is a challenge for the current sequence -based model to acquire knowledge from complex documents and integrate it to perform correct responses without the aid of an explicit semantic structure. To address these issues, we propose a novel graph structure, Grounded Graph ( G 2 ), that models the semantic structure of both dialogue and knowledge to facilitate knowledge selection and integration for knowledge -grounded dialogue generation. We also propose a Grounded Graph Aware Transformer ( G 2 AT ) model that fuses multi -forms knowledge (both sequential and graphic) to enhance knowledge -grounded response generation. Our experiments results show that our proposed model outperforms the previous stateof-the-art methods with more than 10% gains in response generation and nearly 20% improvement in factual consistency. Further, our model reveals good generalization ability and robustness. By incorporating semantic structures as prior knowledge in deep neural networks, our model provides an effective way to aid language generation.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Heterogeneous graph reasoning for knowledge-grounded medical dialogue system
    Liu, Wenge
    Tang, Jianheng
    Liang, Xiaodan
    Cai, Qingling
    [J]. NEUROCOMPUTING, 2021, 442 : 260 - 268
  • [2] AttnIO: Knowledge Graph Exploration with In-and-Out Attention Flow for Knowledge-Grounded Dialogue
    Jung, Jaehun
    Son, Bokyung
    Lyu, Sungwon
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 3484 - 3497
  • [3] Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
    Li, Yu
    Peng, Baolin
    Shen, Yelong
    Mao, Yi
    Liden, Lars
    Yu, Zhou
    Gao, Jianfeng
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 206 - 218
  • [4] KSRL: Knowledge Selection Based Reinforcement Learning for Knowledge-Grounded Dialogue
    Ma, Zhanyu
    Ye, Jian
    Cheng, Shuang
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023, 2023, 14120 : 189 - 196
  • [5] Knowledge-grounded dialogue modelling with dialogue-state tracking, domain tracking, and entity extraction
    Hong, Taesuk
    Cho, Junhee
    Yu, Haeun
    Ko, Youngjoong
    Seo, Jungyun
    [J]. COMPUTER SPEECH AND LANGUAGE, 2023, 78
  • [6] Approximation of Response Knowledge Retrieval in Knowledge-grounded Dialogue Generation
    Zheng, Wen
    Milic-Frayling, Natasa
    Zhou, Ke
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020,
  • [7] Knowledge-Grounded Dialogue Generation for Medical Conversations: A Survey
    Liu, Xiaoxiao
    Chang, Jian
    Zhang, Jian Jun
    [J]. 2023 27TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION, IV, 2023, : 409 - 413
  • [8] Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable Features
    Rashkin, Hannah
    Reitter, David
    Tomar, Gaurav Singh
    Das Google, Dipanjan
    [J]. 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 704 - 718
  • [9] Exploiting Pairwise Mutual Information for Knowledge-Grounded Dialogue
    Zhang, Bo
    Wang, Jian
    Lin, Hongfei
    Ma, Hui
    Xu, Bo
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 : 2231 - 2240
  • [10] Zero-Resource Knowledge-Grounded Dialogue Generation
    Li, Linxiao
    Xu, Can
    Wu, Wei
    Zhao, Yufan
    Zhao, Xueliang
    Tao, Chongyang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33