Code -Style In -Context Learning for Knowledge -Based Question Answering

被引:0
|
作者
Nie, Zhijie [1 ,3 ]
Zhang, Richong [1 ,2 ]
Wang, Zhongyuan [1 ]
Liu, Xudong [1 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, SKLSDE, Beijing, Peoples R China
[2] Zhongguancun Lab, Beijing, Peoples R China
[3] Beihang Univ, Shen Yuan Honors Coll, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current methods for Knowledge -Based Question Answering (KBQA) usually rely on complex training techniques and model frameworks, leading to many limitations in practical applications. Recently, the emergence of In-Context Learning (ICL) capabilities in Large Language Models (LLMs) provides a simple and training -free semantic parsing paradigm for KBQA: Given a small number of questions and their labeled logical forms as demo examples, LLMs can understand the task intent and generate the logic form for a new question. However, current powerful LLMs have little exposure to logic forms during pre -training, resulting in a high format error rate. To solve this problem, we propose a code-style in -context learning method for KBQA, which converts the generation process of unfamiliar logical form into the more familiar code generation process for LLMs. Experimental results on three mainstream datasets show that our method dramatically mitigated the formatting error problem in generating logic forms while realizing a new SOTA on WebQSP, GrailQA, and GraphQ under the few -shot setting. The code and supplementary files are released at https://github.com/ Arthurizij ar/KB - Coder.
引用
收藏
页码:18833 / 18841
页数:9
相关论文
共 50 条
  • [1] Code-Style In-Context Learning for Knowledge-Based Question Answering
    Nie, Zhijie
    Zhang, Richong
    Wang, Zhongyuan
    Liu, Xudong
    [J]. arXiv, 2023,
  • [2] Discourse processing for context question answering based on linguistic knowledge
    Sun, Mingyu
    Chai, Joyce Y.
    [J]. KNOWLEDGE-BASED SYSTEMS, 2007, 20 (06) : 511 - 526
  • [3] Few-shot In-context Learning for Knowledge Base Question Answering
    Li, Tianle
    Ma, Xueguang
    Zhuang, Alex
    Gu, Yu
    Su, Yu
    Chen, Wenhu
    [J]. PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 6966 - 6980
  • [4] Knowledge Base Question Answering Based on Deep Learning Models
    Xie, Zhiwen
    Zeng, Zhao
    Zhou, Guangyou
    He, Tingting
    [J]. NATURAL LANGUAGE UNDERSTANDING AND INTELLIGENT APPLICATIONS (NLPCC 2016), 2016, 10102 : 300 - 311
  • [5] Fusing Context Into Knowledge Graph for Commonsense Question Answering
    Xu, Yichong
    Zhu, Chenguang
    Xu, Ruochen
    Liu, Yang
    Zeng, Michael
    Huang, Xuedong
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1201 - 1207
  • [6] Contrastive Learning with Keyword-based Data Augmentation for Code Search and Code Question Answering
    Park, Shinwoo
    Kim, Youngwook
    Han, Yo-Sub
    [J]. 17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3609 - 3619
  • [7] Knowledge-based question answering
    Rinaldi, F
    Dowdall, J
    Hess, M
    Mollá, D
    Schwitter, R
    Kaljurand, K
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2003, 2773 : 785 - 792
  • [8] Knowledge-based question answering
    Hermjakob, U
    Hovy, EH
    Lin, CY
    [J]. 6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL XVI, PROCEEDINGS: COMPUTER SCIENCE III, 2002, : 66 - 71
  • [9] Explainable Knowledge-Based Learning for Online Medical Question Answering
    Cui, Menglin
    Li, Xiang
    Qin, Peng
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT V, KSEM 2024, 2024, 14888 : 294 - 304
  • [10] Knowledge Graph Question Answering based on Contrastive Learning and Feature Transformation
    Hu, Xinrong
    Huang, Jingjing
    Liu, Junping
    Zhu, Qiang
    Yang, Jie
    [J]. 2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY COMPANION, QRS-C, 2022, : 608 - 615