Enhanced Simple Question Answering with Contrastive Learning

被引:0
|
作者
Wang, Xin [1 ]
Yang, Lan [2 ]
He, Honglian [1 ]
Fang, Yu [1 ]
Zhan, Huayi [2 ]
Zhang, Ji [3 ]
机构
[1] Southwest Petr Univ, Chengdu, Peoples R China
[2] Sichuan Changhong Elect Co Ltd, Mianyang, Sichuan, Peoples R China
[3] Univ Southern Queensland, Toowoomba, Qld, Australia
关键词
Knowledge base; Question answering; Contrastive learning; Transfer learning; Pre-trained model;
D O I
10.1007/978-3-031-10983-6_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Answer natural language questions on knowledge bases (KBQA) has attracted wide attention. Several techniques have been developed for answering simple questions. These techniques mostly rely on deep networks to perform classification for relation prediction. Nowadays, contrastive learning has shown its powers in improving performances of classification, while most prior techniques do not gain benefit from this. In light of these, we propose a novel approach to answering simple questions on knowledge bases. Our approach has two key features. (1) It leverages pre-trained transformers to gain better performance on entity linking. (2) It employs a contrastive learning based model for relation prediction. We experimentally verify the performance of our approach, and show that our approach achieves an accuracy of 83.54%, which beats existing state-of-the-art techniques, on a typical benchmark dataset; we also conduct a deep analysis to show advantages of our technique, especially its sub-modules.
引用
收藏
页码:502 / 515
页数:14
相关论文
共 50 条
  • [1] Simple contrastive learning in a self-supervised manner for robust visual question answering
    Yang, Shuwen
    Xiao, Luwei
    Wu, Xingjiao
    Xu, Junjie
    Wang, Linlin
    He, Liang
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241
  • [2] Bidirectional Contrastive Split Learning for Visual Question Answering
    Sun, Yuwei
    Ochiai, Hideya
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 19, 2024, : 21602 - 21609
  • [3] Long Context Question Answering via Supervised Contrastive Learning
    Caciularu, Avi
    Dagan, Ido
    Goldberger, Jacob
    Cohan, Arman
    [J]. NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 2872 - 2879
  • [4] Multi-level Contrastive Learning for Commonsense Question Answering
    Fang, Quntian
    Huang, Zhen
    Zhang, Ziwen
    Hu, Minghao
    Hu, Biao
    Wang, Ankun
    Li, Dongsheng
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023, 2023, 14120 : 318 - 331
  • [5] Knowledge Graph Question Answering based on Contrastive Learning and Feature Transformation
    Hu, Xinrong
    Huang, Jingjing
    Liu, Junping
    Zhu, Qiang
    Yang, Jie
    [J]. 2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY COMPANION, QRS-C, 2022, : 608 - 615
  • [6] Medical Visual Question Answering via Conditional Reasoning and Contrastive Learning
    Liu, Bo
    Zhan, Li-Ming
    Xu, Li
    Wu, Xiao-Ming
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1532 - 1545
  • [7] Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs
    Kacupaj, Endri
    Singh, Kuldeep
    Maleshkova, Maria
    Lehmann, Jens
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 925 - 934
  • [8] Self-supervised Graph Contrastive Learning for Video Question Answering
    Yao X.
    Gao J.-Y.
    Xu C.-S.
    [J]. Ruan Jian Xue Bao/Journal of Software, 2023, 34 (05): : 2083 - 2100
  • [9] HCCL: Hierarchical Counterfactual Contrastive Learning for Robust Visual Question Answering
    Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, China
    不详
    [J]. ACM Trans. Multimedia Comput. Commun. Appl., 2024, 10
  • [10] Simple Question Answering over Knowledge Graph Enhanced by Question Pattern Classification
    Cui, Hai
    Peng, Tao
    Feng, Lizhou
    Bao, Tie
    Liu, Lu
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2021, 63 (10) : 2741 - 2761