Dual view graph transformer networks for multi-hop knowledge graph reasoning

被引:0
|
作者
Sun, Congcong [1 ]
Chen, Jianrui [1 ,2 ]
Shao, Zhongshi [1 ]
Huang, Junjie [3 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710119, Peoples R China
[2] Minist Educ China, Key Lab Modern Teaching Technol, Xian 710119, Peoples R China
[3] Inner Mongolia Univ, Sch Math Sci, Hohhot 010021, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graphs; Multi-hop reasoning; Reinforcement learning; Dual-view framework;
D O I
10.1016/j.neunet.2025.107260
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To address the incompleteness of knowledge graphs, multi-hop reasoning aims to find the unknown information from existing data and enhance the comprehensive understanding. The presence of reasoning paths endows multi-hop reasoning with interpretability and traceability. Existing reinforcement learning (RL)-based multi- hop reasoning methods primarily rely on the agent's blind trial-and-error approach in a large search space, which leads to inefficient training. In contrast, sequence-based multi-hop reasoning methods focus on learning the mapping from path to path to achieve better training efficiency, but they discard structured knowledge. The absence of structured knowledge directly hinders the ablity to capture and represent complex relations. To address the above issues, we propose a Dual View Graph Transformer Networks for Multi-hop Knowledge Graph Reasoning (DV4KGR), which enables the joint learning of structured and serialized views. The structured view contains a large amount of structured knowledge, which represents the relations among nodes from a global perspective. Meanwhile, the serialized view contains rich knowledge of reasoning semantics, aiding in training the mapping function from reasoning states to reasoning paths. We learn the representations of one-to-many relations in a supervised contrastive learning manner, which enhances the ability to represent complex relations. Additionally, we combine structured knowledge and rule induction for action smoothing, which effectively alleviates the overfitting problem associated with the end-to-end training mode. The experimental results on four benchmark datasets demonstrate that DV4KGR delivers better performance than the state-of-the-art baselines.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Multi-Hop Knowledge Graph Reasoning with Reward Shaping
    Lin, Xi Victoria
    Socher, Richard
    Xiong, Caiming
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3243 - 3253
  • [2] Multi-Hop Reasoning for Question Answering with Knowledge Graph
    Zhang, Jiayuan
    Cai, Yifei
    Zhang, Qian
    Cao, Zehao
    Cheng, Zhenrong
    Li, Dongmei
    Meng, Xianghao
    2021 IEEE/ACIS 20TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2021-SUMMER), 2021, : 121 - 125
  • [3] CogKR: Cognitive Graph for Multi-Hop Knowledge Reasoning
    Du, Zhengxiao
    Zhou, Chang
    Yao, Jiangchao
    Tu, Teng
    Cheng, Letian
    Yang, Hongxia
    Zhou, Jingren
    Tang, Jie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1283 - 1295
  • [4] GaussianPath:A Bayesian Multi-Hop Reasoning Framework for Knowledge Graph Reasoning
    Wan, Guojia
    Du, Bo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4393 - 4401
  • [5] ExKGR: Explainable Multi-hop Reasoning for Evolving Knowledge Graph
    Yan, Cheng
    Zhao, Feng
    Jin, Hai
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 153 - 161
  • [6] Attention-based Multi-hop Reasoning for Knowledge Graph
    Wang, Zikang
    Li, Linjing
    Zeng, Daniel Dajun
    Chen, Yue
    2018 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS (ISI), 2018, : 211 - 213
  • [7] Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph
    Ji, Haozhe
    Ke, Pei
    Huang, Shaohan
    Wei, Furu
    Zhu, Xiaoyan
    Huang, Minlie
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 725 - 736
  • [8] Multi-hop Knowledge Graph Reasoning Based on Hyperbolic Knowledge Graph Embedding and Reinforcement Learning
    Zhou, Xingchen
    Wang, Peng
    Luo, Qiqing
    Pan, Zhe
    PROCEEDINGS OF THE 10TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE GRAPHS (IJCKG 2021), 2021, : 1 - 9
  • [9] Hierarchical Knowledge-Enhancement Framework for multi-hop knowledge graph reasoning
    Xie, Shaorong
    Liu, Ruishen
    Wang, Xinzhi
    Luo, Xiangfeng
    Sugumaran, Vijayan
    Yu, Hang
    NEUROCOMPUTING, 2024, 588
  • [10] SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs
    Ren, Hongyu
    Dai, Hanjun
    Dai, Bo
    Chen, Xinyun
    Zhou, Denny
    Leskovec, Jure
    Schuurmans, Dale
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1472 - 1482