Hierarchical Knowledge-Enhancement Framework for multi-hop knowledge graph reasoning

被引:0
|
作者
Xie, Shaorong [1 ]
Liu, Ruishen [1 ]
Wang, Xinzhi
Luo, Xiangfeng [1 ]
Sugumaran, Vijayan [2 ]
Yu, Hang [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
[2] Oakland Univ, Dept Decis & Informat Sci, Rochester, MI 48309 USA
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Sparse knowledge graph; Multi-hop reasoning; Hierarchical reinforcement learning;
D O I
10.1016/j.neucom.2024.127673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -hop reasoning has gained significant attention in the area of knowledge graph completion, intending to predict missing facts through existing knowledge. However, due to sparsity knowledge and lack of reachable paths for the model to make sensible decisions, most multi -hop reasoning models suffer from degradation performance on the sparse knowledge graphs (KGs). Faced with this challenge, we propose the Hierarchical Knowledge -Enhancement Framework (Hi-KnowE), which improves reasoning performance over sparse KGs by conducting hierarchical dynamic path completion under various background knowledge guidance. Hi-KnowE is based on hierarchical reinforcement learning, breaking the task into high-level and low-level processes. Firstly, we apply high-level policy to reason relations and the relation action space is enlarged under rule guidance. Secondly, tail entities are obtained by low-level policy and semantic knowledge is used to refine the entity action space. The sparsity problem is alleviated by generating reliable information. Moreover, we introduce rule -based inner attention, adopting the overall semantics of relevant rules to assist agent reasoning. This strategy makes the path for the agent more logical and flexible. We further evaluate Hi-KnowE on four sparse datasets extracted from Wikidata and FreeBase. The results outperform the baseline models, demonstrating improvements of up to 1.5% and 1.9% in MRR and Hit@10.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] GaussianPath:A Bayesian Multi-Hop Reasoning Framework for Knowledge Graph Reasoning
    Wan, Guojia
    Du, Bo
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4393 - 4401
  • [2] Step by step: A hierarchical framework for multi-hop knowledge graph reasoning with reinforcement learning
    Zhu, Anjie
    Ouyang, Deqiang
    Liang, Shuang
    Shao, Jie
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 248
  • [3] ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning
    Dengao Li
    Shuyi Miao
    Baofeng Zhao
    Yu Zhou
    Ding Feng
    Jumin Zhao
    Xupeng Niu
    [J]. International Journal of Machine Learning and Cybernetics, 2023, 14 : 2301 - 2315
  • [4] ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning
    Li, Dengao
    Miao, Shuyi
    Zhao, Baofeng
    Zhou, Yu
    Feng, Ding
    Zhao, Jumin
    Niu, Xupeng
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (07) : 2301 - 2315
  • [5] HiAM: A Hierarchical Attention based Model for knowledge graph multi-hop reasoning
    Ma, Ting
    Lv, Shangwen
    Huang, Longtao
    Hu, Songlin
    [J]. NEURAL NETWORKS, 2021, 143 : 261 - 270
  • [6] Multi-Hop Reasoning for Question Answering with Knowledge Graph
    Zhang, Jiayuan
    Cai, Yifei
    Zhang, Qian
    Cao, Zehao
    Cheng, Zhenrong
    Li, Dongmei
    Meng, Xianghao
    [J]. 2021 IEEE/ACIS 20TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2021-SUMMER), 2021, : 121 - 125
  • [7] Multi-Hop Knowledge Graph Reasoning with Reward Shaping
    Lin, Xi Victoria
    Socher, Richard
    Xiong, Caiming
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3243 - 3253
  • [8] CogKR: Cognitive Graph for Multi-Hop Knowledge Reasoning
    Du, Zhengxiao
    Zhou, Chang
    Yao, Jiangchao
    Tu, Teng
    Cheng, Letian
    Yang, Hongxia
    Zhou, Jingren
    Tang, Jie
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1283 - 1295
  • [9] SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs
    Ren, Hongyu
    Dai, Hanjun
    Dai, Bo
    Chen, Xinyun
    Zhou, Denny
    Leskovec, Jure
    Schuurmans, Dale
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1472 - 1482
  • [10] Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph
    Ji, Haozhe
    Ke, Pei
    Huang, Shaohan
    Wei, Furu
    Zhu, Xiaoyan
    Huang, Minlie
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 725 - 736