Dual view graph transformer networks for multi-hop knowledge graph reasoning

被引:0
|
作者
Sun, Congcong [1 ]
Chen, Jianrui [1 ,2 ]
Shao, Zhongshi [1 ]
Huang, Junjie [3 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710119, Peoples R China
[2] Minist Educ China, Key Lab Modern Teaching Technol, Xian 710119, Peoples R China
[3] Inner Mongolia Univ, Sch Math Sci, Hohhot 010021, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graphs; Multi-hop reasoning; Reinforcement learning; Dual-view framework;
D O I
10.1016/j.neunet.2025.107260
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To address the incompleteness of knowledge graphs, multi-hop reasoning aims to find the unknown information from existing data and enhance the comprehensive understanding. The presence of reasoning paths endows multi-hop reasoning with interpretability and traceability. Existing reinforcement learning (RL)-based multi- hop reasoning methods primarily rely on the agent's blind trial-and-error approach in a large search space, which leads to inefficient training. In contrast, sequence-based multi-hop reasoning methods focus on learning the mapping from path to path to achieve better training efficiency, but they discard structured knowledge. The absence of structured knowledge directly hinders the ablity to capture and represent complex relations. To address the above issues, we propose a Dual View Graph Transformer Networks for Multi-hop Knowledge Graph Reasoning (DV4KGR), which enables the joint learning of structured and serialized views. The structured view contains a large amount of structured knowledge, which represents the relations among nodes from a global perspective. Meanwhile, the serialized view contains rich knowledge of reasoning semantics, aiding in training the mapping function from reasoning states to reasoning paths. We learn the representations of one-to-many relations in a supervised contrastive learning manner, which enhances the ability to represent complex relations. Additionally, we combine structured knowledge and rule induction for action smoothing, which effectively alleviates the overfitting problem associated with the end-to-end training mode. The experimental results on four benchmark datasets demonstrate that DV4KGR delivers better performance than the state-of-the-art baselines.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph
    Lv, Xin
    Han, Xu
    Hou, Lei
    Li, Juanzi
    Liu, Zhiyuan
    Zhang, Wei
    Zhang, Yichi
    Kong, Hao
    Wu, Suhui
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 5694 - 5703
  • [22] Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques
    Li, Chen
    Zheng, Haotian
    Sun, Yiping
    Wang, Cangqing
    Yu, Liqiang
    Chang, Che
    Tian, Xinyu
    Liu, Bo
    2024 4th International Conference on Machine Learning and Intelligent Systems Engineering, MLISE 2024, 2024, : 1 - 5
  • [23] HiAM: A Hierarchical Attention based Model for knowledge graph multi-hop reasoning
    Ma, Ting
    Lv, Shangwen
    Huang, Longtao
    Hu, Songlin
    NEURAL NETWORKS, 2021, 143 : 261 - 270
  • [24] Reasoning Path Generation for Answering Multi-hop Questions Over Knowledge Graph
    Xiang, Yuxuan
    Wu, Jiajun
    Wang, Tiexin
    Wang, Meng
    Dai, Tianlun
    Wang, Gaoxu
    Xu, Shidong
    Li, Jing
    WEB AND BIG DATA, PT II, APWEB-WAIM 2022, 2023, 13422 : 195 - 209
  • [25] Dynamically Fused Graph Network for Multi-hop Reasoning
    Qiu, Lin
    Xiao, Yunxuan
    Qu, Yanru
    Zhou, Hao
    Li, Lei
    Zhang, Weinan
    Yu, Yong
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 6140 - 6150
  • [26] Multi-hop Attention Graph Neural Networks
    Wang, Guangtao
    Ying, Rex
    Huang, Jing
    Leskovec, Jure
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3089 - 3096
  • [27] Multi-hop Hierarchical Graph Neural Networks
    Xue, Hui
    Sun, Xin-Kai
    Sun, Wei-Xiang
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 82 - 89
  • [28] Path Spuriousness-aware Reinforcement Learning for Multi-Hop Knowledge Graph Reasoning
    Jiang, Chunyang
    Zhu, Tianchen
    Zhou, Haoyi
    Liu, Chang
    Deng, Ting
    Hu, Chunming
    Li, Jianxin
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3181 - 3192
  • [29] Step by step: A hierarchical framework for multi-hop knowledge graph reasoning with reinforcement learning
    Zhu, Anjie
    Ouyang, Deqiang
    Liang, Shuang
    Shao, Jie
    KNOWLEDGE-BASED SYSTEMS, 2022, 248
  • [30] Attention-based exploitation and exploration strategy for multi-hop knowledge graph reasoning
    Shang, Bin
    Zhao, Yinliang
    Liu, Yifan
    Wang, Chenxin
    INFORMATION SCIENCES, 2024, 653