Knowledge Graph Reasoning via Dynamic Subgraph Attention with Low Resource Computation

被引:0
|
作者
Wang, Yin [1 ,2 ]
Xia, Nan [1 ,2 ]
Yu, Hang [1 ]
Luo, Xiangfeng [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai, Peoples R China
[2] Shanghai ArtiTech AI Technol Co Ltd, Shanghai, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Knowledge graph reasoning; Dynamic Subgraph Attention; Multi-hop path history; Path-based learning; Embedding-based learning;
D O I
10.1016/j.neucom.2024.127866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs (KGs) suffer from inherent incompleteness, which has spurred research into knowledge graph reasoning (KGR), i.e., ways to infer missing facts based on existing triples. The most prevalent approaches employ a static mechanism for entity representation across the entire graph, sharing entity embeddings for different query relations. Nevertheless, these static entity embeddings fail to capture specific semantics for various query scenarios, resulting in inaccurate entity representations and susceptibility to reasoning errors. Furthermore, the whole graph learning style requires substantial computational resources, especially since KGs are often of large-scale. Consequently, these methods are impractical in low -resource environments. To address these issues, we devise a framework called dynamic subgraph attention (DSA), which learns dynamic entity embeddings for different query relations across subgraphs. In our approach, by utilizing multi -hop path history information obtained through path -based learning, we guide a dynamic attention mechanism to generate dynamic entity embeddings for different query relations. To ensure the semantic information of entities, the embedding -based and path -based learning are jointly trained for KGR. Additionally, the proposed dynamic aggregation mechanism operates on subgraphs, resulting in a remarkable 6-7 times resource conservation compared to GPU computations. Empirical experiments further demonstrate that DSA outperforms the current methods significantly on three benchmark datasets.
引用
下载
收藏
页数:12
相关论文
共 50 条
  • [1] Temporal knowledge graph question answering via subgraph reasoning
    Chen, Ziyang
    Zhao, Xiang
    Liao, Jinzhi
    Li, Xinyi
    Kanoulas, Evangelos
    KNOWLEDGE-BASED SYSTEMS, 2022, 251
  • [2] Hierarchical graph attention network for temporal knowledge graph reasoning
    Shao, Pengpeng
    He, Jiayi
    Li, Guanjun
    Zhang, Dawei
    Tao, Jianhua
    NEUROCOMPUTING, 2023, 550
  • [3] Optimizing Parallel Graph Connectivity Computation via Subgraph Sampling
    Sutton, Michael
    Ben-Nun, Tal
    Barak, Amnon
    2018 32ND IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2018, : 12 - 21
  • [4] Subgraph-Indexed Sequential Subdivision for Continuous Subgraph Matching on Dynamic Knowledge Graph
    Sun, Yunhao
    Li, Guanyu
    Guan, Mengmeng
    Ning, Bo
    COMPLEXITY, 2020, 2020
  • [5] KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillation
    Baltatzis, Vasileios
    Costabello, Luca
    LEARNING ON GRAPHS CONFERENCE, VOL 231, 2023, 231
  • [6] One Subgraph for All: Efficient Reasoning on Opening Subgraphs for Inductive Knowledge Graph Completion
    Xie, Zhiwen
    Zhang, Yi
    Zhou, Guangyou
    Liu, Jin
    Tu, Xinhui
    Huang, Jimmy Xiangji
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 8914 - 8927
  • [7] Tensor Graph Attention Network for Knowledge Reasoning in Internet of Things
    Yang, Jing
    Yang, Laurence T.
    Wang, Hao
    Gao, Yuan
    Liu, Huazhong
    Xie, Xia
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) : 9128 - 9137
  • [8] Target relational attention-oriented knowledge graph reasoning
    Zhao, Xiaojuan
    Jia, Yan
    Li, Aiping
    Jiang, Rong
    Chen, Kai
    Wang, Ye
    NEUROCOMPUTING, 2021, 461 : 577 - 586
  • [9] More Interpretable Graph Similarity Computation Via Maximum Common Subgraph Inference
    Lan Z.
    Hong B.
    Ma Y.
    Ma F.
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (11) : 1 - 12
  • [10] An inductive knowledge graph embedding via combination of subgraph and type information
    Hongbo Liu
    Yue Chen
    Peng He
    Chao Zhang
    Hao Wu
    Jiange Zhang
    Scientific Reports, 13