Knowledge Graph Reasoning via Dynamic Subgraph Attention with Low Resource Computation

被引:0
|
作者
Wang, Yin [1 ,2 ]
Xia, Nan [1 ,2 ]
Yu, Hang [1 ]
Luo, Xiangfeng [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai, Peoples R China
[2] Shanghai ArtiTech AI Technol Co Ltd, Shanghai, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Knowledge graph reasoning; Dynamic Subgraph Attention; Multi-hop path history; Path-based learning; Embedding-based learning;
D O I
10.1016/j.neucom.2024.127866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs (KGs) suffer from inherent incompleteness, which has spurred research into knowledge graph reasoning (KGR), i.e., ways to infer missing facts based on existing triples. The most prevalent approaches employ a static mechanism for entity representation across the entire graph, sharing entity embeddings for different query relations. Nevertheless, these static entity embeddings fail to capture specific semantics for various query scenarios, resulting in inaccurate entity representations and susceptibility to reasoning errors. Furthermore, the whole graph learning style requires substantial computational resources, especially since KGs are often of large-scale. Consequently, these methods are impractical in low -resource environments. To address these issues, we devise a framework called dynamic subgraph attention (DSA), which learns dynamic entity embeddings for different query relations across subgraphs. In our approach, by utilizing multi -hop path history information obtained through path -based learning, we guide a dynamic attention mechanism to generate dynamic entity embeddings for different query relations. To ensure the semantic information of entities, the embedding -based and path -based learning are jointly trained for KGR. Additionally, the proposed dynamic aggregation mechanism operates on subgraphs, resulting in a remarkable 6-7 times resource conservation compared to GPU computations. Empirical experiments further demonstrate that DSA outperforms the current methods significantly on three benchmark datasets.
引用
下载
收藏
页数:12
相关论文
共 50 条
  • [31] DA-Net: Distributed Attention Network for Temporal Knowledge Graph Reasoning
    Liu, Kangzheng
    Zhao, Feng
    Chen, Hongxu
    Li, Yicong
    Xu, Guandong
    Jin, Hai
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 1289 - 1298
  • [32] Path-based reasoning with constrained type attention for knowledge graph completion
    Kai Lei
    Jin Zhang
    Yuexiang Xie
    Desi Wen
    Daoyuan Chen
    Min Yang
    Ying Shen
    Neural Computing and Applications, 2020, 32 : 6957 - 6966
  • [33] Reinforcement knowledge graph reasoning based on dual agents and attention mechanismReinforcement knowledge graph reasoning based on...X.-H. Yang et al.
    Xu-Hua Yang
    Tao Wang
    Ji-Song Gan
    Liang-Yu Gao
    Gang-Feng Ma
    Yan-Bo Zhou
    Applied Intelligence, 2025, 55 (6)
  • [34] A hierarchical and interlamination graph self-attention mechanism-based knowledge graph reasoning architecture
    Wu, Yuejia
    Zhou, Jian-tao
    INFORMATION SCIENCES, 2025, 686
  • [36] Neural Knowledge Acquisition via Mutual Attention between Knowledge Graph and Text
    Han, Xu
    Liu, Zhiyuan
    Sun, Maosong
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 4832 - 4839
  • [37] SUGAR: Efficient Subgraph-Level Training via Resource-Aware Graph Partitioning
    Xue, Zihui
    Yang, Yuedong
    Marculescu, Radu
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (11) : 3167 - 3177
  • [38] Biomedical temporal knowledge graph reasoning via contrastive adversarial learning
    Li, Wenchu
    Zhou, Huiwei
    Yao, Weihong
    Wang, Lanlan
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKS AND INTERNET OF THINGS, CNIOT 2024, 2024, : 43 - 48
  • [39] DeepWeak: Reasoning Common Software Weaknesses via Knowledge Graph Embedding
    Han, Zhuobing
    Li, Xiaohong
    Liu, Hongtao
    Xing, Zhenchang
    Feng, Zhiyong
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER 2018), 2018, : 456 - 466
  • [40] Knowledge graph embedding via reasoning over entities, relations, and text
    Nie, Binling
    Sun, Shouqian
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 91 : 426 - 433