Knowledge Graph Reasoning via Dynamic Subgraph Attention with Low Resource Computation

被引:0
|
作者
Wang, Yin [1 ,2 ]
Xia, Nan [1 ,2 ]
Yu, Hang [1 ]
Luo, Xiangfeng [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai, Peoples R China
[2] Shanghai ArtiTech AI Technol Co Ltd, Shanghai, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Knowledge graph reasoning; Dynamic Subgraph Attention; Multi-hop path history; Path-based learning; Embedding-based learning;
D O I
10.1016/j.neucom.2024.127866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs (KGs) suffer from inherent incompleteness, which has spurred research into knowledge graph reasoning (KGR), i.e., ways to infer missing facts based on existing triples. The most prevalent approaches employ a static mechanism for entity representation across the entire graph, sharing entity embeddings for different query relations. Nevertheless, these static entity embeddings fail to capture specific semantics for various query scenarios, resulting in inaccurate entity representations and susceptibility to reasoning errors. Furthermore, the whole graph learning style requires substantial computational resources, especially since KGs are often of large-scale. Consequently, these methods are impractical in low -resource environments. To address these issues, we devise a framework called dynamic subgraph attention (DSA), which learns dynamic entity embeddings for different query relations across subgraphs. In our approach, by utilizing multi -hop path history information obtained through path -based learning, we guide a dynamic attention mechanism to generate dynamic entity embeddings for different query relations. To ensure the semantic information of entities, the embedding -based and path -based learning are jointly trained for KGR. Additionally, the proposed dynamic aggregation mechanism operates on subgraphs, resulting in a remarkable 6-7 times resource conservation compared to GPU computations. Empirical experiments further demonstrate that DSA outperforms the current methods significantly on three benchmark datasets.
引用
下载
收藏
页数:12
相关论文
共 50 条
  • [41] Investigating the Parallel Tractability of Knowledge Graph Reasoning via Boolean Circuits
    Zhou, Zhangquan
    Liu, Jun
    Tang, Shijiao
    KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE GRAPH EMPOWERS THE DIGITAL ECONOMY, CCKS 2022, 2022, 1669 : 3 - 15
  • [42] Self-Supervised Dynamic Graph Representation Learning via Temporal Subgraph Contrast
    Chen, Ke-Jia
    Liu, Linsong
    Jiang, Linpu
    Chen, Jingqiang
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (01)
  • [44] DREAM: Adaptive Reinforcement Learning based on Attention Mechanism for Temporal Knowledge Graph Reasoning
    Zheng, Shangfei
    Yin, Hongzhi
    Chen, Tong
    Quoc Viet Hung Nguyen
    Chen, Wei
    Zhao, Lei
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1578 - 1588
  • [45] ADRL: An attention-based deep reinforcement learning framework for knowledge graph reasoning
    Wang, Qi
    Hao, Yongsheng
    Cao, Jie
    KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [46] ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning
    Dengao Li
    Shuyi Miao
    Baofeng Zhao
    Yu Zhou
    Ding Feng
    Jumin Zhao
    Xupeng Niu
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2301 - 2315
  • [47] ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning
    Li, Dengao
    Miao, Shuyi
    Zhao, Baofeng
    Zhou, Yu
    Feng, Ding
    Zhao, Jumin
    Niu, Xupeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (07) : 2301 - 2315
  • [48] TAGAT: Type-Aware Graph Attention neTworks for reasoning over knowledge graphs
    Wang, Yuzhuo
    Wang, Hongzhi
    He, Junwei
    Lu, Wenbo
    Gao, Shuolin
    KNOWLEDGE-BASED SYSTEMS, 2021, 233
  • [49] HiAM: A Hierarchical Attention based Model for knowledge graph multi-hop reasoning
    Ma, Ting
    Lv, Shangwen
    Huang, Longtao
    Hu, Songlin
    NEURAL NETWORKS, 2021, 143 : 261 - 270
  • [50] Resource Recommendation Based on Industrial Knowledge Graph in Low-Resource Conditions
    Liu, Yangshengyan
    Gu, Fu
    Gu, Xinjian
    Wu, Yijie
    Guo, Jianfeng
    Zhang, Jin
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2022, 15 (01)