RLPath: a knowledge graph link prediction method using reinforcement learning based attentive relation path searching and representation learning

被引:27
|
作者
Chen, Ling [1 ]
Cui, Jun [1 ]
Tang, Xing [1 ]
Qian, Yuntao [1 ]
Li, Yansheng [2 ]
Zhang, Yongjun [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
关键词
Knowledge graph link prediction; Representation learning; Reinforcement learning; Path searching;
D O I
10.1007/s10489-021-02672-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to containing rich patterns between entities, relation paths have been widely used in knowledge graph link prediction. The state-of-the-art link prediction methods considering relation paths obtain relation paths by reinforcement learning with an untrainable reward setting, and realize link prediction by path-ranking algorithm (PRA), which ignores information in entities. In this paper, we propose a new link prediction method RLPath to employ information in both relation paths and entities, which alternately trains a reinforcement learning model with a trainable reward setting to search high-quality relation paths, and a translation-based model to realize link prediction. Simultaneously, we propose a novel reward setting for the reinforcement learning model, which shares the parameters with the attention of the translation-based model, so that these parameters can not only measure the contributions of relation paths, but also guide agents to search relation paths that have high contributions for link prediction, forming mutual promotion. In experiments, we compare RLPath with the state-of-the-art link prediction methods. The results show that RLPath has competitive performance.
引用
收藏
页码:4715 / 4726
页数:12
相关论文
共 50 条
  • [31] A Dynamic Financial Knowledge Graph Based on Reinforcement Learning and Transfer Learning
    Miao, Rui
    Zhang, Xia
    Yan, Hongfei
    Chen, Chong
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 5370 - 5378
  • [32] Prediction of Students' Performance in E-learning Environments Based on Link Prediction in a Knowledge Graph
    Ettorre, Antonia
    Michel, Franck
    Faron, Catherine
    ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS AND DOCTORAL CONSORTIUM, PT II, 2022, 13356 : 432 - 435
  • [33] A Multi-hop Link Prediction Approach Based on Reinforcement Learning in Knowledge Graphs
    Chen, Heng
    Li, Guanyu
    Sun, Yunhao
    Jiang, Wei
    Chen, Xinying
    2018 11TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2018, : 165 - 169
  • [34] Water Quality Prediction Method Based on Reinforcement Learning Graph Neural Network
    Yan, Mingming
    Wang, Zhe
    IEEE ACCESS, 2024, 12 : 184421 - 184430
  • [35] Water Quality Prediction Method Based on Reinforcement Learning Graph Neural Network
    Yan, Mingming
    Wang, Zhe
    IEEE Access, 2024, 12 : 184421 - 184430
  • [36] Research on Knowledge Graph Representation Learning Method Based on Logical Rule Fusion
    Li, Lin
    Zhao, Haili
    Meng, Lingshuai
    Luo, Haitao
    Chen, Zixuan
    Li, Weikuang
    Lin, Shenwen
    2024 IEEE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE, SEAI 2024, 2024, : 326 - 330
  • [37] Operations command behavior knowledge representation learning method based on sequential graph
    Wang B.
    Wu L.
    Hu X.
    He X.
    Guo S.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2020, 42 (11): : 2520 - 2528
  • [38] Taming the Low-Quality Path for Reinforcement Learning-Based Knowledge Graph Reasoning
    Wang, Ruisheng
    Zhang, Weiwen
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2197 - 2202
  • [39] Trip Reinforcement Recommendation with Graph-based Representation Learning
    Chen, Lei
    Cao, Jie
    Tao, Haicheng
    Wu, Jia
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (04)
  • [40] A Knowledge Graph-based Interactive Recommender System Using Reinforcement Learning
    Sun, Ruoxi
    Yan, Jun
    Ren, Fenghui
    2022 TENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA, CBD, 2022, : 73 - 78