ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning

被引:4
|
作者
Li, Dengao [1 ,3 ,4 ]
Miao, Shuyi [1 ,3 ,4 ]
Zhao, Baofeng [5 ]
Zhou, Yu [1 ,3 ,4 ]
Feng, Ding [1 ,3 ,4 ]
Zhao, Jumin [2 ,3 ,4 ]
Niu, Xupeng [1 ,3 ,4 ]
机构
[1] Taiyuan Univ Technol, Coll Data Sci, Taiyuan 030024, Shanxi, Peoples R China
[2] Taiyuan Univ Technol, Coll Informat & Comp, Taiyuan 030024, Shanxi, Peoples R China
[3] Key Lab Big Data Fus Anal & Applicat Shanxi Prov, Taiyuan 030024, Peoples R China
[4] Intelligent Percept Engn Technol Ctr Shanxi, Taiyuan 030024, Peoples R China
[5] Taiyuan Univ Technol, Coll Min Engn, Taiyuan 030024, Peoples R China
基金
中国国家自然科学基金;
关键词
Path-based reasoning; Knowledge graph completion; Link prediction; Attention mechanism;
D O I
10.1007/s13042-022-01764-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graphs can provide a rich resource for constructing question answering systems and recommendation systems. However, most knowledge graphs still encounter knowledge incompleteness. The path-based approach predicts the unknown relation between pairwise entities based on existing path facts. This approach is one of the most promising approaches for knowledge graph completion. A critical challenge of such approaches is integrating path sequence information to achieve the goal of better reasoning. Existing researches focus more on the features between neighboring entities and relations in a path, ignoring the semantic relations of the whole triple. A single path consists of entities and relations, but triples contain valuable semantic information. Moreover, the importance of different triples on each path is disparate. To address these problems, we propose a method convolutional network with hierarchical attention to complete the knowledge graph. Firstly, we use a convolutional network and bidirectional long short-term memory to extract the features of each triple in the path. Then, we employ a novel hierarchical attention network, including triple-level attention and path-level attention, picking up path features at multiple granularities. In addition, we elaborate a multistep reasoning component that repeats multiple interactions with the hierarchical attention module to obtain more plausible inference evidence. Finally, we predict the relation between query entities and provide the most dominant path to explain our answer. The experimental results show that our method outperforms existing approaches by 1-3% on four datasets.
引用
收藏
页码:2301 / 2315
页数:15
相关论文
共 50 条
  • [1] ConvHiA: convolutional network with hierarchical attention for knowledge graph multi-hop reasoning
    Dengao Li
    Shuyi Miao
    Baofeng Zhao
    Yu Zhou
    Ding Feng
    Jumin Zhao
    Xupeng Niu
    [J]. International Journal of Machine Learning and Cybernetics, 2023, 14 : 2301 - 2315
  • [2] HiAM: A Hierarchical Attention based Model for knowledge graph multi-hop reasoning
    Ma, Ting
    Lv, Shangwen
    Huang, Longtao
    Hu, Songlin
    [J]. NEURAL NETWORKS, 2021, 143 : 261 - 270
  • [3] Attention-based Multi-hop Reasoning for Knowledge Graph
    Wang, Zikang
    Li, Linjing
    Zeng, Daniel Dajun
    Chen, Yue
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS (ISI), 2018, : 211 - 213
  • [4] Hierarchical Knowledge-Enhancement Framework for multi-hop knowledge graph reasoning
    Xie, Shaorong
    Liu, Ruishen
    Wang, Xinzhi
    Luo, Xiangfeng
    Sugumaran, Vijayan
    Yu, Hang
    [J]. NEUROCOMPUTING, 2024, 588
  • [5] BAG: Bi-directional Attention Entity Graph Convolutional Network for Multi-hop Reasoning Question Answering
    Cao, Yu
    Fang, Meng
    Tao, Dacheng
    [J]. 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 357 - 362
  • [6] Multi-Hop Knowledge Graph Reasoning with Reward Shaping
    Lin, Xi Victoria
    Socher, Richard
    Xiong, Caiming
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3243 - 3253
  • [7] Multi-Hop Reasoning for Question Answering with Knowledge Graph
    Zhang, Jiayuan
    Cai, Yifei
    Zhang, Qian
    Cao, Zehao
    Cheng, Zhenrong
    Li, Dongmei
    Meng, Xianghao
    [J]. 2021 IEEE/ACIS 20TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2021-SUMMER), 2021, : 121 - 125
  • [8] CogKR: Cognitive Graph for Multi-Hop Knowledge Reasoning
    Du, Zhengxiao
    Zhou, Chang
    Yao, Jiangchao
    Tu, Teng
    Cheng, Letian
    Yang, Hongxia
    Zhou, Jingren
    Tang, Jie
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1283 - 1295
  • [9] Step by step: A hierarchical framework for multi-hop knowledge graph reasoning with reinforcement learning
    Zhu, Anjie
    Ouyang, Deqiang
    Liang, Shuang
    Shao, Jie
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 248
  • [10] Attention-based exploitation and exploration strategy for multi-hop knowledge graph reasoning
    Shang, Bin
    Zhao, Yinliang
    Liu, Yifan
    Wang, Chenxin
    [J]. INFORMATION SCIENCES, 2024, 653