Translation-Based Embeddings with Octonion for Knowledge Graph Completion

被引:8
|
作者
Yu, Mei [1 ,2 ,3 ]
Bai, Chen [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Zhao, Mankun [1 ,2 ,3 ]
Xu, Tianyi [1 ,2 ,3 ]
Liu, Hongwei [4 ]
Li, Xuewei [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Univ, Tianjin Key Lab Adv Networking TANKLab, Tianjin 300350, Peoples R China
[3] Tianjin Univ, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300350, Peoples R China
[4] Tianjin Foreign Studies Univ, Foreign Language Literature & Culture Studies Ctr, Tianjin 300204, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 08期
基金
中国国家自然科学基金;
关键词
knowledge graph completion; octonion; hyperbolic geometry; Poincare space; link prediction;
D O I
10.3390/app12083935
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Knowledge representation learning achieves the automatic completion of knowledge graphs (KGs) by embedding entities into continuous low-dimensional vector space. In knowledge graph completion (KGC) tasks, the inter-dependencies and hierarchical information in KGs have gained attention. Existing methods do not well capture the latent dependencies between all components of entities and relations. To address this, we introduce the mathematical theories of octonion, a more expressive generalized form of complex number and quaternion, and propose a translation-based KGC model with octonion (TransO). TransO models entities as octonion coordinate vectors, relations as the combination of octonion component matrices and coordinate vectors, and uses specific grouping calculation rules to interact between entities and relations. In addition, since hyperbolic Poincare space in non-Euclidean mathematics can represent hierarchical data more accurately and effectively than traditional Euclidean space, we propose a Poincare-extended TransO model (PTransO). PTransO transforms octonion coordinate vectors into hyperbolic embeddings by exponential mapping, and integrates the Euclidean-based calculations into hyperbolic space by operations such as Mobius addition and hyperbolic distance. The experimental results of link prediction indicate that TransO outperforms other translation-based models on the WN18 benchmark, and PTransO further achieves state-of-the-art performance in low-dimensional space on the well-established WN18RR and FB15k-237 benchmarks.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] Enriching Translation-Based Knowledge Graph Embeddings Through Continual Learnings
    Song, Hyun-Je
    Park, Seong-Bae
    [J]. IEEE ACCESS, 2018, 6 : 60489 - 60497
  • [2] Learning Translation-Based Knowledge Graph Embeddings by N-Pair Translation Loss
    Song, Hyun-Je
    Kim, A-Yeong
    Park, Seong-Bae
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (11):
  • [3] Generalized Translation-Based Embedding of Knowledge Graph
    Ebisu, Takuma
    Ichise, Ryutaro
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (05) : 941 - 951
  • [4] Medical Knowledge Graph Completion Based on Word Embeddings
    Gao, Mingxia
    Lu, Jianguo
    Chen, Furong
    [J]. INFORMATION, 2022, 13 (04)
  • [5] Two flexible translation-based models for knowledge graph embedding
    Li, Zepeng
    Huang, Rikui
    Zhang, Yufeng
    Zhu, Jianghong
    Hu, Bin
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (02) : 3093 - 3105
  • [6] Learning Context-based Embeddings for Knowledge Graph Completion
    Fei Pu
    Zhongwei Zhang
    Yan Feng
    Bailin Yang
    [J]. Journal of Data and Information Science, 2022, (02) : 84 - 106
  • [7] Learning Context-based Embeddings for Knowledge Graph Completion
    Fei Pu
    Zhongwei Zhang
    Yan Feng
    Bailin Yang
    [J]. JournalofDataandInformationScience., 2022, 7 (02) - 106
  • [8] Learning Context-based Embeddings for Knowledge Graph Completion
    Pu, Fei
    Zhang, Zhongwei
    Feng, Yan
    Yang, Bailin
    [J]. JOURNAL OF DATA AND INFORMATION SCIENCE, 2022, 7 (02) : 84 - 106
  • [9] Complex Knowledge Graph Embeddings Based on Convolution and Translation
    Shi, Lin
    Yang, Zhao
    Ji, Zhanlin
    Ganchev, Ivan
    [J]. MATHEMATICS, 2023, 11 (12)
  • [10] Knowledge Graph Embedding: A Locally and Temporally Adaptive Translation-Based Approach
    Jia, Yantao
    Wang, Yuanzhuo
    Jin, Xiaolong
    Lin, Hailun
    Cheng, Xueqi
    [J]. ACM TRANSACTIONS ON THE WEB, 2018, 12 (02)