CONHyperKGE: Using Contrastive Learning in Hyperbolic Space for Knowledge Graph Embedding

被引:0
|
作者
Gao, Mandeng [1 ]
Tian, Shengwei [1 ]
Yu, Long [1 ]
机构
[1] Xinjiang Univ, Sch Software, Urumqi, Xinjiang Uygur, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph; hyperbolic space embedding; knowledge graph embedding; contrastive learning;
D O I
10.1142/S0218001424510054
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The embedding of Knowledge Graphs (KGs) in hyperbolic space has recently received great attention in the field of deep learning because it can provide more accurate and concise representations of hierarchical structures compared to Euclidean spaces and complex spaces. Although hyperbolic space embeddings have shown significant improvements over Euclidean spaces and complex space embeddings in handling the task of KG embedding, they still face challenges related to the uneven distribution and insufficient alignment of high-dimensional sparse data. To address this issue, we propose the CONHyperKGE model, which leverages contrastive learning to optimize the embedding distribution in hyperbolic space. This approach enables better capture of hierarchical structures, improved handling of symmetry, and enhanced treatment of sparse matrices. Our proposed method is evaluated on four standard KG Embedding (KGE) datasets: WN18RR, FB15k-237, Kinship, and UMLS. After extensive experimental verification, our method has improved its performance on all four datasets. Notably, on the low-dimensional Kinship dataset, our method achieves an average Mean Reciprocal Rank (MRR) improvement of 2% over the original method, while on the high-dimensional WN18RR dataset, an average MRR improvement of 1% is observed compared to the original method.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Knowledge Graph Entity Typing with Contrastive Learning
    Zhu, Guozhen
    Yao, Shunyu
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 139 - 144
  • [22] Learning cognitive embedding using signed knowledge interaction graph
    Huo, Yujia
    Wong, Derek F.
    Ni, Lionel M.
    Chao, Lidia S.
    Zhang, Jing
    Zuo, Xin
    KNOWLEDGE-BASED SYSTEMS, 2021, 229
  • [23] Learning Contrastive Embedding in Low-Dimensional Space
    Chen, Shuo
    Gong, Chen
    Li, Jun
    Yang, Jian
    Niu, Gang
    Sugiyama, Masashi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [24] Extrapolation over temporal knowledge graph via hyperbolic embedding
    Jia, Yan
    Lin, Menqi
    Wang, Ye
    Li, Jianming
    Chen, Kai
    Siebert, Joanna
    Zhang, Geordie. Z. Z.
    Liao, Qing
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (02) : 418 - 429
  • [25] Knowledge embedding via hyperbolic skipped graph convolutional networks
    Yao, Shuanglong
    Pi, Dechang
    Chen, Junfu
    NEUROCOMPUTING, 2022, 480 : 119 - 130
  • [26] A contrastive knowledge graph embedding model with hierarchical attention and dynamic completion
    Shang, Bin
    Zhao, Yinliang
    Liu, Jun
    Liu, Yifan
    Wang, Chenxin
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (20): : 15005 - 15018
  • [27] A contrastive knowledge graph embedding model with hierarchical attention and dynamic completion
    Bin Shang
    Yinliang Zhao
    Jun Liu
    Yifan Liu
    Chenxin Wang
    Neural Computing and Applications, 2023, 35 : 15005 - 15018
  • [28] Contrastive Knowledge Distillation Method Based on Feature Space Embedding
    Ye F.
    Chen B.
    Lai Y.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2023, 51 (05): : 13 - 23
  • [29] Relational Learning Analysis of Social Politics using Knowledge Graph Embedding
    Bilal Abu-Salih
    Marwan Al-Tawil
    Ibrahim Aljarah
    Hossam Faris
    Pornpit Wongthongtham
    Kit Yan Chan
    Amin Beheshti
    Data Mining and Knowledge Discovery, 2021, 35 : 1497 - 1536
  • [30] Molecular Contrastive Learning with Chemical Element Knowledge Graph
    Fang, Yin
    Zhang, Qiang
    Yang, Haihong
    Zhuang, Xiang
    Deng, Shumin
    Zhang, Wen
    Qin, Ming
    Chen, Zhuo
    Fan, Xiaohui
    Chen, Huajun
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3968 - 3976