SelectE: Multi-scale adaptive selection network for knowledge graph representation learning

被引:0
|
作者
Zu, Lizheng [1 ]
Lin, Lin [1 ]
Fu, Song [1 ]
Guo, Feng [1 ]
Wu, Jinlei [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, Harbin, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Knowledge graph; Representation learning; Adaptive selection mechanism; Convolutional neural network;
D O I
10.1016/j.knosys.2024.111554
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most knowledge graphs in the real world suffer from incompleteness which can be addressed through knowledge graph representation learning (KGRL) techniques that use known facts to infer missing links. In this paper, a novel multi-scale adaptive selection network for KGRL, namely SelectE, is developed to learn richer multi-scale interactive features and automatically select important features, thereby achieving promising KGRL performance. Specifically, first, the input feature matrix is redesigned to better cooperate with multi-scale convolution to improve the interaction of entities and relations. Second, a multi-scale learning module is designed to learn richer multi-scale features from the input matrix using multiple branches with different kernel sizes. Third, to automatically strengthen the important features and suppress the useless features, a multi-scale adaptive selection mechanism is proposed to dynamically allocate the weights of the obtained features based on their contained information. The core of SelectE is to maximize interactions while also considering how to better utilize features. Finally, the outstanding performance of SelectE is validated by a series of comparison experiments on seven benchmark datasets (FB15k-237, WN18RR, FB15k, WN18, YAGO3-10, KINSHIP, UMLS). The experimental results show that SelectE outperforms other state-of-the-art models, demonstrating its remarkable performance and generalization.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Representation Learning of Knowledge Graphs with Multi-scale Capsule Network
    Cheng, Jingwei
    Yang, Zhi
    Dang, Jinming
    Pan, Chunguang
    Zhang, Fu
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2019, PT I, 2019, 11871 : 282 - 290
  • [2] DMSPool: Dual Multi-Scale Pooling for Graph Representation Learning
    Yu, Hualei
    Luo, Chong
    Du, Yuntao
    Cheng, Hao
    Cao, Meng
    Wang, Chongjun
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 375 - 384
  • [3] Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding
    Zhang, Zhaoli
    Li, Zhifei
    Liu, Hai
    Xiong, Neal N.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) : 2335 - 2347
  • [4] Multi-Scale Graph Representation Learning for Autism Identification With Functional MRI
    Chu, Ying
    Wang, Guangyu
    Cao, Liang
    Qiao, Lishan
    Liu, Mingxia
    [J]. FRONTIERS IN NEUROINFORMATICS, 2022, 15
  • [5] GRAHIES: Multi-Scale Graph Representation Learning with Latent Hierarchical Structure
    Yutt, Lei
    Lint, Ling
    Put, Calton
    Chowt, Ka Ho
    Gursoyt, Mehmet Emre
    Truext, Stacey
    Mini, Hong
    Iyengart, Arun
    Slit, Gong
    Zhangt, Qi
    Dillenbergert, Donna
    [J]. 2019 IEEE FIRST INTERNATIONAL CONFERENCE ON COGNITIVE MACHINE INTELLIGENCE (COGMI 2019), 2019, : 8 - 15
  • [6] GraphSAGE++: Weighted Multi-scale GNN for Graph Representation Learning
    E. Jiawei
    Yinglong Zhang
    Shangying Yang
    Hong Wang
    Xuewen Xia
    Xing Xu
    [J]. Neural Processing Letters, 56
  • [7] Graph convolutional neural network for multi-scale feature learning
    Edwards, Michael
    Xie, Xianghua
    Palmer, Robert, I
    Tam, Gary K. L.
    Alcock, Rob
    Roobottom, Carl
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 194
  • [8] Multi-Scale Neural Network for EEG Representation Learning in BCI
    Ko, Wonjun
    Jeon, Eunjin
    Jeong, Seungwoo
    Suk, Heung-Il
    [J]. IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2021, 16 (02) : 31 - 45
  • [9] Multi-Scale Convolutional Neural Network for Temporal Knowledge Graph Completion
    Wei Liu
    Peijie Wang
    Zhihui Zhang
    Qiong Liu
    [J]. Cognitive Computation, 2023, 15 : 1016 - 1022
  • [10] Multi-Scale Convolutional Neural Network for Temporal Knowledge Graph Completion
    Liu, Wei
    Wang, Peijie
    Zhang, Zhihui
    Liu, Qiong
    [J]. COGNITIVE COMPUTATION, 2023, 15 (03) : 1016 - 1022