Multi-modal Entity Alignment via Position-enhanced Multi-label Propagation

被引:0
|
作者
Tang, Wei [1 ]
Wang, Yuanyi [2 ,3 ]
机构
[1] Huawei Translat Serv Ctr, Beijing, Peoples R China
[2] Huawei Test, Dongguan, Guangdong, Peoples R China
[3] CRDU, ATE Dept, Dongguan, Guangdong, Peoples R China
关键词
multi-modal entity alignment; label propagation;
D O I
10.1145/3652583.3658085
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-modal Entity Alignment (MMEA) refers to utilizing multiple modalities such as text, images, videos, etc., to match entities from multiple knowledge graphs. Compared to single-modal entity alignment, multi-modal entity alignment can provide a more comprehensive description of entity semantics and improve matching accuracy. Currently, research efforts are directed towards the development of sophisticated deep learning models, such as graph neural networks, that can effectively capture and integrate the multi-modal features of entities for entity alignment tasks. While these models have shown promising results, they tend to focus on capturing only the local structure of entities, leading to the challenge of subgraph isomorphism. Moreover, the complexity of these models often hinders their scalability. To address these limitations, this paper proposes a non-neural, position-enhanced multi-modal entity alignment algorithm that leverages the label propagation technique to fuse and aggregate various multi-modal and position features, resulting in entity representations that are aware of long-term alignment information. Extensive experiments on various public datasets demonstrate that our proposed approach outperforms state-of-the-art algorithms in terms of both alignment accuracy and computational efficiency.
引用
收藏
页码:366 / 375
页数:10
相关论文
共 50 条
  • [1] Enhanced Entity Interaction Modeling for Multi-Modal Entity Alignment
    Li, Jinxu
    Zhou, Qian
    Chen, Wei
    Zhao, Lei
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2023, 2023, 14118 : 214 - 227
  • [2] Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment
    Li, Qian
    Ji, Cheng
    Guo, Shu
    Liang, Zhaoji
    Wang, Lihong
    Li, Jianxin
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 987 - 999
  • [3] Collaboration based multi-modal multi-label learning
    Zhang, Yi
    Zhu, Yinlong
    Zhang, Zhecheng
    Wang, Chongjung
    APPLIED INTELLIGENCE, 2022, 52 (12) : 14204 - 14217
  • [4] Collaboration based multi-modal multi-label learning
    Yi Zhang
    Yinlong Zhu
    Zhecheng Zhang
    Chongjung Wang
    Applied Intelligence, 2022, 52 : 14204 - 14217
  • [5] Multi-modal Multi-label Emotion Detection with Modality and Label Dependence
    Dong Zhang
    Ju, Xincheng
    Li, Junhui
    Li, Shoushan
    Zhu, Qiaoming
    Zhou, Guodong
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 3584 - 3593
  • [6] Rethinking Modal-oriented Label Correlations for Multi-modal Multi-label Learning
    Zhang, Yi
    Shen, Jundong
    Zhang, Zhecheng
    Zhang, Lei
    Wang, Chongjun
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [7] Multi-modal Siamese Network for Entity Alignment
    Chen, Liyi
    Li, Zhi
    Xu, Tong
    Wu, Han
    Wang, Zhefeng
    Yuan, Nicholas Jing
    Chen, Enhong
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 118 - 126
  • [8] Multi-modal entity alignment in hyperbolic space
    Guo, Hao
    Tang, Jiuyang
    Zeng, Weixin
    Zhao, Xiang
    Liu, Li
    NEUROCOMPUTING, 2021, 461 : 598 - 607
  • [9] MultiJAF: Multi-modal joint entity alignment framework for multi-modal knowledge graph
    Cheng, Bo
    Zhu, Jia
    Guo, Meimei
    NEUROCOMPUTING, 2022, 500 : 581 - 591
  • [10] Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer
    He, Sunan
    Guo, Taian
    Dai, Tao
    Qiao, Ruizhi
    Shu, Xiujun
    Ren, Bo
    Xia, Shu-Tao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 808 - 816