Multi-modal Entity Alignment via Position-enhanced Multi-label Propagation

被引:0
|
作者
Tang, Wei [1 ]
Wang, Yuanyi [2 ,3 ]
机构
[1] Huawei Translat Serv Ctr, Beijing, Peoples R China
[2] Huawei Test, Dongguan, Guangdong, Peoples R China
[3] CRDU, ATE Dept, Dongguan, Guangdong, Peoples R China
关键词
multi-modal entity alignment; label propagation;
D O I
10.1145/3652583.3658085
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-modal Entity Alignment (MMEA) refers to utilizing multiple modalities such as text, images, videos, etc., to match entities from multiple knowledge graphs. Compared to single-modal entity alignment, multi-modal entity alignment can provide a more comprehensive description of entity semantics and improve matching accuracy. Currently, research efforts are directed towards the development of sophisticated deep learning models, such as graph neural networks, that can effectively capture and integrate the multi-modal features of entities for entity alignment tasks. While these models have shown promising results, they tend to focus on capturing only the local structure of entities, leading to the challenge of subgraph isomorphism. Moreover, the complexity of these models often hinders their scalability. To address these limitations, this paper proposes a non-neural, position-enhanced multi-modal entity alignment algorithm that leverages the label propagation technique to fuse and aggregate various multi-modal and position features, resulting in entity representations that are aware of long-term alignment information. Extensive experiments on various public datasets demonstrate that our proposed approach outperforms state-of-the-art algorithms in terms of both alignment accuracy and computational efficiency.
引用
收藏
页码:366 / 375
页数:10
相关论文
共 50 条
  • [31] Visual Entity Linking via Multi-modal Learning
    Zheng, Qiushuo
    Wen, Hao
    Wang, Meng
    Qi, Guilin
    DATA INTELLIGENCE, 2022, 4 (01) : 1 - 19
  • [32] Multi-modal multi-label semantic indexing of images based on hybrid ensemble learning
    Li, Wei
    Sun, Maosong
    Habel, Christopher
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2007, 2007, 4810 : 744 - +
  • [33] CARAT: Contrastive Feature Reconstruction and Aggregation for Multi-Modal Multi-Label Emotion Recognition
    Peng, Cheng
    Chen, Ke
    Shou, Lidan
    Chen, Gang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 13, 2024, : 14581 - 14589
  • [34] MHM: Multi-modal Clinical Data based Hierarchical Multi-label Diagnosis Prediction
    Qiao, Zhi
    Zhang, Zhen
    Wu, Xian
    Ge, Shen
    Fan, Wei
    PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 1841 - 1844
  • [35] MMIEA: Multi-modal Interaction Entity Alignment model for knowledge graphs
    Zhu, Bin
    Wu, Meng
    Hong, Yunpeng
    Chen, Yi
    Xie, Bo
    Liu, Fei
    Bu, Chenyang
    Ding, Weiping
    INFORMATION FUSION, 2023, 100
  • [36] Graph structure prefix injection transformer for multi-modal entity alignment
    Zhang, Yan
    Luo, Xiangyu
    Hu, Jing
    Zhang, Miao
    Xiao, Kui
    Li, Zhifei
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (03)
  • [37] Multi-modal entity alignment based on joint knowledge representation learning
    Wang H.-Y.
    Lun B.
    Zhang X.-M.
    Sun X.-L.
    Kongzhi yu Juece/Control and Decision, 2021, 35 (12): : 2855 - 2864
  • [38] Multi-modal Graph Convolutional Network for Knowledge Graph Entity Alignment
    You, Yinghui
    Wei, Yuyang
    Zhang, Yanlong
    Chen, Wei
    Zhao, Lei
    WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 142 - 157
  • [39] Multi-Modal Entity Alignment Using Uncertainty Quantification for Modality Importance
    Hama, Kenta
    Matsubara, Takashi
    IEEE ACCESS, 2023, 11 : 28479 - 28489
  • [40] MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid
    Chen, Zhuo
    Chen, Jiaoyan
    Zhang, Wen
    Guo, Lingbing
    Fang, Yin
    Huang, Yufeng
    Zhang, Yichi
    Geng, Yuxia
    Pan, Jeff Z.
    Song, Wenting
    Chen, Huajun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3317 - 3327