Multi-modal Entity Alignment via Position-enhanced Multi-label Propagation

被引:0
|
作者
Tang, Wei [1 ]
Wang, Yuanyi [2 ,3 ]
机构
[1] Huawei Translat Serv Ctr, Beijing, Peoples R China
[2] Huawei Test, Dongguan, Guangdong, Peoples R China
[3] CRDU, ATE Dept, Dongguan, Guangdong, Peoples R China
关键词
multi-modal entity alignment; label propagation;
D O I
10.1145/3652583.3658085
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-modal Entity Alignment (MMEA) refers to utilizing multiple modalities such as text, images, videos, etc., to match entities from multiple knowledge graphs. Compared to single-modal entity alignment, multi-modal entity alignment can provide a more comprehensive description of entity semantics and improve matching accuracy. Currently, research efforts are directed towards the development of sophisticated deep learning models, such as graph neural networks, that can effectively capture and integrate the multi-modal features of entities for entity alignment tasks. While these models have shown promising results, they tend to focus on capturing only the local structure of entities, leading to the challenge of subgraph isomorphism. Moreover, the complexity of these models often hinders their scalability. To address these limitations, this paper proposes a non-neural, position-enhanced multi-modal entity alignment algorithm that leverages the label propagation technique to fuse and aggregate various multi-modal and position features, resulting in entity representations that are aware of long-term alignment information. Extensive experiments on various public datasets demonstrate that our proposed approach outperforms state-of-the-art algorithms in terms of both alignment accuracy and computational efficiency.
引用
收藏
页码:366 / 375
页数:10
相关论文
共 50 条
  • [21] Partial Modal Conditioned GANs for Multi-modal Multi-label Learning with Arbitrary Modal-Missing
    Zhang, Yi
    Shen, Jundong
    Zhang, Zhecheng
    Wang, Chongjun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 413 - 428
  • [22] Multi-modal Contextual Prompt Learning for Multi-label Classification with Partial Labels
    Wang, Rui
    Pan, Zhengxin
    Wu, Fangyu
    Lv, Yifan
    Zhang, Bailing
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 517 - 524
  • [23] M3TR: Multi-modal Multi-label Recognition with Transformer
    Zhao, Jiawei
    Zhao, Yifan
    Li, Jia
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 469 - 477
  • [24] Multi-modal Multi-label Semantic Indexing of Images using Unlabeled Data
    Li, Wei
    Sun, Maosong
    ALPIT 2008: SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED LANGUAGE PROCESSING AND WEB INFORMATION TECHNOLOGY, PROCEEDINGS, 2008, : 204 - 209
  • [25] College Student Scholarships and Subsidies Granting: A Multi-Modal Multi-Label Approach
    Ye, Han-Jia
    Zhan, De-Chuan
    Li, Xiaolin
    Huang, Zhen-Chuan
    Jiang, Yuan
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 559 - 568
  • [26] Multi-Modal Entity Alignment Method Based on Feature Enhancement
    Wang, Huansha
    Liu, Qinrang
    Huang, Ruiyang
    Zhang, Jianpeng
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [27] Actor-agnostic Multi-label Action Recognition with Multi-modal Query
    Mondal, Anindya
    Nag, Sauradip
    Prada, Joaquin M.
    Zhu, Xiatian
    Dutta, Anjan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 784 - 794
  • [28] Multi-modal Multi-label Emotion Recognition with Heterogeneous Hierarchical Message Passing
    Zhang, Dong
    Ju, Xincheng
    Zhang, Wei
    Li, Junhui
    Li, Shoushan
    Zhu, Qiaoming
    Zhou, Guodong
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14338 - 14346
  • [29] Transformer-based Label Set Generation for Multi-modal Multi-label Emotion Detection
    Ju, Xincheng
    Zhang, Dong
    Li, Junhui
    Zhou, Guodong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 512 - 520
  • [30] Multi-modal, Multi-task and Multi-label for Music Genre Classification and Emotion Regression
    Pandeya, Yagya Raj
    You, Jie
    Bhattarai, Bhuwan
    Lee, Joonwhoan
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1042 - 1045