Multi-level discriminator based contrastive learning for multiplex networks

被引:0
|
作者
Wu, Hongrun [1 ]
Zhang, Mingjie [2 ]
Xiang, Zhenglong [1 ,2 ,3 ,4 ]
Chen, Yingpin [1 ]
Yu, Fei [1 ]
Xia, Xuewen [1 ]
Li, Yuanxiang [1 ,2 ]
机构
[1] Minnan Normal Univ, Key Lab Intelligent Optimizat & Informat Proc, Zhangzhou 363000, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
关键词
Contrastive learning; Heterogeneous graphs; Multi-discriminator learning; Multiplex network embedding; PARTICLE SWARM OPTIMIZATION;
D O I
10.1016/j.neucom.2024.128754
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph embedding is a technique for obtaining low-dimensional representations of nodes across diverse networks, which may then be used for various downstream tasks and applications. When it applies to heterogeneous networks, it is hard to handle heterogeneous networks because they usually contain different types of nodes and edges with more semantic and structural information. Recently, contrastive learning has developed as the preferred strategy for dealing with unsupervised heterogeneous graph embedding to reduce the cost of human label annotation. However, most multi-view contrastive learning approaches calculate the model's loss only based on the mutual dependence between the node representation and graph representation. These approaches ignore that both node attributes and node clustering contain discriminative content. To solve this issue, we propose a model called Multi-Level Discriminator-based Contrastive Learning for Multiplex Networks (MLDCL). This model adopts a multi-level multi-discriminator-based approach that can simultaneously learn the globallevel structural information, node-level attribute information, and local-level clustering information. Moreover, an augmentation strategy in the contrast learning process from the spectral domain is proposed to improve the representation and discriminative ability of MLDCL. Numerous tests with node clustering and classification tasks on widely used datasets demonstrate the efficacy of the proposed approach.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multi-level graph contrastive learning
    Shao, Pengpeng
    Tao, Jianhua
    NEUROCOMPUTING, 2024, 570
  • [2] Multi-Level Graph Knowledge Contrastive Learning
    Yang, Haoran
    Wang, Yuhao
    Zhao, Xiangyu
    Chen, Hongxu
    Yin, Hongzhi
    Li, Qing
    Xu, Guandong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8829 - 8841
  • [3] Multi-level Contrastive Learning for Keyphrase Generation
    Li, Yafu
    Li, Shinian
    Yu, Heng
    Zhuang, Wu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024, 2024, 14877 : 238 - 249
  • [4] Graph Similarity Learning Based on Learnable Augmentation and Multi-Level Contrastive Learning
    Feng, Jian
    Guo, Yifan
    Du, Cailing
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 5135 - 5151
  • [5] Multi-level Contrastive Learning on Weak Social Networks for Information Diffusion Prediction
    Feng, Zihan
    Wu, Rui
    Yang, Yajun
    Gao, Hong
    Wang, Xin
    Liu, Xueli
    Hu, Qinghua
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT VI, DASFAA 2024, 2024, 14855 : 84 - 100
  • [6] Multi-level Contrastive Learning for Script-based Character Understanding
    Li, Dawei
    Zhang, Hengyuan
    Li, Yanran
    Yang, Shiping
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 5995 - 6013
  • [7] Multi-level Contrastive Learning for Commonsense Question Answering
    Fang, Quntian
    Huang, Zhen
    Zhang, Ziwen
    Hu, Minghao
    Hu, Biao
    Wang, Ankun
    Li, Dongsheng
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023, 2023, 14120 : 318 - 331
  • [8] Multi-level Contrastive Learning Framework for Sequential Recommendation
    Wang, Ziyang
    Liu, Huoyu
    Wei, Wei
    Hu, Yue
    Mao, Xian-Ling
    He, Shaojian
    Fang, Rui
    Chen, Dangyang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2098 - 2107
  • [9] Multi-level Disentangled Contrastive Learning on Heterogeneous Graphs
    Lin, Tong
    Zhou, Cangqi
    Li, Qianmu
    Hu, Dianming
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 628 - 634
  • [10] Contrastive Multi-Level Graph Neural Networks for Session-Based Recommendation
    Wang, Fuyun
    Gao, Xingyu
    Chen, Zhenyu
    Lyu, Lei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 9278 - 9289