Multi-level discriminator based contrastive learning for multiplex networks

被引:0
|
作者
Wu, Hongrun [1 ]
Zhang, Mingjie [2 ]
Xiang, Zhenglong [1 ,2 ,3 ,4 ]
Chen, Yingpin [1 ]
Yu, Fei [1 ]
Xia, Xuewen [1 ]
Li, Yuanxiang [1 ,2 ]
机构
[1] Minnan Normal Univ, Key Lab Intelligent Optimizat & Informat Proc, Zhangzhou 363000, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
关键词
Contrastive learning; Heterogeneous graphs; Multi-discriminator learning; Multiplex network embedding; PARTICLE SWARM OPTIMIZATION;
D O I
10.1016/j.neucom.2024.128754
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph embedding is a technique for obtaining low-dimensional representations of nodes across diverse networks, which may then be used for various downstream tasks and applications. When it applies to heterogeneous networks, it is hard to handle heterogeneous networks because they usually contain different types of nodes and edges with more semantic and structural information. Recently, contrastive learning has developed as the preferred strategy for dealing with unsupervised heterogeneous graph embedding to reduce the cost of human label annotation. However, most multi-view contrastive learning approaches calculate the model's loss only based on the mutual dependence between the node representation and graph representation. These approaches ignore that both node attributes and node clustering contain discriminative content. To solve this issue, we propose a model called Multi-Level Discriminator-based Contrastive Learning for Multiplex Networks (MLDCL). This model adopts a multi-level multi-discriminator-based approach that can simultaneously learn the globallevel structural information, node-level attribute information, and local-level clustering information. Moreover, an augmentation strategy in the contrast learning process from the spectral domain is proposed to improve the representation and discriminative ability of MLDCL. Numerous tests with node clustering and classification tasks on widely used datasets demonstrate the efficacy of the proposed approach.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Organizational learning across multi-level networks
    Zappa, Paola
    Robins, Garry
    SOCIAL NETWORKS, 2016, 44 : 295 - 306
  • [22] Multi-level Contrastive Learning for Self-Supervised Vision Transformers
    Mo, Shentong
    Sun, Zhun
    Li, Chao
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2777 - 2786
  • [23] Multi-level Adaptive Contrastive Learning for Knowledge Internalization in Dialogue Generation
    Yang, Chenxu
    Lin, Zheng
    Wang, Lanrui
    Tian, Chong
    Pang, Liang
    Li, Jiangnan
    Ho, Qirong
    Cao, Yanan
    Wang, Weiping
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 8002 - 8015
  • [24] MULTI-LEVEL CONTRASTIVE LEARNING FOR HYBRID CROSS-MODAL RETRIEVAL
    Zhao, Yiming
    Lu, Haoyu
    Zhao, Shiqi
    Wu, Haoran
    Lu, Zhiwu
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6390 - 6394
  • [25] Adaptive multi-level graph convolution with contrastive learning for skeleton-based action recognition
    Geng, Pei
    Li, Haowei
    Wang, Fuyun
    Lyu, Lei
    SIGNAL PROCESSING, 2022, 201
  • [26] Multi-level Graph Contrastive Prototypical Clustering
    Zhang, Yuchao
    Yuan, Yuan
    Wang, Qi
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 4611 - 4619
  • [27] MLC-DTA: Drug-target affinity prediction based on multi-level contrastive learning and equivariant graph neural networks
    Zheng, Mengxin
    Sun, Guicong
    Fan, Yongxian
    NEUROCOMPUTING, 2025, 637
  • [28] Improving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning
    Zou, Ding
    Wei, Wei
    Wang, Ziyang
    Mao, Xian-Ling
    Zhu, Feida
    Fang, Rui
    Chen, Dangyang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2817 - 2826
  • [29] MoleMCL: a multi-level contrastive learning framework for molecular pre-training
    Zhang, Xinyi
    Xu, Yanni
    Jiang, Changzhi
    Shen, Lian
    Liu, Xiangrong
    BIOINFORMATICS, 2024, 40 (04)
  • [30] Unsupervised Maritime Vessel Re-Identification With Multi-Level Contrastive Learning
    Zhang, Qian
    Zhang, Mingxin
    Liu, Jinghe
    He, Xuanyu
    Song, Ran
    Zhang, Wei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) : 5406 - 5418