GCH: Graph Contrastive Learning with Higher-Order Networks

被引:0
|
作者
Li, Xia [1 ]
Yang, Yan [1 ]
机构
[1] Heilongjiang Univ, Sch Comp Sci & Technol, Harbin 150080, Peoples R China
来源
关键词
Graph Neural Networks; Graph Representation Learning; Unsupervised Learning; Self-Supervised Learning; Contrastive learning;
D O I
10.1007/978-981-97-7238-4_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning has improved graph representation learning, becoming a successful unsupervised graph representation learning method. This method first generates two or more views of the input graph through data augmentation and learns node representations by maximizing the consistency between views. However, existing methods mostly use random data augmentation strategies, such as randomly deleting edges and randomly masking features, or ignore the rich global information in the graph structure, resulting in poor performance. This paper proposes a new unsupervised graph contrastive learning with higher-order networks (GCH). Since data augmentation is a key component of contrastive learning, this paper introduces high-order networks by incorporating similarity-based global information into the original graph. Then, a method combining adaptive and random enhancement strategies is used to make the semantic information between the two graph views complementary, preserving important semantic information while avoiding excessive similarity. In addition, the previous methods only consider the same nodes as positive samples, and this paper identifies positive samples based on capturing global information. Extensive experiments on eight public graph benchmark datasets show that the GCH algorithm outperforms existing state-of-the-art algorithms in node classification tasks, even surpassing supervised learning algorithms.
引用
收藏
页码:176 / 192
页数:17
相关论文
共 50 条
  • [1] Higher-Order Graph Contrastive Learning for Recommendation
    Zheng, ZhenZhong
    Li, Jianxin
    Wu, Xiaoming
    Liu, Xiangzhi
    Pei, Lili
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT VI, DASFAA 2024, 2024, 14855 : 35 - 51
  • [2] Rethinking Higher-order Representation Learning with Graph Neural Networks
    Xu, Tuo
    Zou, Lei
    LEARNING ON GRAPHS CONFERENCE, VOL 231, 2023, 231
  • [3] Graph Neural Network for Higher-Order Dependency Networks
    Jin, Di
    Gong, Yingli
    Wang, Zhiqiang
    Yu, Zhizhi
    He, Dongxiao
    Huang, Yuxiao
    Wang, Wenjun
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1622 - 1630
  • [4] Higher-Order Graph Convolutional Embedding for Temporal Networks
    Mo, Xian
    Pang, Jun
    Liu, Zhiming
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2020, PT I, 2020, 12342 : 3 - 15
  • [5] Higher-order Clustering and Pooling for Graph Neural Networks
    Duval, Alexandre
    Malliaros, Fragkiskos
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 426 - 435
  • [6] Hybrid Low-Order and Higher-Order Graph Convolutional Networks
    Lei, Fangyuan
    Liu, Xun
    Dai, Qingyun
    Ling, Bingo Wing-Kuen
    Zhao, Huimin
    Liu, Yan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
  • [7] Predicting Biomedical Interactions With Higher-Order Graph Convolutional Networks
    Kishan, K. C.
    Li, Rui
    Cui, Feng
    Haake, Anne R.
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2022, 19 (02) : 676 - 687
  • [8] Graph Convolution Networks based on Higher-order Trustable Neighbors
    He, Meixia
    Chen, Jianrui
    Li, Jiamin
    Proceedings - 2022 10th International Conference on Information Systems and Computing Technology, ISCTech 2022, 2022, : 215 - 221
  • [9] Contrastive Graph Learning with Graph Convolutional Networks
    Nagendar, G.
    Sitaram, Ramachandrula
    DOCUMENT ANALYSIS SYSTEMS, DAS 2022, 2022, 13237 : 96 - 110
  • [10] LEARNING AND ENCODING HIGHER-ORDER RULES IN NEURAL NETWORKS
    LEVINE, DS
    BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 1995, 27 (02): : 178 - 182