Self-supervised Graph Learning with Segmented Graph Channels

被引:0
|
作者
Gao, Hang [1 ,2 ]
Li, Jiangmeng [1 ,2 ]
Zheng, Changwen [2 ]
机构
[1] Univ Chinese Acad Sci, Zhongguancun East Road 80, Beijing 100081, Peoples R China
[2] Chinese Acad Sci, Inst Software, Sci & Technol Integrated Infomat Syst Lab, Zhongguancun South Fourth St 4, Beijing 100083, Peoples R China
关键词
Graph neural network; Self-supervised learning; Unsupervised learning; Contrastive learning; Node classification;
D O I
10.1007/978-3-031-26390-3_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Self-supervised graph learning adopts self-defined signals as supervision to learn representations. This learning paradigm solves the critical problem of utilizing unlabeled graph data. Conventional self-supervised graph learning methods rely on graph data augmentation to generate different views of the input data as self-defined signals. However, the views generated by such an approach contain amounts of identical node features, which leads to the learning of redundant information. To this end, we propose Self-Supervised Graph Learning with Segmented Graph Channels (SGL-SGC) to address the issue. SGL-SGC divides the input graph data across the feature dimensions as Segmented Graph Channels (SGCs). By combining SGCs with data augmentation, SGL-SGC can generate views that vastly reduce the redundant information. We further design a feature-level weight-sensitive loss to jointly accelerate optimization and avoid the model falling into a local optimum. Empirically, the experiments on multiple benchmark datasets demonstrate that SGL-SGC outperforms the state-of-the-art methods in contrastive graph learning tasks. Ablation studies verify the effectiveness and efficiency of different parts of SGL-SGC.
引用
收藏
页码:293 / 308
页数:16
相关论文
共 50 条
  • [1] Self-supervised Graph Learning for Recommendation
    Wu, Jiancan
    Wang, Xiang
    Feng, Fuli
    He, Xiangnan
    Chen, Liang
    Lian, Jianxun
    Xie, Xing
    [J]. SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 726 - 735
  • [2] Graph Adversarial Self-Supervised Learning
    Yang, Longqi
    Zhang, Liangliang
    Yang, Wenjing
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] Graph Self-Supervised Learning: A Survey
    Liu, Yixin
    Jin, Ming
    Pan, Shirui
    Zhou, Chuan
    Zheng, Yu
    Xia, Feng
    Yu, Philip S.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) : 5879 - 5900
  • [4] Self-Supervised Bidirectional Learning for Graph Matching
    Guo, Wenqi
    Zhang, Lin
    Tu, Shikui
    Xu, Lei
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7784 - 7792
  • [5] Contrastive Self-supervised Learning for Graph Classification
    Zeng, Jiaqi
    Xie, Pengtao
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10824 - 10832
  • [6] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    [J]. 36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [7] Self-supervised Adaptive Aggregator Learning on Graph
    Lin, Bei
    Luo, Binli
    He, Jiaojiao
    Gui, Ning
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 29 - 41
  • [8] Self-supervised Learning of Visual Graph Matching
    Liu, Chang
    Zhang, Shaofeng
    Yang, Xiaokang
    Yan, Junchi
    [J]. COMPUTER VISION, ECCV 2022, PT XXIII, 2022, 13683 : 370 - 388
  • [9] Graph Self-supervised Learning with Accurate Discrepancy Learning
    Kim, Dongki
    Baek, Jinheon
    Hwang, Sung Ju
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning
    Cheng, Jiashun
    Li, Man
    Li, Jia
    Tsung, Fugee
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7131 - 7139