Graph Neural Networks With Adaptive Confidence Discrimination

被引:0
|
作者
Liu, Yanbei [1 ,2 ]
Yu, Lu [3 ]
Zhao, Shichuan [3 ]
Wang, Xiao [4 ]
Geng, Lei [1 ,2 ]
Xiao, Zhitao [1 ,2 ]
Ma, Shuai [5 ]
Pang, Yanwei [6 ,7 ]
机构
[1] Tiangong Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[2] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin 300387, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Beihang Univ, Sch Software, Beijing 100876, Peoples R China
[5] Beihang Univ, Sch Comp Sci & Engn, Beijing 100083, Peoples R China
[6] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[7] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Adaptive confidence discrimination; graph neural network (GNN); graph representation learning; pseudolabel learning;
D O I
10.1109/TNNLS.2024.3446229
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) have demonstrated remarkable success for semisupervised node classification. However, these GNNs are still limited to the conventionally semisupervised framework and cannot fully leverage the potential value of large numbers of unlabeled samples. The pseudolabeling method in semisupervised learning (SSL) is widely recognized because it can clearly leverage unlabeled samples. Nevertheless, the existing pseudolabeling methods usually utilize a fixed threshold for all classes and only use a portion of unlabeled samples (ones with high prediction confidence), which leads to class imbalance and low data utilization. To solve these problems, we propose GNNs with adaptive confidence discrimination (ACDGNN) to fully utilize unlabeled samples for facilitating semisupervised node classification. Specifically, an adaptive confidence discrimination module is designed to divide all unlabeled nodes into two subsets by comparing their confidence scores with the adaptive confidence threshold at each training epoch. Then, different constraint strategies for two subset nodes are employed. Unlabeled nodes with high confidence are used to iteratively expand the label set, while ones with low confidence learn discriminative features by applying contrastive learning. Validated by extensive experiments, the proposed ACDGNN delivers significant accuracy gains over the previous SOTAs: an average improvement of 2.0% on all datasets and 5.7% on the Flickr dataset in particular.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] DAMGNN: Deep adaptive multi-channel graph neural networks
    Li, Yuqiang
    Chen, Wei
    Liao, Jing
    Liu, Chun
    INTELLIGENT DATA ANALYSIS, 2022, 26 (04) : 873 - 891
  • [42] GraphANGEL: Adaptive aNd Structure-Aware Sampling on Graph NEuraL Networks
    Peng, Jingshu
    Shen, Yanyan
    Chen, Lei
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 479 - 488
  • [43] Laplacian Score Benefit Adaptive Filter Selection for Graph Neural Networks
    Wang, Yewen
    Zhang, Shichang
    Cho, John
    Sun, Yizhou
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 19 - 25
  • [44] Soft-mask: Adaptive Substructure Extractions for Graph Neural Networks
    Yang, Mingqi
    Shen, Yanming
    Qi, Heng
    Yin, Baocai
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 2058 - 2068
  • [45] A Block-Based Adaptive Decoupling Framework for Graph Neural Networks
    Shen, Xu
    Zhang, Yuyang
    Xie, Yu
    Wong, Ka-Chun
    Peng, Chengbin
    ENTROPY, 2022, 24 (09)
  • [46] Multi-strategy adaptive data augmentation for Graph Neural Networks
    Juan, Xin
    Liang, Xiao
    Xue, Haotian
    Wang, Xin
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [47] Predicting unseen antibodies' neutralizability via adaptive graph neural networks
    Zhang, Jie
    Du, Yishan
    Zhou, Pengfei
    Ding, Jinru
    Xia, Shuai
    Wang, Qian
    Chen, Feiyang
    Zhou, Mu
    Zhang, Xuemei
    Wang, Weifeng
    Wu, Hongyan
    Lu, Lu
    Zhang, Shaoting
    NATURE MACHINE INTELLIGENCE, 2022, 4 (11) : 964 - 976
  • [48] FP-GNN: Adaptive FPGA accelerator for Graph Neural Networks
    Tian, Teng
    Zhao, Letian
    Wang, Xiaotian
    Wu, Qizhe
    Yuan, Wei
    Jin, Xi
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 136 : 294 - 310
  • [49] Predicting unseen antibodies’ neutralizability via adaptive graph neural networks
    Jie Zhang
    Yishan Du
    Pengfei Zhou
    Jinru Ding
    Shuai Xia
    Qian Wang
    Feiyang Chen
    Mu Zhou
    Xuemei Zhang
    Weifeng Wang
    Hongyan Wu
    Lu Lu
    Shaoting Zhang
    Nature Machine Intelligence, 2022, 4 : 964 - 976
  • [50] Towards Deeper Graph Neural Networks via Layer-Adaptive
    Xu, Bingbing
    Xie, Bin
    Shen, Huawei
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 103 - 106