Graph Neural Networks With Adaptive Confidence Discrimination

被引:0
|
作者
Liu, Yanbei [1 ,2 ]
Yu, Lu [3 ]
Zhao, Shichuan [3 ]
Wang, Xiao [4 ]
Geng, Lei [1 ,2 ]
Xiao, Zhitao [1 ,2 ]
Ma, Shuai [5 ]
Pang, Yanwei [6 ,7 ]
机构
[1] Tiangong Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[2] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin 300387, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Beihang Univ, Sch Software, Beijing 100876, Peoples R China
[5] Beihang Univ, Sch Comp Sci & Engn, Beijing 100083, Peoples R China
[6] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[7] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Adaptive confidence discrimination; graph neural network (GNN); graph representation learning; pseudolabel learning;
D O I
10.1109/TNNLS.2024.3446229
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) have demonstrated remarkable success for semisupervised node classification. However, these GNNs are still limited to the conventionally semisupervised framework and cannot fully leverage the potential value of large numbers of unlabeled samples. The pseudolabeling method in semisupervised learning (SSL) is widely recognized because it can clearly leverage unlabeled samples. Nevertheless, the existing pseudolabeling methods usually utilize a fixed threshold for all classes and only use a portion of unlabeled samples (ones with high prediction confidence), which leads to class imbalance and low data utilization. To solve these problems, we propose GNNs with adaptive confidence discrimination (ACDGNN) to fully utilize unlabeled samples for facilitating semisupervised node classification. Specifically, an adaptive confidence discrimination module is designed to divide all unlabeled nodes into two subsets by comparing their confidence scores with the adaptive confidence threshold at each training epoch. Then, different constraint strategies for two subset nodes are employed. Unlabeled nodes with high confidence are used to iteratively expand the label set, while ones with low confidence learn discriminative features by applying contrastive learning. Validated by extensive experiments, the proposed ACDGNN delivers significant accuracy gains over the previous SOTAs: an average improvement of 2.0% on all datasets and 5.7% on the Flickr dataset in particular.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Adaptive Layout Decomposition with Graph Embedding Neural Networks
    Li, Wei
    Xia, Jialu
    Ma, Yuzhe
    Li, Jialu
    Lin, Yibo
    Yu, Bei
    PROCEEDINGS OF THE 2020 57TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2020,
  • [22] Adaptive Bandit Cluster Selection for Graph Neural Networks
    Ayache, Ghadir
    Hugues, Thomas
    Xu, Chris
    Zhang, Julia
    Hu, Diane
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 1385 - 1392
  • [23] GeniePath: Graph Neural Networks with Adaptive Receptive Paths
    Liu, Ziqi
    Chen, Chaochao
    Li, Longfei
    Zhou, Jun
    Li, Xiaolong
    Song, Le
    Qi, Yuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4424 - 4431
  • [24] Bayesian Graph Neural Networks with Adaptive Connection Sampling
    Hasanzadeh, Arman
    Hajiramezanali, Ehsan
    Boluki, Shahin
    Zhou, Mingyuan
    Duffield, Nick
    Narayanan, Krishna
    Qian, Xiaoning
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [25] Differentially private graph neural networks for graph classification and its adaptive optimization
    Li, Yong
    Song, Xiao
    Gong, Kaiqi
    Liu, Songsong
    Li, Wenxin
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 263
  • [26] Confidence-Aware Graph Neural Networks for Learning Reliability Assessment Commitments
    Park, Seonho
    Chen, Wenbo
    Han, Dahye
    Tanneau, Mathieu
    Van Hentenryck, Pascal
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 3839 - 3850
  • [27] Uncertainty-Confidence Fused Pseudo-labeling for Graph Neural Networks
    Long, Pingjiang
    Jian, Zihao
    Liu, Xiangrong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 331 - 342
  • [28] The Challenge of Classification Confidence Estimation in Dynamically-Adaptive Neural Networks
    Dall'Occo, Francesco
    Bueno-Crespo, Andres
    Abellan, Jose L.
    Bertozzi, Davide
    Favalli, Michele
    EMBEDDED COMPUTER SYSTEMS: ARCHITECTURES, MODELING, AND SIMULATION, SAMOS 2021, 2022, 13227 : 505 - 522
  • [29] Adaptive Ensemble Prediction for Deep Neural Networks based on Confidence Level
    Inoue, Hiroshi
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [30] Adaptive Multi-layer Contrastive Graph Neural Networks
    Shuhao Shi
    Pengfei Xie
    Xu Luo
    Kai Qiao
    Linyuan Wang
    Jian Chen
    Bin Yan
    Neural Processing Letters, 2023, 55 : 4757 - 4776