Graph Neural Networks With Adaptive Confidence Discrimination

被引:0
|
作者
Liu, Yanbei [1 ,2 ]
Yu, Lu [3 ]
Zhao, Shichuan [3 ]
Wang, Xiao [4 ]
Geng, Lei [1 ,2 ]
Xiao, Zhitao [1 ,2 ]
Ma, Shuai [5 ]
Pang, Yanwei [6 ,7 ]
机构
[1] Tiangong Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[2] Tianjin Key Lab Optoelect Detect Technol & Syst, Tianjin 300387, Peoples R China
[3] Tiangong Univ, Sch Elect & Informat Engn, Tianjin 300387, Peoples R China
[4] Beihang Univ, Sch Software, Beijing 100876, Peoples R China
[5] Beihang Univ, Sch Comp Sci & Engn, Beijing 100083, Peoples R China
[6] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[7] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Adaptive confidence discrimination; graph neural network (GNN); graph representation learning; pseudolabel learning;
D O I
10.1109/TNNLS.2024.3446229
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) have demonstrated remarkable success for semisupervised node classification. However, these GNNs are still limited to the conventionally semisupervised framework and cannot fully leverage the potential value of large numbers of unlabeled samples. The pseudolabeling method in semisupervised learning (SSL) is widely recognized because it can clearly leverage unlabeled samples. Nevertheless, the existing pseudolabeling methods usually utilize a fixed threshold for all classes and only use a portion of unlabeled samples (ones with high prediction confidence), which leads to class imbalance and low data utilization. To solve these problems, we propose GNNs with adaptive confidence discrimination (ACDGNN) to fully utilize unlabeled samples for facilitating semisupervised node classification. Specifically, an adaptive confidence discrimination module is designed to divide all unlabeled nodes into two subsets by comparing their confidence scores with the adaptive confidence threshold at each training epoch. Then, different constraint strategies for two subset nodes are employed. Unlabeled nodes with high confidence are used to iteratively expand the label set, while ones with low confidence learn discriminative features by applying contrastive learning. Validated by extensive experiments, the proposed ACDGNN delivers significant accuracy gains over the previous SOTAs: an average improvement of 2.0% on all datasets and 5.7% on the Flickr dataset in particular.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Graph Neural Networks with Adaptive Readouts
    Buterez, David
    Janet, Jon Paul
    Kiddle, Steven J.
    Oglic, Dino
    Lio, Pietro
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [2] Graph Neural Networks with Adaptive Residual
    Liu, Xiaorui
    Ding, Jiayuan
    Jin, Wei
    Xu, Han
    Ma, Yao
    Liu, Zitao
    Tang, Jiliang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] Graph Neural Networks With Adaptive Structures
    Zhang, Zepeng
    Lu, Songtao
    Huang, Zengfeng
    Zhao, Ziping
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2025, 19 (01) : 181 - 194
  • [4] Adaptive Graph Convolutional Neural Networks
    Li, Ruoyu
    Wang, Sheng
    Zhu, Feiyun
    Huang, Junzhou
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3546 - 3553
  • [5] Adaptive Diffusion in Graph Neural Networks
    Zhao, Jialin
    Dong, Yuxiao
    Ding, Ming
    Kharlamov, Evgeny
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] Graph Convolutional Neural Networks with Geometric and Discrimination information
    Shang, Ronghua
    Meng, Yang
    Zhang, Weitong
    Shang, Fanhua
    Jiao, Licheng
    Yang, Shuyuan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
  • [7] GRAPH-ADAPTIVE ACTIVATION FUNCTIONS FOR GRAPH NEURAL NETWORKS
    Iancu, Bianca
    Ruiz, Luana
    Ribeiro, Alejandro
    Isufi, Elvin
    PROCEEDINGS OF THE 2020 IEEE 30TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2020,
  • [8] An Adaptive FCM Probabilistic Neural Networks with Confidence Criteria
    Gao Zhihua
    Ben Kerong
    Zhang Linke
    2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL II, 2010, : 252 - 255
  • [9] Adaptive Parallel Training for Graph Neural Networks
    Ma, Kaihao
    Liu, Renjie
    Yan, Xiao
    Cai, Zhenkun
    Song, Xiang
    Wang, Minjie
    Li, Yichao
    Cheng, James
    PROCEEDINGS OF THE 2025 THE 30TH ACM SIGPLAN ANNUAL SYMPOSIUM ON PRINCIPLES AND PRACTICE OF PARALLEL PROGRAMMING, PPOPP 2025, 2025, : 29 - 42
  • [10] Adaptive dependency learning graph neural networks
    Sriramulu, Abishek
    Fourrier, Nicolas
    Bergmeir, Christoph
    INFORMATION SCIENCES, 2023, 625 : 700 - 714