Graph Stochastic Neural Networks for Semi-supervised Learning

被引:0
|
作者
Wang, Haibo [1 ,2 ]
Zhou, Chuan [3 ,4 ]
Chen, Xin [2 ]
Wu, Jia [5 ]
Pan, Shirui [6 ]
Wang, Jilong [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
[2] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing, Peoples R China
[3] Chinese Acad Sci, Acad Math & Syst Sci, Beijing, Peoples R China
[4] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
[5] Macquarie Univ, Fac Sci & Engn, Sydney, Australia
[6] Monash Univ, Fac Informat Technol, Melbourne, Australia
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved remarkable performance in the task of the semi-supervised node classification. However, most existing models learn a deterministic classification function, which lack sufficient flexibility to explore better choices in the presence of kinds of imperfect observed data such as the scarce labeled nodes and noisy graph structure. To improve the rigidness and inflexibility of deterministic classification functions, this paper proposes a novel framework named Graph Stochastic Neural Networks (GSNN), which aims to model the uncertainty of the classification function by simultaneously learning a family of functions, i:e:; a stochastic function. Specifically, we introduce a learnable graph neural network coupled with a high-dimensional latent variable to model the distribution of the classification function, and further adopt the amortised variational inference to approximate the intractable joint posterior for missing labels and the latent variable. By maximizing the lower-bound of the likelihood for observed node labels, the instantiated models can be trained in an end-to-end manner effectively. Extensive experiments on three real-world datasets show that GSNN achieves substantial performance gain in different scenarios compared with state-of-the-art baselines.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Graph Random Neural Networks for Semi-Supervised Learning on Graphs
    Feng, Wenzheng
    Zhang, Jie
    Dong, Yuxiao
    Han, Yu
    Luan, Huanbo
    Xu, Qian
    Yang, Qiang
    Kharlamov, Evgeny
    Tang, Jie
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] Graph Neural Networks for Soft Semi-Supervised Learning on Hypergraphs
    Yadati, Naganand
    Gao, Tingran
    Asoodeh, Shahab
    Talukdar, Partha
    Louis, Anand
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT I, 2021, 12712 : 447 - 458
  • [3] An In-depth Analysis of Graph Neural Networks for Semi-supervised Learning
    Chen, Yuyan
    Hu, Sen
    Zou, Lei
    [J]. SEMANTIC TECHNOLOGY, JIST 2019, 2020, 1157 : 65 - 77
  • [4] Semi-Supervised Learning and Graph Neural Networks for Fake News Detection
    Benamira, Adrien
    Devillers, Benjamin
    Lesot, Etienne
    Ray, Ayush K.
    Saadi, Manal
    Malliaros, Fragkiskos D.
    [J]. PROCEEDINGS OF THE 2019 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM 2019), 2019, : 568 - 569
  • [5] Semi-Supervised Mixture Learning for Graph Neural Networks With Neighbor Dependence
    Liu, Kai
    Liu, Hongbo
    Wang, Tao
    Hu, Guoqiang
    Ward, Tomas E. E.
    Chen, C. L. Philip
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12528 - 12539
  • [6] CSGNN: Improving Graph Neural Networks with Contrastive Semi-supervised Learning
    Song, Yumeng
    Gu, Yu
    Li, Xiaohua
    Li, Chuanwen
    Yu, Ge
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 731 - 738
  • [7] Active and Semi-Supervised Graph Neural Networks for Graph Classification
    Xie, Yu
    Lv, Shengze
    Qian, Yuhua
    Wen, Chao
    Liang, Jiye
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2022, 8 (04) : 920 - 932
  • [8] MGLNN: Semi-supervised learning via Multiple Graph Cooperative Learning Neural Networks
    Jiang, Bo
    Chen, Si
    Wang, Beibei
    Luo, Bin
    [J]. NEURAL NETWORKS, 2022, 153 : 204 - 214
  • [9] SEMI-SUPERVISED MULTIMODALITY LEARNING WITH GRAPH CONVOLUTIONAL NEURAL NETWORKS FOR DISEASE DIAGNOSIS
    Huang, Yongxiang
    Chung, Albert C. S.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2451 - 2455
  • [10] Graph Ensemble Networks for Semi-supervised Embedding Learning
    Tang, Hui
    Liang, Xun
    Wu, Bo
    Guan, Zhenyu
    Guo, Yuhui
    Zheng, Xiangping
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2021, 12815 : 408 - 420