Batch virtual adversarial training for graph convolutional networks

被引:0
|
作者
Deng, Zhijie [1 ,2 ]
Dong, Yinpeng [1 ]
Zhu, Jun [1 ]
机构
[1] Tsinghua Univ, Inst AI, BNRist Ctr, THU Bosch ML Ctr,Dept Comp Sci & Tech,THBI Lab, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China
来源
AI OPEN | 2023年 / 4卷
关键词
Virtual adversarial training; Graph convolutional networks; Semi-supervised node classification;
D O I
10.1016/j.aiopen.2023.08.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present batch virtual adversarial training (BVAT), a novel regularization method for graph convolutional networks (GCNs). BVAT addresses the issue that GCNs do not ensure the smoothness of the model's output distribution against local perturbations around the input node features. We propose two algorithms, samplingbased BVAT and optimization -based BVAT, which promote the output smoothness of GCN classifiers based on the generated virtual adversarial perturbations for either a subset of independent nodes or all nodes via an elaborate optimization process. Extensive experiments on three citation network datasets Cora , Citeseer and Pubmed and a knowledge graph dataset Nell validate the efficacy of the proposed method in semi -supervised node classification tasks.
引用
收藏
页码:73 / 79
页数:7
相关论文
共 50 条
  • [31] On the limitations of adversarial training for robust image classification with convolutional neural networks
    Carletti, Mattia
    Sinigaglia, Erto
    Terzi, Matteo
    Susto, Gian Antonio
    [J]. INFORMATION SCIENCES, 2024, 675
  • [32] Organic crystal structure prediction via coupled generative adversarial networks and graph convolutional networks
    Ye, Zhuyifan
    Wang, Nannan
    Zhou, Jiantao
    Ouyang, Defang
    [J]. INNOVATION, 2024, 5 (02):
  • [33] PolicyClusterGCN: Identifying Efficient Clusters for Training Graph Convolutional Networks
    Gurukar, Saket
    Venkatakrishnan, Shaileshh Bojja
    Ravindran, Balaraman
    Parthasarathy, Srinivasan
    [J]. PROCEEDINGS OF THE 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2023, 2023, : 245 - 252
  • [34] HyperGCN: A New Method of Training Graph Convolutional Networks on Hypergraphs
    Yadati, Naganand
    Nimishakavi, Madhav
    Yadav, Prateek
    Nitin, Vikram
    Louis, Anand
    Talukdar, Partha
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [35] Sampling Methods for Efficient Training of Graph Convolutional Networks: A Survey
    Liu, Xin
    Yan, Mingyu
    Deng, Lei
    Li, Guoqi
    Ye, Xiaochun
    Fan, Dongrui
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (02) : 205 - 234
  • [36] Robust Training of Graph Convolutional Networks via Latent Perturbation
    Jin, Hongwei
    Zhang, Xinhua
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT III, 2021, 12459 : 394 - 411
  • [37] Sampling Methods for Efficient Training of Graph Convolutional Networks: A Survey
    Xin Liu
    Mingyu Yan
    Lei Deng
    Guoqi Li
    Xiaochun Ye
    Dongrui Fan
    [J]. IEEE/CAA Journal of Automatica Sinica, 2022, 9 (02) : 205 - 234
  • [38] Text Classification Model Based on Graph Attention Networks and Adversarial Training
    Li, Jing
    Jian, Yumei
    Xiong, Yujie
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [39] ε-k anonymization and adversarial training of graph neural networks for privacy preservation in social networks
    Tian, Hu
    Zheng, Xiaolong
    Zhang, Xingwei
    Zeng, Daniel Dajun
    [J]. ELECTRONIC COMMERCE RESEARCH AND APPLICATIONS, 2021, 50
  • [40] Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On
    Vidaurre, Raquel
    Santesteban, Igor
    Garces, Elena
    Casas, Dan
    [J]. COMPUTER GRAPHICS FORUM, 2020, 39 (08) : 145 - 156