Batch virtual adversarial training for graph convolutional networks

被引:0
|
作者
Deng, Zhijie [1 ,2 ]
Dong, Yinpeng [1 ]
Zhu, Jun [1 ]
机构
[1] Tsinghua Univ, Inst AI, BNRist Ctr, THU Bosch ML Ctr,Dept Comp Sci & Tech,THBI Lab, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China
来源
AI OPEN | 2023年 / 4卷
关键词
Virtual adversarial training; Graph convolutional networks; Semi-supervised node classification;
D O I
10.1016/j.aiopen.2023.08.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present batch virtual adversarial training (BVAT), a novel regularization method for graph convolutional networks (GCNs). BVAT addresses the issue that GCNs do not ensure the smoothness of the model's output distribution against local perturbations around the input node features. We propose two algorithms, samplingbased BVAT and optimization -based BVAT, which promote the output smoothness of GCN classifiers based on the generated virtual adversarial perturbations for either a subset of independent nodes or all nodes via an elaborate optimization process. Extensive experiments on three citation network datasets Cora , Citeseer and Pubmed and a knowledge graph dataset Nell validate the efficacy of the proposed method in semi -supervised node classification tasks.
引用
收藏
页码:73 / 79
页数:7
相关论文
共 50 条
  • [21] Adversarial dense graph convolutional networks for single-cell classification
    Wang, Kangwei
    Li, Zhengwei
    You, Zhu-Hong
    Han, Pengyong
    Nie, Ru
    [J]. BIOINFORMATICS, 2023, 39 (02)
  • [22] Network Representation Learning Framework Based on Adversarial Graph Convolutional Networks
    Chen, Mengxue
    Liu, Yong
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2019, 32 (11): : 1042 - 1050
  • [23] Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling
    Li, Hongkang
    Wang, Meng
    Liu, Sijia
    Chen, Pin-Yu
    Xiong, Jinjun
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [24] Derivative-free optimization adversarial attacks for graph convolutional networks
    Yang, Runze
    Long, Teng
    [J]. PEERJ COMPUTER SCIENCE, 2021, 7 : 1 - 23
  • [25] Indirect Adversarial Attacks via Poisoning Neighbors for Graph Convolutional Networks
    Takahashi, Tsubasa
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 1395 - 1400
  • [26] Certifiable Robustness and Robust Training for Graph Convolutional Networks
    Zuegner, Daniel
    Guennemann, Stephan
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 246 - 256
  • [27] Stochastic Training of Graph Convolutional Networks with Variance Reduction
    Chen, Jianfei
    Zhu, Jun
    Song, Le
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [28] On Provable Benefits of Depth in Training Graph Convolutional Networks
    Cong, Weilin
    Ramezani, Morteza
    Mahdavi, Mehrdad
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [29] Degree aware based adversarial graph convolutional networks for entity alignment in heterogeneous knowledge graph
    Wang, Hanchen
    Wang, Yining
    Li, Jianfeng
    Luo, Tao
    [J]. NEUROCOMPUTING, 2022, 487 : 99 - 109
  • [30] Robust Graph Neural Networks Against Adversarial Attacks via Jointly Adversarial Training
    Tian, Hu
    Ye, Bowei
    Zheng, Xiaolong
    Wu, Desheng Dash
    [J]. IFAC PAPERSONLINE, 2020, 53 (05): : 420 - 425