Batch virtual adversarial training for graph convolutional networks

被引:0
|
作者
Deng, Zhijie [1 ,2 ]
Dong, Yinpeng [1 ]
Zhu, Jun [1 ]
机构
[1] Tsinghua Univ, Inst AI, BNRist Ctr, THU Bosch ML Ctr,Dept Comp Sci & Tech,THBI Lab, Beijing, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China
来源
AI OPEN | 2023年 / 4卷
关键词
Virtual adversarial training; Graph convolutional networks; Semi-supervised node classification;
D O I
10.1016/j.aiopen.2023.08.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present batch virtual adversarial training (BVAT), a novel regularization method for graph convolutional networks (GCNs). BVAT addresses the issue that GCNs do not ensure the smoothness of the model's output distribution against local perturbations around the input node features. We propose two algorithms, samplingbased BVAT and optimization -based BVAT, which promote the output smoothness of GCN classifiers based on the generated virtual adversarial perturbations for either a subset of independent nodes or all nodes via an elaborate optimization process. Extensive experiments on three citation network datasets Cora , Citeseer and Pubmed and a knowledge graph dataset Nell validate the efficacy of the proposed method in semi -supervised node classification tasks.
引用
收藏
页码:73 / 79
页数:7
相关论文
共 50 条
  • [1] Robust graph convolutional networks with directional graph adversarial training
    Hu, Weibo
    Chen, Chuan
    Chang, Yaomin
    Zheng, Zibin
    Du, Yunfei
    [J]. APPLIED INTELLIGENCE, 2021, 51 (11) : 7812 - 7826
  • [2] Robust graph convolutional networks with directional graph adversarial training
    Weibo Hu
    Chuan Chen
    Yaomin Chang
    Zibin Zheng
    Yunfei Du
    [J]. Applied Intelligence, 2021, 51 : 7812 - 7826
  • [3] GRAPH CONVOLUTIONAL NETWORKS & ADVERSARIAL TRAINING FOR JOINT EXTRACTION OF ENTITY AND RELATION
    Qu, Xiaolong
    Zhang, Yang
    Tian, Ziwei
    LI, Yuxun
    LI, Dongmei
    Zhang, Xiaoping
    [J]. UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2023, 85 (03): : 213 - 224
  • [4] Graph Convolutional Networks for Target-oriented Opinion Words Extraction with Adversarial Training
    Zhou, Yan
    Jiang, Wei
    Song, Po
    Su, Yipeng
    Guo, Tao
    Han, Jizhong
    Hu, Songlin
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [5] Node ranking algorithm using Graph Convolutional Networks and mini-batch training
    Li, Wenjun
    Li, Ting
    Nikougoftar, Elaheh
    [J]. CHAOS SOLITONS & FRACTALS, 2024, 187
  • [6] Distributed Training of Graph Convolutional Networks
    Scardapane, Simone
    Spinelli, Indro
    Di Lorenzo, Paolo
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2021, 7 : 87 - 100
  • [7] DEFENDING GRAPH CONVOLUTIONAL NETWORKS AGAINST ADVERSARIAL ATTACKS
    Ioannidis, Vassilis N.
    Giannakis, Georgios B.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8469 - 8473
  • [8] Enhancing Social Recommendation With Adversarial Graph Convolutional Networks
    Yu, Junliang
    Yin, Hongzhi
    Li, Jundong
    Gao, Min
    Huang, Zi
    Cui, Lizhen
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (08) : 3727 - 3739
  • [9] Graph Convolutional Adversarial Networks for Spatiotemporal Anomaly Detection
    Deng, Leyan
    Lian, Defu
    Huang, Zhenya
    Chen, Enhong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (06) : 2416 - 2428
  • [10] Robust Graph Convolutional Networks Against Adversarial Attacks
    Zhu, Dingyuan
    Zhang, Ziwei
    Cui, Peng
    Zhu, Wenwu
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1399 - 1407