TRAINING STABLE GRAPH NEURAL NETWORKS THROUGH CONSTRAINED LEARNING

被引:3
|
作者
Cervino, Juan [1 ]
Ruiz, Luana [1 ]
Ribeiro, Alejandro [1 ]
机构
[1] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
关键词
Graph Neural Networks; Constrained Learning; Stability;
D O I
10.1109/ICASSP43922.2022.9746912
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we leverage the stability property of GNNs as a typing point in order to seek for representations that are stable within a distribution. We propose a novel constrained learning approach by imposing a constraint on the stability condition of the GNN within a perturbation of choice. We showcase our framework in real world data, corroborating that we are able to obtain more stable representations while not compromising the overall accuracy of the predictor.
引用
收藏
页码:4223 / 4227
页数:5
相关论文
共 50 条
  • [1] Learning Stochastic Graph Neural Networks With Constrained Variance
    Gao, Zhan
    Isufi, Elvin
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 358 - 371
  • [2] Neural Graph Learning: Training Neural Networks Using Graphs
    Bui, Thang D.
    Ravi, Sujith
    Ramavajjala, Vivek
    [J]. WSDM'18: PROCEEDINGS OF THE ELEVENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2018, : 64 - 71
  • [3] Constrained Training of Recurrent Neural Networks for Automata Learning
    Aichernig, Bernhard K.
    Koenig, Sandra
    Mateis, Cristinel
    Pferscher, Andrea
    Schmidt, Dominik
    Tappler, Martin
    [J]. SOFTWARE ENGINEERING AND FORMAL METHODS, SEFM 2022, 2022, 13550 : 155 - 172
  • [4] Training Deep Neural Networks with Constrained Learning Parameters
    Date, Prasanna
    Carothers, Christopher D.
    Mitchell, John E.
    Hendler, James A.
    Magdon-Ismail, Malik
    [J]. 2020 INTERNATIONAL CONFERENCE ON REBOOTING COMPUTING (ICRC 2020), 2020, : 107 - 115
  • [5] VARIANCE-CONSTRAINED LEARNING FOR STOCHASTIC GRAPH NEURAL NETWORKS
    Gao, Zhan
    Isufi, Elvin
    Ribeiro, Alejandro
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5245 - 5249
  • [6] Dirichlet Energy Constrained Learning for Deep Graph Neural Networks
    Zhou, Kaixiong
    Huang, Xiao
    Zha, Daochen
    Chen, Rui
    Li, Li
    Choi, Soo-Hyun
    Hu, Xia
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [7] Training cellular neural networks with stable learning algorithm
    Moreno-Armendariz, Marco A.
    Pazienza, Giovanni Egidio
    Yu, Wen
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 558 - 563
  • [8] Learning Stable Graph Neural Networks via Spectral Regularization
    Gao, Zhan
    Isufi, Elvin
    [J]. 2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 361 - 365
  • [9] Self-Constrained Graph Stochastic Neural Networks for Graphstructure Learning
    Key Lab of Intelligent Perception and Image Understanding of Ministry of Education, International Center of Intelligent Perception and Computation, Xidian University, Xi’an
    710071, China
    [J].
  • [10] Learning by Transference: Training Graph Neural Networks on Growing Graphs
    Cervino, Juan
    Ruiz, Luana
    Ribeiro, Alejandro
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 233 - 247