On the Robustness of Graph Neural Diffusion to Topology Perturbations

被引:0
|
作者
Song, Yang [1 ]
Kang, Qiyu [2 ]
Wang, Sijie [2 ]
Zhao, Kai [2 ]
Tay, Wee Peng [2 ]
机构
[1] Nanyang Technol Univ, AI C3, Singapore, Singapore
[2] Nanyang Technol Univ, Singapore, Singapore
关键词
SEMIGROUPS; STABILITY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural diffusion on graphs is a novel class of graph neural networks that has attracted increasing attention recently. The capability of graph neural partial differential equations (PDEs) in addressing common hurdles of graph neural networks (GNNs), such as the problems of over-smoothing and bottlenecks, has been investigated but not their robustness to adversarial attacks. In this work, we explore the robustness properties of graph neural PDEs. We empirically demonstrate that graph neural PDEs are intrinsically more robust against topology perturbation as compared to other GNNs. We provide insights into this phenomenon by exploiting the stability of the heat semigroup under graph topology perturbations. We discuss various graph diffusion operators and relate them to existing graph neural PDEs. Furthermore, we propose a general graph neural PDE framework based on which a new class of robust GNNs can be defined. We verify that the new model achieves comparable state-of-the-art performance on several benchmark datasets.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Understanding the Representation Power of Graph Neural Networks in Learning Graph Topology
    Dehmamy, Nima
    Barabasi, Albert-Laszlo
    Yu, Rose
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [22] GRAPH NEURAL REACTION DIFFUSION MODELS
    Eliasof, Moshe
    Haber, Eldad
    Treister, Eran
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2024, 46 (04): : C399 - C420
  • [23] Adaptive Diffusion in Graph Neural Networks
    Zhao, Jialin
    Dong, Yuxiao
    Ding, Ming
    Kharlamov, Evgeny
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [24] DeepGRAND: Deep Graph Neural Diffusion
    Khang Nguyen
    Hieu Nong
    Khuong Nguyen
    Nguyen, Tan M.
    Vinh Nguyen
    FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, : 1044 - 1048
  • [25] Towards Verifying Robustness of Neural Networks Against A Family of Semantic Perturbations
    Mohapatra, Jeet
    Weng, Tsui-Wei
    Chen, Pin-Yu
    Liu, Sijia
    Daniel, Luca
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 241 - 249
  • [26] Verifying Attention Robustness of Deep Neural Networks Against Semantic Perturbations
    Munakata, Satoshi
    Urban, Caterina
    Yokoyama, Haruki
    Yamamoto, Koji
    Munakata, Kazuki
    NASA FORMAL METHODS, NFM 2023, 2023, 13903 : 37 - 61
  • [27] Verifying Attention Robustness of Deep Neural Networks against Semantic Perturbations
    Munakata, Satoshi
    Urban, Caterina
    Yokoyama, Haruki
    Yamamoto, Koji
    Munakata, Kazuki
    2022 29TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, APSEC, 2022, : 560 - 561
  • [28] An Empirical Study on the Effect of Training Data Perturbations on Neural Network Robustness
    Wang, Jie
    Wu, Zili
    Lu, Minyan
    Ai, Jun
    SENSORS, 2024, 24 (15)
  • [29] On the Topology Awareness and Generalization Performance of Graph Neural Networks
    Su, Junwei
    Wu, Chuan
    COMPUTER VISION - ECCV 2024, PT LXXXIV, 2025, 15142 : 73 - 89
  • [30] Graph Neural Networks and 3-dimensional topology
    Ri, Song Jin
    Putrov, Pavel
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (03):