Graph Structure Learning via Lottery Hypothesis at Scale

被引:0
|
作者
Wang, Yuxin [1 ,2 ]
Hu, Xiannian [1 ]
Xie, Jiaqing [3 ]
Yin, Zhangyue [1 ]
Zhou, Yunhua [1 ]
Huang, Xuanjing [1 ,2 ]
Qiu, Xipeng [1 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Fudan Univ, Inst Modern Languages & Linguist, Shanghai, Peoples R China
[3] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph Neural Networks; Graph Structural Learning; Lottery Hypothesis; Large Scale Graph Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) are commonly applied to analyze real-world graph structured data. However, GNNs are sensitive to the given graph structure, which cast importance on graph structure learning to find optimal graph structures and representations. Previous methods have been restricted from large graphs due to high computational complexity. Lottery ticket hypothesis suggests that there exists a subnetwork that has comparable or better performance with proto-networks, which has been transferred to suit for pruning GNNs recently. There are few studies that address lottery ticket hypothesis's performance on defense in graphs. In this paper, we propose a scalable graph structure learning method leveraging lottery (ticket) hypothesis : GSL-LH. Our experiments show that GSL-LH can outperform its backbone model without attack and show better robustness against attack, achieving state-of-the-art performances in regular-size graphs compared to other graph structure learning methods without feature augmentation. In large graphs, GSL-LH can have comparable results with state-of-the-art defense methods other than graph structure learning, while bringing some insights into explanation of robustness.(1) (2) (3)
引用
收藏
页数:16
相关论文
共 50 条
  • [11] Improving fraud detection via imbalanced graph structure learning
    Ren, Lingfei
    Hu, Ruimin
    Liu, Yang
    Li, Dengshi
    Wu, Junhang
    Zang, Yilong
    Hu, Wenyi
    MACHINE LEARNING, 2024, 113 (03) : 1069 - 1090
  • [12] Robust Graph Structure Learning via Multiple Statistical Tests
    Wang, Yaohua
    Zhang, Fangyi
    Lin, Ming
    Wang, Senzhang
    Sun, Xiuyu
    Jin, Rong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [13] Contrastive Graph Structure Learning via Information Bottleneck for Recommendation
    Wei, Chunyu
    Liang, Jian
    Liu, Di
    Wang, Fei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [14] Improving fraud detection via imbalanced graph structure learning
    Lingfei Ren
    Ruimin Hu
    Yang Liu
    Dengshi Li
    Junhang Wu
    Yilong Zang
    Wenyi Hu
    Machine Learning, 2024, 113 : 1069 - 1090
  • [15] Prohibited Item Detection via Risk Graph Structure Learning
    Ji, Yugang
    Chu, Guanyi
    Wang, Xiao
    Shi, Chuan
    Zhao, Jianan
    Du, Junping
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1434 - 1443
  • [16] Compact Graph Structure Learning via Mutual Information Compression
    Liu, Nian
    Wang, Xiao
    Wu, Lingfei
    Chen, Yu
    Guo, Xiaojie
    Shi, Chuan
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1601 - 1610
  • [17] Learning Causal Chain Graph Structure via Alternate Learning and Double Pruning
    Yang, Shujing
    Cao, Fuyuan
    Yu, Kui
    Liang, Jiye
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (04) : 442 - 456
  • [18] Probabilistic Semi-Supervised Learning via Sparse Graph Structure Learning
    Wang, Li
    Chan, Raymond
    Zeng, Tieyong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 853 - 867
  • [19] LEARNING GRAPH STRUCTURE WITH STATIONARY GRAPH SIGNALS VIA FIRST-ORDER APPROXIMATION
    Zhu, Zhaowei
    Jin, Shengda
    Song, Xuming
    Luo, Xiliang
    2017 22ND INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2017,
  • [20] Kernelized multi-view graph clustering via graph structure preserving and consensus affinity graph learning
    Zhongyan Gui
    Jing Yang
    Zhiqiang Xie
    Cuicui Ye
    Pattern Analysis and Applications, 2025, 28 (2)