Graph Structure Learning via Lottery Hypothesis at Scale

被引:0
|
作者
Wang, Yuxin [1 ,2 ]
Hu, Xiannian [1 ]
Xie, Jiaqing [3 ]
Yin, Zhangyue [1 ]
Zhou, Yunhua [1 ]
Huang, Xuanjing [1 ,2 ]
Qiu, Xipeng [1 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Fudan Univ, Inst Modern Languages & Linguist, Shanghai, Peoples R China
[3] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph Neural Networks; Graph Structural Learning; Lottery Hypothesis; Large Scale Graph Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) are commonly applied to analyze real-world graph structured data. However, GNNs are sensitive to the given graph structure, which cast importance on graph structure learning to find optimal graph structures and representations. Previous methods have been restricted from large graphs due to high computational complexity. Lottery ticket hypothesis suggests that there exists a subnetwork that has comparable or better performance with proto-networks, which has been transferred to suit for pruning GNNs recently. There are few studies that address lottery ticket hypothesis's performance on defense in graphs. In this paper, we propose a scalable graph structure learning method leveraging lottery (ticket) hypothesis : GSL-LH. Our experiments show that GSL-LH can outperform its backbone model without attack and show better robustness against attack, achieving state-of-the-art performances in regular-size graphs compared to other graph structure learning methods without feature augmentation. In large graphs, GSL-LH can have comparable results with state-of-the-art defense methods other than graph structure learning, while bringing some insights into explanation of robustness.(1) (2) (3)
引用
收藏
页数:16
相关论文
共 50 条
  • [1] A Unified Lottery Ticket Hypothesis for Graph Neural Networks
    Chen, Tianlong
    Sui, yongduo
    Chen, Xuxi
    Zhang, Aston
    Wang, Zhangyang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [2] Graph Classification via Graph Structure Learning
    Tu Huynh
    Tuyen Thanh Thi Ho
    Bac Le
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2022, PT II, 2022, 13758 : 269 - 281
  • [3] Learning graph structure via graph convolutional networks
    Zhang, Qi
    Chang, Jianlong
    Meng, Gaofeng
    Xu, Shibiao
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION, 2019, 95 : 308 - 318
  • [4] Dimensionality Reduction via Graph Structure Learning
    Mao, Qi
    Wang, Li
    Goodison, Steve
    Sun, Yijun
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 765 - 774
  • [6] Exploring lottery ticket hypothesis in few-shot learning
    Xie, Yu
    Sun, Qiang
    Fu, Yanwei
    NEUROCOMPUTING, 2023, 550
  • [7] Learning fair representations via rebalancing graph structure
    Zhang, Guixian
    Cheng, Debo
    Yuan, Guan
    Zhang, Shichao
    INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (01)
  • [8] PROSE: Graph Structure Learning via Progressive Strategy
    Wang, Huizhao
    Fu, Yao
    Yu, Tao
    Hu, Linghui
    Jiang, Weihao
    Pu, Shiliang
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2337 - 2348
  • [9] Large Scale Video Representation Learning via Relational Graph Clustering
    Lee, Hyodong
    Lee, Joonseok
    Ng, Joe Yue-Hei
    Natsev, Paul
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6806 - 6815
  • [10] The Elastic Lottery Ticket Hypothesis
    Chen, Xiaohan
    Cheng, Yu
    Wang, Shuohang
    Gan, Zhe
    Liu, Jingjing
    Wang, Zhangyang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,