FedGTA: Topology-aware Averaging for Federated Graph Learning

被引:1
|
作者
Li, Xunkai [1 ]
Wu, Zhengyu [1 ]
Zhang, Wentao [2 ]
Zhu, Yinlin [3 ]
Li, Rong-Hua [1 ]
Wang, Guoren [1 ]
机构
[1] Beijing Inst Technol, Beijing, Peoples R China
[2] HEC Montreal, Mila Quebec AI Inst, Montreal, PQ, Canada
[3] Sun Yat Sen Univ, Beijing, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 17卷 / 01期
关键词
D O I
10.14778/3617838.3617842
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Graph Learning (FGL) is a distributed machine learning paradigm that enables collaborative training on large-scale subgraphs across multiple local systems. Existing FGL studies fall into two categories: (i) FGL Optimization, which improves multiclient training in existing machine learning models; (ii) FGL Model, which enhances performance with complex local models and multiclient interactions. However, most FGL optimization strategies are designed specifically for the computer vision domain and ignore graph structure, presenting dissatisfied performance and slow convergence. Meanwhile, complex local model architectures in FGL Models studies lack scalability for handling large-scale subgraphs and have deployment limitations. To address these issues, we propose Federated Graph Topology-aware Aggregation (FedGTA), a personalized optimization strategy that optimizes through topologyaware local smoothing confidence and mixed neighbor features. During experiments, we deploy FedGTAin 12 multi-scale real-world datasets with the Louvain and Metis split. This allows us to evaluate the performance and robustness of FedGTA across a range of scenarios. Extensive experiments demonstrate that FedGTA achieves state-of-the-art performance while exhibiting high scalability and efficiency. The experiment includes ogbn-papers100M, the most representative large-scale graph database so that we can verify the applicability of our method to large-scale graph learning. To the best of our knowledge, our study is the first to bridge large-scale graph learning with FGL using this optimization strategy, contributing to the development of efficient and scalable FGL methods.
引用
收藏
页码:41 / 50
页数:10
相关论文
共 50 条
  • [1] Topology-aware Federated Learning in Edge Computing: A Comprehensive Survey
    Wu, Jiajun
    Dong, Fan
    Leung, Henry
    Zhu, Zhuangdi
    Zhou, Jiayu
    Drew, Steve
    [J]. ACM COMPUTING SURVEYS, 2024, 56 (10)
  • [2] Automatic Graph Topology-Aware Transformer
    Wang, Chao
    Zhao, Jiaxuan
    Li, Lingling
    Jiao, Licheng
    Liu, Fang
    Yang, Shuyuan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [3] A Topology-Aware Framework for Graph Traversals
    Meng, Jia
    Cao, Liang
    Yu, Huashan
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2017, 2017, 10393 : 165 - 179
  • [4] Topology-Aware Graph Pooling Networks
    Gao, Hongyang
    Liu, Yi
    Ji, Shuiwang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4512 - 4518
  • [5] A TOPOLOGY-AWARE CODING FRAMEWORK FOR DISTRIBUTED GRAPH PROCESSING
    Guler, Basak
    Avestimehr, A. Salman
    Ortega, Antonio
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 8182 - 8186
  • [6] Topology-Aware Reliability Assessment by Graph Neural Networks
    Zhu, Yongli
    Singh, Chanan
    [J]. 2022 IEEE KANSAS POWER AND ENERGY CONFERENCE (KPEC 2022), 2022,
  • [7] Topology-Aware Graph Signal Sampling for Pooling in Graph Neural Networks
    Nouranizadeh, Amirhossein
    Matinkia, Mohammadjavad
    Rahmati, Mohammad
    [J]. 2021 26TH INTERNATIONAL COMPUTER CONFERENCE, COMPUTER SOCIETY OF IRAN (CSICC), 2021,
  • [8] TOPOLOGY-AWARE LEARNING FOR VOLUMETRIC CEREBROVASCULAR SEGMENTATION
    Banerjee, Subhashis
    Toumpanakis, Dimitrios
    Dhara, Ashis Kumar
    Wikstrom, Johan
    Strand, Robin
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [9] TOPOLOGY-AWARE DISTRIBUTED ADAPTATION OF LAPLACIAN WEIGHTS FOR IN-NETWORK AVERAGING
    Bertrand, Alexander
    Moonen, Marc
    [J]. 2013 PROCEEDINGS OF THE 21ST EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2013,
  • [10] Olive Branch Learning: A Topology-Aware Federated Learning Framework for Space-Air-Ground Integrated Network
    Fang, Qingze
    Zhai, Zhiwei
    Yu, Shuai
    Wu, Qiong
    Gong, Xiaowen
    Chen, Xu
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (07) : 4534 - 4551