Over-the-Air Federated Graph Learning

被引:0
|
作者
Wang, Zixin [1 ,2 ]
Zhou, Yong [1 ]
Shi, Yuanming [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept ECE, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
Vectors; Wireless networks; Transceivers; Convergence; Servers; Optimization; Graph neural networks; Computational modeling; Atmospheric modeling; Training; Federated graph learning; over-the-air computation; deep reinforcement learning; NETWORKS; DESIGN; COMMUNICATION; SURFACE;
D O I
10.1109/TWC.2024.3471906
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Message-passing graph neural network (MPGNN) shows tremendous promise in modeling complex networks by capturing the interaction among vertices via the messaging-passing mechanism. However, the dimension of MPGNN is tied to the size of vertices in the graph, which varies from graph to graph, resulting in dimension mismatch that hinders the utilization of graph data distributed at the network edge. To address this issue, we in this paper leverage the attention mechanism to project the graph representation of MPGNNs into a unified space and apply over-the-air computation (AirComp) to support federated graph learning (FGL) over wireless networks. By explicitly deriving the upper bound on the convergence of over-the-air FGL, we formulate a long-term transmission distortion minimization problem, which is further decomposed into a series of online optimization problems by using Lyapunov optimization. We further propose a deep reinforcement learning based algorithm to optimize the AirComp transceiver, where the analytical expression of transmit power is exploited in the action design to reduce the searching space and also enhance the training performance. Simulations demonstrate that, compared to the benchmarks, the proposed algorithm attains two orders of magnitude acceleration in the inference stage, while exhibiting enhanced robustness and improving learning performance.
引用
收藏
页码:18669 / 18683
页数:15
相关论文
共 50 条
  • [1] Over-the-Air Clustered Federated Learning
    Sami, Hasin Us
    Guler, Basak
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7877 - 7893
  • [2] Federated Learning Over-the-Air by Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9143 - 9156
  • [3] Over-the-Air Decentralized Federated Learning
    Shi, Yandong
    Zhou, Yong
    Shi, Yuanming
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 455 - 460
  • [4] Over-the-Air Federated Learning with Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 291 - 295
  • [5] OVER-THE-AIR PERSONALIZED FEDERATED LEARNING
    Sami, Hasin Us
    Guler, Basak
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8777 - 8781
  • [6] Robust Over-the-Air Federated Learning
    Kim, Hwanjin
    Nam, Hongjae
    Love, David J.
    2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [7] Over-the-Air Federated Learning and Optimization
    Zhu, Jingyang
    Shi, Yuanming
    Zhou, Yong
    Jiang, Chunxiao
    Chen, Wei
    Letaief, Khaled B.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 16996 - 17020
  • [8] Federated Learning with Partial Gradients Over-the-Air
    Wang, Wendi
    Chen, Zihan
    Pappas, Nikolaos
    Yang, Howard H.
    2023 20TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING, SECON, 2023,
  • [9] Federated Learning Based on Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [10] Inverse Feasibility in Over-the-Air Federated Learning
    Piotrowski, Tomasz
    Ismayilov, Rafail
    Frey, Matthias
    Cavalcante, Renato L. G.
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1434 - 1438