Over-the-Air Federated Graph Learning

被引:0
|
作者
Wang, Zixin [1 ,2 ]
Zhou, Yong [1 ]
Shi, Yuanming [1 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept ECE, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
Vectors; Wireless networks; Transceivers; Convergence; Servers; Optimization; Graph neural networks; Computational modeling; Atmospheric modeling; Training; Federated graph learning; over-the-air computation; deep reinforcement learning; NETWORKS; DESIGN; COMMUNICATION; SURFACE;
D O I
10.1109/TWC.2024.3471906
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Message-passing graph neural network (MPGNN) shows tremendous promise in modeling complex networks by capturing the interaction among vertices via the messaging-passing mechanism. However, the dimension of MPGNN is tied to the size of vertices in the graph, which varies from graph to graph, resulting in dimension mismatch that hinders the utilization of graph data distributed at the network edge. To address this issue, we in this paper leverage the attention mechanism to project the graph representation of MPGNNs into a unified space and apply over-the-air computation (AirComp) to support federated graph learning (FGL) over wireless networks. By explicitly deriving the upper bound on the convergence of over-the-air FGL, we formulate a long-term transmission distortion minimization problem, which is further decomposed into a series of online optimization problems by using Lyapunov optimization. We further propose a deep reinforcement learning based algorithm to optimize the AirComp transceiver, where the analytical expression of transmit power is exploited in the action design to reduce the searching space and also enhance the training performance. Simulations demonstrate that, compared to the benchmarks, the proposed algorithm attains two orders of magnitude acceleration in the inference stage, while exhibiting enhanced robustness and improving learning performance.
引用
收藏
页码:18669 / 18683
页数:15
相关论文
共 50 条
  • [21] Over-the-Air Federated Learning via Weighted Aggregation
    Azimi-Abarghouyi, Seyed Mohammad
    Tassiulas, Leandros
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18240 - 18253
  • [22] Asynchronous Federated Learning via Over-the-air Computation
    Zheng, Zijian
    Deng, Yansha
    Liu, Xiaonan
    Nallanathan, Arumugam
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1345 - 1350
  • [23] Over-the-Air Federated Learning from Heterogeneous Data
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina
    IEEE Transactions on Signal Processing, 2021, 69 : 3796 - 3811
  • [24] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964
  • [25] ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION
    Sifaou, Houssem
    Li, Geoffrey Ye
    2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [26] Over-the-Air Federated Multi-Task Learning
    Ma, Haoming
    Yuan, Xiaojun
    Fan, Dian
    Ding, Zhi
    Wang, Xin
    Fang, Jun
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 5184 - 5189
  • [27] Over-the-Air Federated Learning From Heterogeneous Data
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina C.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 3796 - 3811
  • [28] Over-the-Air Federated Edge Learning With Hierarchical Clustering
    Aygun, Ozan
    Kazemi, Mohammad
    Gunduz, Deniz
    Duman, Tolga M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 17856 - 17871
  • [29] Cloud-RAN Over-the-Air Federated Learning
    Ma, Haoming
    Yuan, Xiaojun
    Ding, Zhi
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 4257 - 4262
  • [30] Over-the-Air Federated Learning with Energy Harvesting Devices
    Aygun, Ozan
    Kazemi, Mohammad
    Gunduz, Deniz
    Duman, Tolga M.
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1942 - 1947