Asynchronous Federated Learning via Over-the-air Computation

被引:0
|
作者
Zheng, Zijian [1 ]
Deng, Yansha [2 ]
Liu, Xiaonan [1 ]
Nallanathan, Arumugam [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London, England
[2] Kings Coll London, Dept Engn, London, England
关键词
Asynchronous federated learning; over-the-air computation; error accumulation;
D O I
10.1109/GLOBECOM54140.2023.10437951
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging field of federated learning (FL) provides great potential for edge intelligence while protecting data privacy. However, as the system grows in scale or becomes more heterogeneous, new challenges, such as the spectrum shortage and stragglers issues, arise. These issues can potentially be addressed by over-the-air computation (AirComp) and asynchronous FL, respectively, however, their combination is difficult due to their conflicting requirements. In this paper, we propose a novel asynchronous FL with AirComp in a time-triggered manner (async-AirFed). The conventional async aggregation requests the historical data to be used for model updates, which can cause the accumulation of channel noise and interference when AirComp is applied. To address this issue, we propose a simple but effective truncation method which retains a limited length of historical data. Convergence analysis presents that our proposed async-AirFed converges on non-convex optimality function with sublinear rate. Simulation results show that our proposed scheme achieves more than 34% faster convergence than the benchmarks, by achieving an accuracy of 85%, which also improves the time utilization efficiency and reduces the impact of staleness and the channel.
引用
下载
收藏
页码:1345 / 1350
页数:6
相关论文
共 50 条
  • [21] Coded Over-the-Air Computation for Model Aggregation in Federated Learning
    Zhang, Naifu
    Tao, Meixia
    Wang, Jia
    Shao, Shuo
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (01) : 160 - 164
  • [22] Federated learning via over-the-air computation in IRS-assisted UAV communications
    Li, Ruijie
    Zhu, Li
    Zhang, Guoping
    Xu, Hongbo
    Chen, Yun
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [23] Federated learning via over-the-air computation in IRS-assisted UAV communications
    Ruijie Li
    Li Zhu
    Guoping Zhang
    Hongbo Xu
    Yun Chen
    Scientific Reports, 13
  • [24] Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning
    Jiang, Bingqing
    Du, Jun
    Jiang, Chunxiao
    Shi, Yuanming
    Han, Zhu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 173 - 178
  • [25] Over-the-Air Federated Learning via Weighted Aggregation
    Azimi-Abarghouyi, Seyed Mohammad
    Tassiulas, Leandros
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 18240 - 18253
  • [26] Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning
    Chen, Danni
    Lei, Ming
    Zhao, Ming-Min
    Liu, An
    Sheng, Sikai
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [27] Decentralized Federated Learning via MIMO Over-the-Air Computation: Consensus Analysis and Performance Optimization
    Zhai, Zhiyuan
    Yuan, Xiaojun
    Wang, Xin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 11847 - 11862
  • [28] On-Device Federated Learning via Second-Order Optimization with Over-the-Air Computation
    Hua, Sheng
    Yang, Kai
    Shi, Yuanming
    2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL), 2019,
  • [29] Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation
    Li, Liang
    Huang, Chenpei
    Shi, Dian
    Wang, Hao
    Zhou, Xiangwei
    Shu, Minglei
    Pan, Miao
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (02) : 1228 - 1242
  • [30] Broadband Digital Over-the-Air Computation for Wireless Federated Edge Learning
    You, Lizhao
    Zhao, Xinbo
    Cao, Rui
    Shao, Yulin
    Fu, Liqun
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 5212 - 5228