Asynchronous Federated Learning via Over-the-air Computation

被引:0
|
作者
Zheng, Zijian [1 ]
Deng, Yansha [2 ]
Liu, Xiaonan [1 ]
Nallanathan, Arumugam [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London, England
[2] Kings Coll London, Dept Engn, London, England
关键词
Asynchronous federated learning; over-the-air computation; error accumulation;
D O I
10.1109/GLOBECOM54140.2023.10437951
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging field of federated learning (FL) provides great potential for edge intelligence while protecting data privacy. However, as the system grows in scale or becomes more heterogeneous, new challenges, such as the spectrum shortage and stragglers issues, arise. These issues can potentially be addressed by over-the-air computation (AirComp) and asynchronous FL, respectively, however, their combination is difficult due to their conflicting requirements. In this paper, we propose a novel asynchronous FL with AirComp in a time-triggered manner (async-AirFed). The conventional async aggregation requests the historical data to be used for model updates, which can cause the accumulation of channel noise and interference when AirComp is applied. To address this issue, we propose a simple but effective truncation method which retains a limited length of historical data. Convergence analysis presents that our proposed async-AirFed converges on non-convex optimality function with sublinear rate. Simulation results show that our proposed scheme achieves more than 34% faster convergence than the benchmarks, by achieving an accuracy of 85%, which also improves the time utilization efficiency and reduces the impact of staleness and the channel.
引用
收藏
页码:1345 / 1350
页数:6
相关论文
共 50 条
  • [1] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [2] Asynchronous Federated Learning via Over-the-Air Computation in LEO Satellite Networks
    Huang, Yansong
    Li, Xuan
    Zhao, Moke
    Li, Haiyan
    Peng, Mugen
    [J]. IEEE Transactions on Wireless Communications, 2024, 23 (12) : 19885 - 19901
  • [3] ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION
    Sifaou, Houssem
    Li, Geoffrey Ye
    [J]. 2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [4] Semi-Asynchronous Federated Edge Learning for Over-the-air Computation
    Kou, Zhoubin
    Ji, Yun
    Zhong, Xiaoxiong
    Zhang, Sheng
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1351 - 1356
  • [5] Broadband Digital Over-the-Air Computation for Asynchronous Federated Edge Learning
    Zhao, Xinbo
    You, Lizhao
    Rui Cao
    Shao, Yulin
    Fu, Liqun
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 5359 - 5364
  • [6] Federated Linear Bandit Learning via Over-the-air Computation
    Wang, Jiali
    Jiang, Yuning
    Liu, Xin
    Wang, Ting
    Shi, Yuanming
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1363 - 1368
  • [7] Multiple Parallel Federated Learning via Over-the-Air Computation
    Shi, Gaoxin
    Guo, Shuaishuai
    Ye, Jia
    Saeed, Nasir
    Dang, Shuping
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 1252 - 1264
  • [8] Federated Learning Based on Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [9] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [10] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964