Over-the-Air Federated Learning via Weighted Aggregation

被引:0
|
作者
Azimi-Abarghouyi, Seyed Mohammad [1 ]
Tassiulas, Leandros [2 ]
机构
[1] KTH Royal Institute of Technology, School of Electrical Engineering and Computer Science, Stockholm,114 28, Sweden
[2] Yale University, Institute for Network Science, Department of Electrical Engineering, New Haven,CT,06511, United States
基金
美国国家科学基金会;
关键词
D O I
10.1109/TWC.2024.3463754
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This paper introduces a new federated learning scheme that leverages over-the-air computation. A novel feature of this scheme is the proposal to employ adaptive weights during aggregation, a facet treated as predefined in other over-the-air schemes. This can mitigate the impact of wireless channel conditions on learning performance, without needing channel state information at transmitter side (CSIT). We provide a mathematical methodology to derive the convergence bound for the proposed scheme in the context of computational heterogeneity and general loss functions, supplemented with design insights. Accordingly, we propose aggregation cost metrics and efficient algorithms to find optimized weights for the aggregation. Finally, through numerical experiments, we validate the effectiveness of the proposed scheme. Even with the challenges posed by channel conditions and device heterogeneity, the proposed scheme surpasses other over-the-air strategies by an accuracy improvement of 15% over the scheme using CSIT and 30% compared to the one without CSIT. © 2024 IEEE.
引用
收藏
页码:18240 / 18253
相关论文
共 50 条
  • [31] Inverse Feasibility in Over-the-Air Federated Learning
    Piotrowski, Tomasz
    Ismayilov, Rafail
    Frey, Matthias
    Cavalcante, Renato L. G.
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1434 - 1438
  • [32] Hierarchical Over-the-Air Federated Edge Learning
    Aygun, Ozan
    Kazemi, Mohammad
    Gunduz, Deniz
    Duman, Tolga M.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3376 - 3381
  • [33] COTAF: Convergent Over-the-Air Federated Learning
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina C.
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [34] An Overview on Over-the-Air Federated Edge Learning
    Cao, Xiaowen
    Lyu, Zhonghao
    Zhu, Guangxu
    Xu, Jie
    Xu, Lexi
    Cui, Shuguang
    IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) : 202 - 210
  • [35] Scalable Hierarchical Over-the-Air Federated Learning
    Azimi-Abarghouyi S.M.
    Fodor V.
    IEEE Transactions on Wireless Communications, 2024, 23 (08) : 1 - 1
  • [36] Over-the-air Learning Rate Optimization for Federated Learning
    Xu, Chunmei
    Liu, Shengheng
    Huang, Yongming
    Huang, Chongwen
    Zhang, Zhaoyang
    2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [37] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [38] Data and Channel-Adaptive Sensor Scheduling for Federated Edge Learning via Over-the-Air Gradient Aggregation
    Su, Liqun
    Lau, Vincent K. N.
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (03) : 1640 - 1654
  • [39] Riemannian Low-Rank Model Compression for Federated Learning With Over-the-Air Aggregation
    Xue, Ye
    Lau, Vincent
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 2172 - 2187
  • [40] Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
    Fan, Dian
    Yuan, Xiaojun
    Zhang, Ying-Jun Angela
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3757 - 3771