ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION

被引:5
|
作者
Sifaou, Houssem [1 ]
Li, Geoffrey Ye [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London, England
关键词
Federated learning; Over-the-air computation; Byzantine attacks; STOCHASTIC GRADIENT DESCENT;
D O I
10.1109/MLSP55214.2022.9943401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of the local model updates of some malicious clients. We propose a robust transmission and aggregation framework to such attacks while preserving the benefits of over-the-air computation for federated learning. For the proposed robust federated learning, the participating clients are randomly divided into groups and a transmission time slot is allocated to each group. The parameter server aggregates the results of the different groups using a robust aggregation technique and conveys the result to the clients for another training round. We also analyze the convergence of the proposed algorithm. Numerical simulations confirm the robustness of the proposed approach to Byzantine attacks.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Empowering over-the-air personalized federated learning via RIS
    Wei SHI
    Jiacheng YAO
    Jindan XU
    Wei XU
    Lexi XU
    Chunming ZHAO
    [J]. Science China(Information Sciences), 2024, 67 (11) : 371 - 372
  • [32] Over-the-Air Federated Graph Learning
    Wang, Zixin
    Zhou, Yong
    Shi, Yuanming
    [J]. IEEE Transactions on Wireless Communications, 2024, 23 (12) : 18669 - 18683
  • [33] Over-the-Air Clustered Federated Learning
    Sami, Hasin Us
    Guler, Basak
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7877 - 7893
  • [34] Federated Learning in Wireless Networks via Over-the-Air Computations
    Oksuz, Halil Yigit
    Molinari, Fabio
    Sprekeler, Henning
    Raisch, Joerg
    [J]. 2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 4379 - 4386
  • [35] Federated Learning Over-the-Air by Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9143 - 9156
  • [36] Over-the-Air Decentralized Federated Learning
    Shi, Yandong
    Zhou, Yong
    Shi, Yuanming
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 455 - 460
  • [37] Empowering over-the-air personalized federated learning via RIS
    Shi, Wei
    Yao, Jiacheng
    Xu, Jindan
    Xu, Wei
    Xu, Lexi
    Zhao, Chunming
    [J]. Science China Information Sciences, 2024, 67 (11)
  • [38] Over-the-Air Federated Learning with Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    [J]. SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 291 - 295
  • [39] OVER-THE-AIR PERSONALIZED FEDERATED LEARNING
    Sami, Hasin Us
    Guler, Basak
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8777 - 8781
  • [40] Over-the-Air Federated Learning and Optimization
    Zhu, Jingyang
    Shi, Yuanming
    Zhou, Yong
    Jiang, Chunxiao
    Chen, Wei
    Letaief, Khaled B.
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 16996 - 17020