ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION

被引:5
|
作者
Sifaou, Houssem [1 ]
Li, Geoffrey Ye [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London, England
关键词
Federated learning; Over-the-air computation; Byzantine attacks; STOCHASTIC GRADIENT DESCENT;
D O I
10.1109/MLSP55214.2022.9943401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of the local model updates of some malicious clients. We propose a robust transmission and aggregation framework to such attacks while preserving the benefits of over-the-air computation for federated learning. For the proposed robust federated learning, the participating clients are randomly divided into groups and a transmission time slot is allocated to each group. The parameter server aggregates the results of the different groups using a robust aggregation technique and conveys the result to the clients for another training round. We also analyze the convergence of the proposed algorithm. Numerical simulations confirm the robustness of the proposed approach to Byzantine attacks.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [2] Asynchronous Federated Learning via Over-the-air Computation
    Zheng, Zijian
    Deng, Yansha
    Liu, Xiaonan
    Nallanathan, Arumugam
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1345 - 1350
  • [3] Multiple Parallel Federated Learning via Over-the-Air Computation
    Shi, Gaoxin
    Guo, Shuaishuai
    Ye, Jia
    Saeed, Nasir
    Dang, Shuping
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 1252 - 1264
  • [4] Federated Linear Bandit Learning via Over-the-air Computation
    Wang, Jiali
    Jiang, Yuning
    Liu, Xin
    Wang, Ting
    Shi, Yuanming
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1363 - 1368
  • [5] Robust Over-the-Air Federated Learning
    Kim, Hwanjin
    Nam, Hongjae
    Love, David J.
    [J]. 2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [6] Federated Learning Based on Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [7] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [8] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964
  • [9] Federated Edge Learning with Misaligned Over-The-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    [J]. SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 236 - 240
  • [10] Edge Federated Learning via Unit-Modulus Over-The-Air Computation
    Wang, Shuai
    Hong, Yuncong
    Wang, Rui
    Hao, Qi
    Wu, Yik-Chung
    Ng, Derrick Wing Kwan
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (05) : 3141 - 3156