Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

被引:0
|
作者
Dahl, Martin [1 ]
Larsson, Erik G. [1 ]
机构
[1] Linkoping Univ, Dept Elect Engn ISY, Linkoping, Sweden
基金
瑞典研究理事会;
关键词
Federated learning; Wireless networks; COMPUTATION;
D O I
10.1109/CISS59072.2024.10480215
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block.
引用
下载
收藏
页数:6
相关论文
共 50 条
  • [1] Over-the-Air Federated Graph Learning
    Wang, Zixin
    Zhou, Yong
    Shi, Yuanming
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 18669 - 18683
  • [2] Over-the-Air Clustered Federated Learning
    Sami, Hasin Us
    Guler, Basak
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7877 - 7893
  • [3] Federated Learning Over-the-Air by Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9143 - 9156
  • [4] Over-the-Air Decentralized Federated Learning
    Shi, Yandong
    Zhou, Yong
    Shi, Yuanming
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 455 - 460
  • [5] Over-the-Air Federated Learning with Retransmissions
    Hellstrom, Henrik
    Fodor, Viktoria
    Fischione, Carlo
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 291 - 295
  • [6] OVER-THE-AIR PERSONALIZED FEDERATED LEARNING
    Sami, Hasin Us
    Guler, Basak
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8777 - 8781
  • [7] Over-the-Air Federated Learning and Optimization
    Zhu, Jingyang
    Shi, Yuanming
    Zhou, Yong
    Jiang, Chunxiao
    Chen, Wei
    Letaief, Khaled B.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 16996 - 17020
  • [8] Robust Over-the-Air Federated Learning
    Kim, Hwanjin
    Nam, Hongjae
    Love, David J.
    2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [9] Federated Learning with Partial Gradients Over-the-Air
    Wang, Wendi
    Chen, Zihan
    Pappas, Nikolaos
    Yang, Howard H.
    2023 20TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING, SECON, 2023,
  • [10] Over-the-Air Federated Learning with Enhanced Privacy
    Xue, Xiaochan
    Hasan, Moh Khalid
    Yu, Shucheng
    Kandel, Laxima Niure
    Song, Min
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 4546 - 4551