Robust Federated Learning Over Noisy Fading Channels

被引:2
|
作者
Shah, Suhail M. M. [1 ]
Su, Liqun [1 ]
Lau, Vincent K. N. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Training; Convergence; Fading channels; Noise measurement; Standards; Optimization; Servers; Channel noise; federated averaging (FedAvg); federated learning (FL); transmission power optimization; wireless machine learning (ML); ANALOG FUNCTION COMPUTATION; STOCHASTIC-APPROXIMATION;
D O I
10.1109/JIOT.2022.3230452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance capabilities of models trained in a federated learning (FL) setting over wireless networks can be significantly affected by the underlying properties of the transmission channel. Even for shallow models, there can be an acute degradation in performance which necessitates the development of algorithms which are robust to transmission channel effects, such as noise and fading. In this work, we present a two-pronged approach to overcome the limitations of existing wireless machine learning (ML)-based algorithms. First, to tackle the effect of channel noise, we incorporate a novel tracking-based stochastic approximation scheme in the standard federated averaging pipeline which averages out the effect of the channel noise. In contrast to previous works on FL with a noisy channel, we provide exact convergence guarantees for our algorithm without the need to increase the transmission power gain. Second, to combat channel fading and further optimize the power consumption at the client level, we propose an adaptive transmission policy obtained by solving an optimization problem with long-term constraints. The solution is obtained in an online manner via a dual decomposition method. The superior empirical performance of the proposed scheme compared to state-of-the-art works is demonstrated on standard ML tasks.
引用
收藏
页码:7993 / 8013
页数:21
相关论文
共 50 条
  • [1] Federated Learning over Noisy Channels
    Wei, Xizixiang
    Shen, Cong
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [2] Federated Learning Over Wireless Fading Channels
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) : 3546 - 3557
  • [3] COOPERATIVE LEARNING VIA FEDERATED DISTILLATION OVER FADING CHANNELS
    Ahn, Jin-Hyun
    Simeone, Osvaldo
    Kang, Joonhyuk
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8856 - 8860
  • [4] FEDREC: FEDERATED LEARNING OF UNIVERSAL RECEIVERS OVER FADING CHANNELS
    Mashhadi, Mandi Boloursaz
    Shlezinger, Nir
    Eldar, Yonina C.
    Gunduz, Deniz
    2021 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2021, : 576 - 580
  • [5] Federated Learning Over Noisy Channels: Convergence Analysis and Design Examples
    Wei, Xizixiang
    Shen, Cong
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1253 - 1268
  • [6] Robust Federated Learning With Noisy Labels
    Yang, Seunghan
    Park, Hyoungseob
    Byun, Junyoung
    Kim, Changick
    IEEE INTELLIGENT SYSTEMS, 2022, 37 (02) : 35 - 43
  • [7] Robust Federated Learning With Noisy Communication
    Ang, Fan
    Chen, Li
    Zhao, Nan
    Chen, Yunfei
    Wang, Weidong
    Yu, F. Richard
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (06) : 3452 - 3464
  • [8] On the Privacy Leakage of Over-the-Air Federated Learning Over MIMO Fading Channels
    Liu, Hang
    Yan, Jia
    Zhang, Ying-Jun Angela
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5274 - 5279
  • [9] Differentially Private Over-the-Air Federated Learning Over MIMO Fading Channels
    Liu H.
    Yan J.
    Zhang Y.A.
    IEEE Transactions on Wireless Communications, 2024, 23 (08) : 1 - 1
  • [10] Accelerated Federated Learning Over Wireless Fading Channels With Adaptive Stochastic Momentum
    Su, Liqun
    Lau, Vincent K. N.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (08): : 14136 - 14152