Robust Federated Learning Over Noisy Fading Channels

被引:2
|
作者
Shah, Suhail M. M. [1 ]
Su, Liqun [1 ]
Lau, Vincent K. N. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Training; Convergence; Fading channels; Noise measurement; Standards; Optimization; Servers; Channel noise; federated averaging (FedAvg); federated learning (FL); transmission power optimization; wireless machine learning (ML); ANALOG FUNCTION COMPUTATION; STOCHASTIC-APPROXIMATION;
D O I
10.1109/JIOT.2022.3230452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance capabilities of models trained in a federated learning (FL) setting over wireless networks can be significantly affected by the underlying properties of the transmission channel. Even for shallow models, there can be an acute degradation in performance which necessitates the development of algorithms which are robust to transmission channel effects, such as noise and fading. In this work, we present a two-pronged approach to overcome the limitations of existing wireless machine learning (ML)-based algorithms. First, to tackle the effect of channel noise, we incorporate a novel tracking-based stochastic approximation scheme in the standard federated averaging pipeline which averages out the effect of the channel noise. In contrast to previous works on FL with a noisy channel, we provide exact convergence guarantees for our algorithm without the need to increase the transmission power gain. Second, to combat channel fading and further optimize the power consumption at the client level, we propose an adaptive transmission policy obtained by solving an optimization problem with long-term constraints. The solution is obtained in an online manner via a dual decomposition method. The superior empirical performance of the proposed scheme compared to state-of-the-art works is demonstrated on standard ML tasks.
引用
收藏
页码:7993 / 8013
页数:21
相关论文
共 50 条
  • [21] Robust CDMA radio transmission over fading channels
    Giannetti, F
    Luise, M
    Reggiannini, R
    IEEE GLOBECOM 1996 - CONFERENCE RECORD, VOLS 1-3: COMMUNICATIONS: THE KEY TO GLOBAL PROSPERITY, 1996, : 1311 - 1315
  • [22] Robust Transmission of Video Stream over Fading Channels
    Li, Mao-Quan
    Xu, Zheng-Quan
    Xu, Yan-Yan
    NOVEL ALGORITHMS AND TECHNIQUES IN TELECOMMUNICATIONS AND NETWORKING, 2010, : 311 - 316
  • [23] Robust Over-the-Air Federated Learning
    Kim, Hwanjin
    Nam, Hongjae
    Love, David J.
    2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [24] Random Access Compressed Sensing Over Fading and Noisy Communication Channels
    Fazel, Fatemeh
    Fazel, Maryam
    Stojanovic, Milica
    2012 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2012,
  • [25] Random Access Compressed Sensing over Fading and Noisy Communication Channels
    Fazel, Fatemeh
    Fazel, Maryam
    Stojanovic, Milica
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (05) : 2114 - 2125
  • [26] Distributionally Robust Federated Learning for Network Traffic Classification With Noisy Labels
    Shi, Siping
    Guo, Yingya
    Wang, Dan
    Zhu, Yifei
    Han, Zhu
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 6212 - 6226
  • [27] Robust index assignment for MDSQ encoder over noisy channels
    Ma, Rui
    Labeau, Fabrice
    2006 IEEE WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 2006, : 286 - +
  • [28] Robust transmission of JPEG 2000 images over noisy channels
    Sanchez, V
    Mandal, MK
    2002 INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, DIGEST OF TECHNICAL PAPERS, 2002, : 80 - 81
  • [29] Robust source coding for images over very noisy channels
    Marvel, LM
    Khayrallah, AS
    Boncelet, CG
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, 1996, : 759 - 762
  • [30] Channel optimized robust image coding over noisy channels
    Salari, Ezzatollah
    Li, Xiaodong
    OPTICAL ENGINEERING, 2006, 45 (12)