Robust Federated Learning Over Noisy Fading Channels

被引:2
|
作者
Shah, Suhail M. M. [1 ]
Su, Liqun [1 ]
Lau, Vincent K. N. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Training; Convergence; Fading channels; Noise measurement; Standards; Optimization; Servers; Channel noise; federated averaging (FedAvg); federated learning (FL); transmission power optimization; wireless machine learning (ML); ANALOG FUNCTION COMPUTATION; STOCHASTIC-APPROXIMATION;
D O I
10.1109/JIOT.2022.3230452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance capabilities of models trained in a federated learning (FL) setting over wireless networks can be significantly affected by the underlying properties of the transmission channel. Even for shallow models, there can be an acute degradation in performance which necessitates the development of algorithms which are robust to transmission channel effects, such as noise and fading. In this work, we present a two-pronged approach to overcome the limitations of existing wireless machine learning (ML)-based algorithms. First, to tackle the effect of channel noise, we incorporate a novel tracking-based stochastic approximation scheme in the standard federated averaging pipeline which averages out the effect of the channel noise. In contrast to previous works on FL with a noisy channel, we provide exact convergence guarantees for our algorithm without the need to increase the transmission power gain. Second, to combat channel fading and further optimize the power consumption at the client level, we propose an adaptive transmission policy obtained by solving an optimization problem with long-term constraints. The solution is obtained in an online manner via a dual decomposition method. The superior empirical performance of the proposed scheme compared to state-of-the-art works is demonstrated on standard ML tasks.
引用
收藏
页码:7993 / 8013
页数:21
相关论文
共 50 条
  • [41] Information-Theoretic Generalization Analysis for Topology-Aware Heterogeneous Federated Edge Learning Over Noisy Channels
    Wu, Zheshun
    Xu, Zenglin
    Yu, Hongfang
    Liu, Jie
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 691 - 695
  • [42] Robust Federated Learning with Parameter Classification and Weighted Aggregation against Noisy Labels
    Li, Qun
    Duan, Congying
    Chen, Siguang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2445 - 2450
  • [43] Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction
    Chen, Li
    Ang, Fan
    Chen, Yunfei
    Wang, Weidong
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (03): : 1501 - 1511
  • [44] Macroscopic multistage image compression for robust transmission over noisy channels
    Sherwood, PG
    Zeger, K
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '99, PARTS 1-2, 1998, 3653 : 73 - 83
  • [45] Robust transmission of Jpeg2000 images over noisy channels
    Sanchez, VS
    Mandal, MK
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2002, 48 (03) : 451 - 456
  • [46] On Noisy ARQ in Block-Fading Channels
    Makki, Behrooz
    Graell i Amat, Alexandre
    Eriksson, Thomas
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2014, 63 (02) : 731 - 746
  • [47] Estimation of fading distribution parameters in noisy channels
    Chen, YF
    Beaulieu, NC
    2005 IEEE PACIFIC RIM CONFERENCE ON COMMUNICATIONS, COMPUTERS AND SIGNAL PROCESSING (PACRIM), 2005, : 340 - 343
  • [48] A robust adaptive mimo-ofdm over mobile fading channels
    Choe, Sangho
    2007 IEEE MILITARY COMMUNICATIONS CONFERENCE, VOLS 1-8, 2007, : 2633 - 2637
  • [49] Robust Uplink Communications over Fading Channels with Variable Backhaul Connectivity
    Karasik, Roy
    Simeone, Osvaldo
    Shamai , Shlomo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (11) : 5788 - 5799
  • [50] Robust Uplink Communications over Fading Channels with Variable Backhaul Connectivity
    Karasik, Roy
    Simeone, Osvaldo
    Shamai, Shlomo
    2013 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2013, : 1172 - +