Robust Federated Learning Over Noisy Fading Channels

被引:2
|
作者
Shah, Suhail M. M. [1 ]
Su, Liqun [1 ]
Lau, Vincent K. N. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Training; Convergence; Fading channels; Noise measurement; Standards; Optimization; Servers; Channel noise; federated averaging (FedAvg); federated learning (FL); transmission power optimization; wireless machine learning (ML); ANALOG FUNCTION COMPUTATION; STOCHASTIC-APPROXIMATION;
D O I
10.1109/JIOT.2022.3230452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance capabilities of models trained in a federated learning (FL) setting over wireless networks can be significantly affected by the underlying properties of the transmission channel. Even for shallow models, there can be an acute degradation in performance which necessitates the development of algorithms which are robust to transmission channel effects, such as noise and fading. In this work, we present a two-pronged approach to overcome the limitations of existing wireless machine learning (ML)-based algorithms. First, to tackle the effect of channel noise, we incorporate a novel tracking-based stochastic approximation scheme in the standard federated averaging pipeline which averages out the effect of the channel noise. In contrast to previous works on FL with a noisy channel, we provide exact convergence guarantees for our algorithm without the need to increase the transmission power gain. Second, to combat channel fading and further optimize the power consumption at the client level, we propose an adaptive transmission policy obtained by solving an optimization problem with long-term constraints. The solution is obtained in an online manner via a dual decomposition method. The superior empirical performance of the proposed scheme compared to state-of-the-art works is demonstrated on standard ML tasks.
引用
收藏
页码:7993 / 8013
页数:21
相关论文
共 50 条
  • [31] Decentralized Federated Learning Over Imperfect Communication Channels
    Li W.
    Lv T.
    Ni W.
    Zhao J.
    Hossain E.
    Poor H.V.
    IEEE Transactions on Communications, 2024, 72 (11) : 1 - 1
  • [32] Federated Learning over Time-Varying Channels
    Tegin, Busra
    Duman, Tolga M.
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [33] Federated Noisy Client Learning
    Tam, Kahou
    Li, Li
    Han, Bo
    Xu, Chengzhong
    Fu, Huazhu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 36 (01) : 1 - 14
  • [34] Robust video transmission over correlated mobile fading channels
    Lu, JH
    Ben Letaief, K
    Liou, ML
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1999, 9 (05) : 737 - 751
  • [35] Robust progressive image transmission over Rayleigh fading channels
    Wang, DH
    Zhou, YH
    Su, PC
    Wang, H
    2003 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY, VOL 1 AND 2, PROCEEDINGS, 2003, : 846 - 849
  • [36] Robust spectrum management with incomplete information over fading channels
    Noam, Yair
    Leshem, Amir
    Messer, Hagit
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2017, 354 (02): : 1066 - 1086
  • [37] Error performance of multilevel modulation codes over phase noisy fading channels
    Morelos-Zaragoza, RH
    Isaka, M
    Imai, H
    2000 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2000, : 138 - 138
  • [38] Stabilization of MIMO Systems Over Multiple Independent and Memoryless Fading Noisy Channels
    Liu, Qinyuan
    Chen, Wei
    Wang, Zidong
    Qiu, Li
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (04) : 1581 - 1594
  • [39] Rate and power adaptation over slow fading channels with noisy quantized feedback
    Ekbatani, Siavash
    Etemadi, Farzad
    Jafarkhani, Hamid
    CONFERENCE RECORD OF THE FORTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, VOLS 1-5, 2007, : 1951 - 1955
  • [40] Robust Federated Learning-based Content Caching over Uncertain Wireless Transmission Channels in FRANs
    Manzoor, Sanaullah
    Mian, Adnan Noor
    2021 19TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), 2021,