Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning

被引:3
|
作者
Jiang, Bingqing [1 ]
Du, Jun [1 ]
Jiang, Chunxiao [2 ]
Shi, Yuanming [3 ]
Han, Zhu [4 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Tsinghua Space Ctr, Beijing 100084, Peoples R China
[3] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[4] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
关键词
ACCESS;
D O I
10.1109/GLOBECOM48099.2022.10000727
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) is expected as a revolutionary technology to be widely used in Internet-of-Things (IoT) networks for computationally intensive tasks. However, the traditional centralized training framework imposes large latency, network burdens and high risk of privacy disclosure. As a promising distributed solution, federated learning involves the collaborative model training among edge devices, with the orchestration of a server to carry the capacities of low-latency and privacy preservation for AI-driven networks. To further improve the communication efficiency, over-the-air computation (AirComp) is capable of computing while transmitting data by exploiting the superposition property of wireless channels to harness the interference. However, gradient aggregation suffers from channel distortion induced by channel fading and noise, which may degrade the training performance. Moreover, it is beneficial to schedule the informative edge devices in federated learning under limited energy resources. In this work, we propose a dynamic device scheduling scheme for AirComp enabled federated learning systems. In this scheme, a proper number of qualified edge devices with channel inversion based power control are scheduled to participate the model training, where local updates diversity, channel condition and energy consumption are exploited jointly. Inspired by the Lyapunov drift-plus-penalty method, we formulate the optimization problem to attain the device selection strategy. Simulation results validate that the proposed scheme can achieve a close-to-optimal test accuracy with fast convergence rate, and present good performance of robustness under different channel conditions.
引用
收藏
页码:173 / 178
页数:6
相关论文
共 50 条
  • [1] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [2] Device Scheduling in Over-the-Air Federated Learning Via Matching Pursuit
    Bereyhi, Ali
    Vagollari, Adela
    Asaad, Saba
    Muller, Ralf R.
    Gerstacker, Wolfgang
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 2188 - 2203
  • [3] Asynchronous Federated Learning via Over-the-air Computation
    Zheng, Zijian
    Deng, Yansha
    Liu, Xiaonan
    Nallanathan, Arumugam
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1345 - 1350
  • [4] One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning
    Zhu, Guangxu
    Du, Yuqing
    Gunduz, Deniz
    Huang, Kaibin
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [5] Communication-Efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling
    Zhang, Maojun
    Zhu, Guangxu
    Wang, Shuai
    Jiang, Jiamo
    Liao, Qing
    Zhong, Caijun
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (10) : 8536 - 8551
  • [6] ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION
    Sifaou, Houssem
    Li, Geoffrey Ye
    [J]. 2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [7] User Scheduling for Federated Learning Through Over-the-Air Computation
    Ma, Xiang
    Sun, Haijian
    Wang, Qun
    Hu, Rose Qingyang
    [J]. 2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [8] Device Scheduling for Over-the-Air Federated Learning with Differential Privacy
    Yan, Na
    Wang, Kezhi
    Pan, Cunhua
    Chai, Kok Keong
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 51 - 56
  • [9] Multiple Parallel Federated Learning via Over-the-Air Computation
    Shi, Gaoxin
    Guo, Shuaishuai
    Ye, Jia
    Saeed, Nasir
    Dang, Shuping
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 1252 - 1264
  • [10] Federated Linear Bandit Learning via Over-the-air Computation
    Wang, Jiali
    Jiang, Yuning
    Liu, Xin
    Wang, Ting
    Shi, Yuanming
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1363 - 1368