Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

被引:206
|
作者
Shi, Wenqi [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Jiang, Miao [2 ]
Geng, Lu [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Hitachi China Res & Dev Cooperat, Beijing 100190, Peoples R China
关键词
Federated learning; wireless networks; resource allocation; scheduling; convergence analysis;
D O I
10.1109/TWC.2020.3025446
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning (FL), devices contribute to the global training by uploading their local model updates via wireless channels. Due to limited computation and communication resources, device scheduling is crucial to the convergence rate of FL. In this paper, we propose a joint device scheduling and resource allocation policy to maximize the model accuracy within a given total training time budget for latency constrained wireless FL. A lower bound on the reciprocal of the training performance loss, in terms of the number of training rounds and the number of scheduled devices per round, is derived. Based on the bound, the accuracy maximization problem is solved by decoupling it into two sub-problems. First, given the scheduled devices, the optimal bandwidth allocation suggests allocating more bandwidth to the devices with worse channel conditions or weaker computation capabilities. Then, a greedy device scheduling algorithm is introduced, which selects the device consuming the least updating time obtained by the optimal bandwidth allocation in each step, until the lower bound begins to increase, meaning that scheduling more devices will degrade the model accuracy. Experiments show that the proposed policy outperforms state-of-the-art scheduling policies under extensive settings of data distributions and cell radius.
引用
收藏
页码:453 / 467
页数:15
相关论文
共 50 条
  • [31] Update Aware Device Scheduling for Federated Learning at the Wireless Edge
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2598 - 2603
  • [32] Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with Non-IID Data
    Liu, Shengli
    Yu, Guanding
    Chen, Xianfu
    Bennis, Mehdi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 74 - 79
  • [33] Joint Resource Management and Model Compression for Wireless Federated Learning
    Chen, Mingzhe
    Shlezinger, Nir
    Poor, H. Vincent
    Eldar, Yonina C.
    Cui, Shuguang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [34] Resource Allocation for Latency-Aware Federated Learning in Industrial Internet of Things
    Gao, Weifeng
    Zhao, Zhiwei
    Min, Geyong
    Ni, Qiang
    Jiang, Yuhong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) : 8505 - 8513
  • [35] User and resource allocation in latency constrained Xhaul via reinforcement learning
    Chughtai, Mohsan Niaz
    Noor, Shabnam
    Laurinavicius, Ignas
    Assimakopoulos, Philippos
    Gomes, Nathan J.
    Zhu, Huiling
    Wang, Jiangzhou
    Zheng, Xi
    Yan, Qi
    JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2023, 15 (04) : 219 - 228
  • [36] Joint Device Selection and Power Control for Wireless Federated Learning
    Guo, Wei
    Li, Ran
    Huang, Chuan
    Qin, Xiaoqi
    Shen, Kaiming
    Zhang, Wei
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (08) : 2395 - 2410
  • [37] Resource allocation in wireless networks with federated learning: Network adaptability and learning acceleration
    Lee, Hyun-Suk
    Lee, Da-Eun
    ICT EXPRESS, 2022, 8 (01): : 31 - 36
  • [38] Joint Resource Allocation for Latency-Constrained Dynamic Computation Offloading with MEC
    Merluzzi, Mattia
    Di Lorenzo, Paolo
    Barbarossa, Sergio
    Frascolla, Valerio
    2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOP (WCNCW), 2019,
  • [39] Federated Learning in Unreliable and Resource-Constrained Cellular Wireless Networks
    Salehi, Mohammad
    Hossain, Ekram
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (08) : 5136 - 5151
  • [40] Joint Resource Allocation and Learning Optimization for UAV-Assisted Federated Learning
    Liu, Chaoyi
    Zhu, Qi
    APPLIED SCIENCES-BASEL, 2023, 13 (06):