Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

被引:206
|
作者
Shi, Wenqi [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Jiang, Miao [2 ]
Geng, Lu [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Hitachi China Res & Dev Cooperat, Beijing 100190, Peoples R China
关键词
Federated learning; wireless networks; resource allocation; scheduling; convergence analysis;
D O I
10.1109/TWC.2020.3025446
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning (FL), devices contribute to the global training by uploading their local model updates via wireless channels. Due to limited computation and communication resources, device scheduling is crucial to the convergence rate of FL. In this paper, we propose a joint device scheduling and resource allocation policy to maximize the model accuracy within a given total training time budget for latency constrained wireless FL. A lower bound on the reciprocal of the training performance loss, in terms of the number of training rounds and the number of scheduled devices per round, is derived. Based on the bound, the accuracy maximization problem is solved by decoupling it into two sub-problems. First, given the scheduled devices, the optimal bandwidth allocation suggests allocating more bandwidth to the devices with worse channel conditions or weaker computation capabilities. Then, a greedy device scheduling algorithm is introduced, which selects the device consuming the least updating time obtained by the optimal bandwidth allocation in each step, until the lower bound begins to increase, meaning that scheduling more devices will degrade the model accuracy. Experiments show that the proposed policy outperforms state-of-the-art scheduling policies under extensive settings of data distributions and cell radius.
引用
收藏
页码:453 / 467
页数:15
相关论文
共 50 条
  • [11] Federated Learning under Channel Uncertainty: Joint Client Scheduling and Resource Allocation
    Wadu, Madhusanka Manimel
    Samarakoon, Sumudu
    Bennis, Mehdi
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [12] Joint Client Scheduling and Resource Allocation Under Channel Uncertainty in Federated Learning
    Wadu, Madhusanka Manimel
    Samarakoon, Sumudu
    Bennis, Mehdi
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 5962 - 5974
  • [13] Joint Optimization of Device Selection and Resource Allocation for Multiple Federations in Federated Edge Learning
    Fu, Shucun
    Dong, Fang
    Shen, Dian
    Zhang, Jinghui
    Huang, Zhaowu
    He, Qiang
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (01) : 251 - 262
  • [14] Latency-Efficient Wireless Federated Learning With Quantization and Scheduling
    Yan, Zhigang
    Li, Dong
    Yu, Xianhua
    Zhang, Zhichao
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (11) : 2621 - 2625
  • [15] Wireless Federated Learning over MIMO Networks: Joint Device Scheduling and Beamforming Design
    Huang, Shaoming
    Zhang, Pengfei
    Mao, Yijie
    Lian, Lixiang
    Wu, Youlong
    Shi, Yuanming
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 794 - 799
  • [16] Adaptive User Scheduling and Resource Allocation in Wireless Federated Learning Networks : A Deep Reinforcement Learning Approach
    Wu, Changxiang
    Ren, Yijing
    So, Daniel K. C.
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 1219 - 1225
  • [17] Device Scheduling with Fast Convergence for Wireless Federated Learning
    Shi, Wenqi
    Zhou, Sheng
    Niu, Zhisheng
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [18] Device Scheduling for Secure Aggregation in Wireless Federated Learning
    Yan, Na
    Wang, Kezhi
    Zhi, Kangda
    Pan, Cunhua
    Poor, H. Vincent
    Chai, Kok Keong
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28851 - 28862
  • [19] Exploring Representativity in Device Scheduling for Wireless Federated Learning
    Chen, Zhixiong
    Yi, Wenqiang
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (01) : 720 - 735
  • [20] Blockchain Assisted Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Client Scheduling
    Deng, Xiumei
    Li, Jun
    Ma, Chuan
    Wei, Kang
    Shi, Long
    Ding, Ming
    Chen, Wen
    Poor, H. Vincent
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (05) : 3537 - 3553