Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

被引:206
|
作者
Shi, Wenqi [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Jiang, Miao [2 ]
Geng, Lu [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Hitachi China Res & Dev Cooperat, Beijing 100190, Peoples R China
关键词
Federated learning; wireless networks; resource allocation; scheduling; convergence analysis;
D O I
10.1109/TWC.2020.3025446
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning (FL), devices contribute to the global training by uploading their local model updates via wireless channels. Due to limited computation and communication resources, device scheduling is crucial to the convergence rate of FL. In this paper, we propose a joint device scheduling and resource allocation policy to maximize the model accuracy within a given total training time budget for latency constrained wireless FL. A lower bound on the reciprocal of the training performance loss, in terms of the number of training rounds and the number of scheduled devices per round, is derived. Based on the bound, the accuracy maximization problem is solved by decoupling it into two sub-problems. First, given the scheduled devices, the optimal bandwidth allocation suggests allocating more bandwidth to the devices with worse channel conditions or weaker computation capabilities. Then, a greedy device scheduling algorithm is introduced, which selects the device consuming the least updating time obtained by the optimal bandwidth allocation in each step, until the lower bound begins to increase, meaning that scheduling more devices will degrade the model accuracy. Experiments show that the proposed policy outperforms state-of-the-art scheduling policies under extensive settings of data distributions and cell radius.
引用
收藏
页码:453 / 467
页数:15
相关论文
共 50 条
  • [41] Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms
    Zeng, Tengchan
    Semiari, Omid
    Mozaffari, Mohammad
    Chen, Mingzhe
    Saad, Walid
    Bennis, Mehdi
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [42] FEDRESOURCE: Federated Learning Based Resource Allocation in Modern Wireless Networks
    Satheesh, P. G.
    Sasikala, T.
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (09) : 1023 - 1030
  • [43] Resource Allocation for Wireless Federated Edge Learning based on Data Importance
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [44] Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks
    Van-Dinh Nguyen
    Sharma, Shree Krishna
    Vu, Thang X.
    Chatzinotas, Symeon
    Ottersten, Bjorn
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) : 3394 - 3409
  • [45] Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation
    Dinh, Canh T.
    Tran, Nguyen H.
    Nguyen, Minh N. H.
    Hong, Choong Seon
    Bao, Wei
    Zomaya, Albert Y.
    Gramoli, Vincent
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2021, 29 (01) : 398 - 409
  • [46] Joint Partial Offloading and Resource Allocation for Vehicular Federated Learning Tasks
    Ma, Guifu
    Hu, Manjiang
    Wang, Xiaowei
    Li, Haoran
    Bian, Yougang
    Zhu, Konglin
    Wu, Di
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 1 - 16
  • [47] Joint Training and Resource Allocation Optimization for Federated Learning in UAV Swarm
    Shen, Yun
    Qu, Yuben
    Dong, Chao
    Zhou, Fuhui
    Wu, Qihui
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 2272 - 2284
  • [48] A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning
    Zhang, Jingbo
    Wu, Qiong
    Fan, Pingyi
    Fan, Qiang
    Computers, Materials and Continua, 2024, 81 (02): : 1953 - 1998
  • [49] Federated Learning for Cellular Networks: Joint User Association and Resource Allocation
    Khan, Latif U.
    Majeed, Umer
    Hong, Choong Seon
    APNOMS 2020: 2020 21ST ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2020, : 405 - 408
  • [50] Joint User Selection and Resource Allocation for Fast Federated Edge Learning
    JIANG Zhihui
    HE Yinghui
    YU Guanding
    ZTE Communications, 2020, 18 (02) : 20 - 30