Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness

被引:137
|
作者
Ren, Jinke [1 ,2 ]
He, Yinghui [1 ]
Wen, Dingzhu [3 ]
Yu, Guanding [1 ]
Huang, Kaibin [3 ]
Guo, Dongning [2 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
[2] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
[3] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Scheduling; Convergence; Servers; Wireless communication; Processor scheduling; Probabilistic logic; Resource management; Federated edge learning; scheduling; multiuser diversity; resource management; convergence analysis; ADAPTIVE RESOURCE-ALLOCATION; WIRELESS NETWORKS; COMMUNICATION;
D O I
10.1109/TWC.2020.3015671
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In cellular federated edge learning (FEEL), multiple edge devices holding local data jointly train a neural network by communicating learning updates with an access point without exchanging their data samples. With very limited communication resources, it is beneficial to schedule the most informative local learning updates. This paper focuses on FEEL with gradient averaging over participating devices in each round of communication. A novel scheduling policy is proposed to exploit both diversity in multiuser channels and diversity in the "importance" of the edge devices' learning updates. First, a new probabilistic scheduling framework is developed to yield unbiased update aggregation in FEEL. The importance of a local learning update is measured by its gradient divergence. If one edge device is scheduled in each communication round, the scheduling policy is derived in closed form to achieve the optimal trade-off between channel quality and update importance. The probabilistic scheduling framework is then extended to allow scheduling multiple edge devices in each communication round. Numerical results obtained using popular models and learning datasets demonstrate that the proposed scheduling policy can achieve faster model convergence and higher learning accuracy than conventional scheduling policies that only exploit a single type of diversity.
引用
收藏
页码:7690 / 7703
页数:14
相关论文
共 50 条
  • [1] Importance- and Channel-Aware Scheduling in Cellular Federated Edge Learning
    Ren, Jinke
    He, Yinghui
    Wen, Dingzhu
    Yu, Guanding
    Huang, Kaibin
    Guo, Dongning
    [J]. 2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 294 - 298
  • [2] Device scheduling and channel allocation for energy-efficient Federated Edge Learning
    Hu, Youqiang
    Huang, Hejiao
    Yu, Nuo
    [J]. COMPUTER COMMUNICATIONS, 2022, 189 : 53 - 66
  • [3] DYNAMIC SCHEDULING FOR FEDERATED EDGE LEARNING WITH STREAMING DATA
    Hu, Chung-Hsuan
    Chen, Zheng
    Larsson, Erik G.
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [4] Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning
    Sun, Yuchang
    Lin, Zehong
    Mao, Yuyi
    Jin, Shi
    Zhang, Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 6905 - 6920
  • [5] Gradient and Channel Aware Dynamic Scheduling for Over-the-Air Computation in Federated Edge Learning Systems
    Du, Jun
    Jiang, Bingqing
    Jiang, Chunxiao
    Shi, Yuanming
    Han, Zhu
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 1035 - 1050
  • [6] Fast Federated Edge Learning with Overlapped Communication and Computation and Channel-Aware Fair Client Scheduling
    Ozfatura, Mehmet Emre
    Zhao, Junlin
    Gunduz, Deniz
    [J]. SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 311 - 315
  • [7] Update Aware Device Scheduling for Federated Learning at the Wireless Edge
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2598 - 2603
  • [8] Data-Quality Based Scheduling for Federated Edge Learning
    Taik, Afaf
    Moudoud, Hajar
    Cherkaoui, Soumaya
    [J]. PROCEEDINGS OF THE IEEE 46TH CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN 2021), 2021, : 17 - 23
  • [9] Dynamic Data Sample Selection and Scheduling in Edge Federated Learning
    Serhani, Mohamed Adel
    Abreha, Haftay Gebreslasie
    Tariq, Asadullah
    Hayajneh, Mohammad
    Xu, Yang
    Hayawi, Kadhim
    [J]. IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 : 2133 - 2149
  • [10] Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning
    Wen, Wanli
    Chen, Zihan
    Yang, Howard H.
    Xia, Wenchao
    Quek, Tony Q. S.
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 5857 - 5872