Dynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints

被引:46
|
作者
Sun, Yuxuan [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Gunduz, Deniz [2 ]
机构
[1] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2BT, England
基金
欧洲研究理事会; 英国工程与自然科学研究理事会;
关键词
Federated edge learning; over-the-air computation; energy constraints; dynamic scheduling; Lyapunov optimization; CONVERGENCE; OPTIMIZATION; CHALLENGES; ALLOCATION; NETWORKS; DESIGN;
D O I
10.1109/JSAC.2021.3126078
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Machine learning and wireless communication technologies are jointly facilitating an intelligent edge, where federated edge learning (FEEL) is emerging as a promising training framework. As wireless devices involved in FEEL are resource limited in terms of communication bandwidth, computing power and battery capacity, it is important to carefully schedule them to optimize the training performance. In this work, we consider an over-the-air FEEL system with analog gradient aggregation, and propose an energy-aware dynamic device scheduling algorithm to optimize the training performance within the energy constraints of devices, where both communication energy for gradient aggregation and computation energy for local training are considered. The consideration of computation energy makes dynamic scheduling challenging, as devices are scheduled before local training, but the communication energy for over-the-air aggregation depends on the l(2)-norm of local gradient, which is known only after local training. We thus incorporate estimation methods into scheduling to predict the gradient norm. Taking the estimation error into account, we characterize the performance gap between the proposed algorithm and its offline counterpart. Experimental results show that, under a highly unbalanced local data distribution, the proposed algorithm can increase the accuracy by 4.9% on CIFAR-10 dataset compared with the myopic benchmark, while satisfying the energy constraints.
引用
收藏
页码:227 / 242
页数:16
相关论文
共 50 条
  • [1] Gradient and Channel Aware Dynamic Scheduling for Over-the-Air Computation in Federated Edge Learning Systems
    Du, Jun
    Jiang, Bingqing
    Jiang, Chunxiao
    Shi, Yuanming
    Han, Zhu
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 1035 - 1050
  • [2] Hierarchical Over-the-Air Federated Edge Learning
    Aygun, Ozan
    Kazemi, Mohammad
    Gunduz, Deniz
    Duman, Tolga M.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3376 - 3381
  • [3] An Overview on Over-the-Air Federated Edge Learning
    Cao, Xiaowen
    Lyu, Zhonghao
    Zhu, Guangxu
    Xu, Jie
    Xu, Lexi
    Cui, Shuguang
    IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) : 202 - 210
  • [4] Energy-Efficient Dynamic Device Scheduling for Over-the-Air Federated Learning in UAV Swarms
    Jiang, Bingqing
    Du, Jun
    Yang, Guowei
    Jiang, Chunxiao
    Liu, Chen-Feng
    Tian, Yu
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 170 - 175
  • [5] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964
  • [6] Over-the-Air Federated Edge Learning With Hierarchical Clustering
    Aygün, Ozan
    Kazemi, Mohammad
    Gündüz, Deniz
    Duman, Tolga M.
    IEEE Transactions on Wireless Communications, 2024, 23 (12) : 17856 - 17871
  • [7] Federated Edge Learning with Misaligned Over-The-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 236 - 240
  • [8] User Scheduling for Federated Learning Through Over-the-Air Computation
    Ma, Xiang
    Sun, Haijian
    Wang, Qun
    Hu, Rose Qingyang
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [9] Device Scheduling for Over-the-Air Federated Learning with Differential Privacy
    Yan, Na
    Wang, Kezhi
    Pan, Cunhua
    Chai, Kok Keong
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 51 - 56
  • [10] Optimized Power Control for Over-the-Air Federated Edge Learning
    Cao, Xiaowen
    Zhu, Guangxu
    Xu, Jie
    Cui, Shuguang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,