Towards Fast and Energy-Efficient Hierarchical Federated Edge Learning: A Joint Design for Helper Scheduling and Resource Allocation

被引:1
|
作者
Went, Wanli [1 ,2 ]
Yang, Howard H. [3 ]
Xia, Wenchao [4 ]
Quek, Tony Q. S. [5 ]
机构
[1] Chongqing Univ, Sch Microelectron & Commun Engn, Chongqing, Peoples R China
[2] Southeast Univ, Nat Mobile Communicat Res Lab, Nanjing, Peoples R China
[3] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining, Peoples R China
[4] Nanjing Univ Posts & Telecommunicat, Jiangsu Key Lab Wireless Communicat, Nanjing, Peoples R China
[5] Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore, Singapore
关键词
NETWORKS;
D O I
10.1109/ICC45855.2022.9838950
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Hierarchical federated edge learning (H-FEEL) has been recently proposed to enhance the federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients. Each helper collects the trained gradients from users nearby, aggregates them, and sends the result to the server for model update. Due to limited communication resources, only a portion of helpers can upload their aggregated gradients to the server, thereby necessitating a well design for helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for H-FEEL which involves local gradient computing, weighted gradient uploading, and model updating phases. By characterizing these phases mathematically and analyzing the one-round convergence bound of the training algorithm, we formulate a problem to achieve the scheduling and resource allocation scheme. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation problem and helper scheduling problem. For the first subproblem, we obtain a low-complexity suboptimal solution by using a four-stage method. For the second subproblem, we obtain a stationary point by using the penalty convex-concave procedure. The efficacy of our scheme is demonstrated via simulations, and the analytical framework is shown to provide valuable insights for the design of practical H-FEEL system.
引用
下载
收藏
页码:5378 / 5383
页数:6
相关论文
共 50 条
  • [21] A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning
    Zhang, Jingbo
    Wu, Qiong
    Fan, Pingyi
    Fan, Qiang
    Computers, Materials and Continua, 2024, 81 (02): : 1953 - 1998
  • [22] Towards Energy-efficient Federated Edge Intelligence for IoT Networks
    Wang, Qu
    Xiao, Yong
    Zhu, Huixiang
    Sun, Zijian
    Li, Yingyu
    Ge, Xiaohu
    2021 IEEE 41ST INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW 2021), 2021, : 55 - 62
  • [23] Fuzzy Logic Assisted Client Selection and Energy-Efficient Joint Optimization for Hierarchical Federated Learning
    Dong, Zhihao
    Zhu, Xu
    Cao, Jie
    Jiang, Yufei
    Lau, Vincent K. N.
    Sun, Sumei
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 1262 - 1267
  • [24] Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing
    Wang, Zhiyuan
    Xu, Hongli
    Liu, Jianchun
    Huang, He
    Qiao, Chunming
    Zhao, Yangming
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [25] Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Jin, Jiangming
    Zhang, Yang
    Niyato, Dusit
    Leung, Cyril
    Miao, Chunyan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (03) : 536 - 550
  • [26] Energy-Efficient Resource Management for Federated Edge Learning With CPU-GPU Heterogeneous Computing
    Zeng, Qunsong
    Du, Yuqing
    Huang, Kaibin
    Leung, Kin K.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (12) : 7947 - 7962
  • [27] Energy-efficient anycast scheduling and resource allocation in optical grids
    Saja Al Mamoori
    Darshil Rami
    Arunita Jaekel
    Journal of Ambient Intelligence and Humanized Computing, 2018, 9 : 73 - 83
  • [28] Energy-Efficient Scheduling and Resource Allocation in Uplink OFDMA Systems
    Ye, Haina
    Lim, Gubong
    Cimini, Leonard J.
    Tan, Zhenhui
    IEEE COMMUNICATIONS LETTERS, 2015, 19 (03) : 439 - +
  • [29] Energy-efficient anycast scheduling and resource allocation in optical grids
    Al Mamoori, Saja
    Rami, Darshil
    Jaekel, Arunita
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2018, 9 (01) : 73 - 83
  • [30] Joint Client Scheduling and Wireless Resource Allocation for Heterogeneous Federated Edge Learning With Non-IID Data
    Yin, Tong
    Li, Lixin
    Lin, Wensheng
    Ni, Tao
    Liu, Ying
    Xu, Haitao
    Han, Zhu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5742 - 5754