Accelerating Convergence of Federated Learning in MEC With Dynamic Community

被引:25
|
作者
Sun, Wen [1 ]
Zhao, Yong [1 ]
Ma, Wenqiang [1 ]
Guo, Bin [2 ]
Xu, Lexi [3 ]
Duong, Trung Q. [4 ]
机构
[1] Northwestern Polytech Univ, Dept Cybersecur, Xian 710060, Peoples R China
[2] Northwestern Polytech Univ, Dept Comp Sci, Xian 710060, Peoples R China
[3] China United Network Commun Corp, Res Inst, Beijing 100140, Peoples R China
[4] Queens Univ Belfast, Belfast BT7 1NN, North Ireland
基金
中国国家自然科学基金;
关键词
Federated learning; Training; Adaptation models; Convergence; Task analysis; Reinforcement learning; Heuristic algorithms; Deep reinforcement learning; edge intelligence; federated learning; resource allocation; COMMUNICATION;
D O I
10.1109/TMC.2023.3241770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) brings computational resources to the edge of network that triggers the paradigm shift of centralized machine learning towards federated learning. Federated learning enables edge nodes to collaboratively train a shared prediction model without sharing data. In MEC, heterogeneous edge nodes may join or leave the training phase during the federated learning process, resulting in slow convergence of dynamic communities and federated learning. In this paper, we propose a fine-grained training strategy for federated learning to accelerate its convergence rate in MEC with dynamic community. Based on multi-agent reinforcement learning, the proposed scheme enables each edge node to adaptively adjust its training strategy (aggregation timing and frequency) according to the network dynamics, while compromising with each other to improve the convergence of federated learning. To further adapt to the dynamic community in MEC, we propose a meta-learning-based scheme where new nodes can learn from other nodes and quickly perform scene migration to further accelerate the convergence of federated learning. Numerical results show that the proposed framework outperforms the benchmarks in terms of convergence speed, learning accuracy, and resource consumption.
引用
收藏
页码:1769 / 1784
页数:16
相关论文
共 50 条
  • [21] Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing
    Wang, Lun
    Xu, Yang
    Xu, Hongli
    Chen, Min
    Huang, Liusheng
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (09) : 5001 - 5016
  • [22] Accelerating Federated Learning With Cluster Construction and Hierarchical Aggregation
    Wang, Zhiyuan
    Xu, Hongli
    Liu, Jianchun
    Xu, Yang
    Huang, He
    Zhao, Yangming
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) : 3805 - 3822
  • [23] FedLC: Accelerating Asynchronous Federated Learning in Edge Computing
    Xu, Yang
    Ma, Zhenguo
    Xu, Hongli
    Chen, Suo
    Liu, Jianchun
    Xue, Yinxing
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 5327 - 5343
  • [24] Polaris: Accelerating Asynchronous Federated Learning With Client Selection
    Kang, Yufei
    Li, Baochun
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (02) : 446 - 458
  • [25] Accelerating Federated Edge Learning via Topology Optimization
    Huang, Shanfeng
    Zhang, Zezhong
    Wang, Shuai
    Wang, Rui
    Huang, Kaibin
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 2056 - 2070
  • [26] Accelerating Federated Learning via Momentum Gradient Descent
    Liu, Wei
    Chen, Li
    Chen, Yunfei
    Zhang, Wenyi
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (08) : 1754 - 1766
  • [27] Towards Accelerating the Adoption of Federated Learning for Heterogeneous Data
    Ntokos, Christos
    Bakalos, Nikolaos
    Kalogeras, Dimitrios
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023, 2023, : 617 - 624
  • [28] Dynamic Clustering in Federated Learning
    Kim, Yeongwoo
    Al Hakim, Ezeddin
    Haraldson, Johan
    Eriksson, Henrik
    da Silva, Jose Mairton B., Jr.
    Fischione, Carlo
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [29] Global Convergence of Federated Learning for Mixed Regression
    Su, Lili
    Xu, Jiaming
    Yang, Pengkun
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (09) : 6391 - 6411
  • [30] Fast convergence for federated learning in OFDMA systems
    Ye, Deshi
    Chen, Songyang
    Wang, Can
    2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,