Accelerating Convergence of Federated Learning in MEC With Dynamic Community

被引:25
|
作者
Sun, Wen [1 ]
Zhao, Yong [1 ]
Ma, Wenqiang [1 ]
Guo, Bin [2 ]
Xu, Lexi [3 ]
Duong, Trung Q. [4 ]
机构
[1] Northwestern Polytech Univ, Dept Cybersecur, Xian 710060, Peoples R China
[2] Northwestern Polytech Univ, Dept Comp Sci, Xian 710060, Peoples R China
[3] China United Network Commun Corp, Res Inst, Beijing 100140, Peoples R China
[4] Queens Univ Belfast, Belfast BT7 1NN, North Ireland
基金
中国国家自然科学基金;
关键词
Federated learning; Training; Adaptation models; Convergence; Task analysis; Reinforcement learning; Heuristic algorithms; Deep reinforcement learning; edge intelligence; federated learning; resource allocation; COMMUNICATION;
D O I
10.1109/TMC.2023.3241770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) brings computational resources to the edge of network that triggers the paradigm shift of centralized machine learning towards federated learning. Federated learning enables edge nodes to collaboratively train a shared prediction model without sharing data. In MEC, heterogeneous edge nodes may join or leave the training phase during the federated learning process, resulting in slow convergence of dynamic communities and federated learning. In this paper, we propose a fine-grained training strategy for federated learning to accelerate its convergence rate in MEC with dynamic community. Based on multi-agent reinforcement learning, the proposed scheme enables each edge node to adaptively adjust its training strategy (aggregation timing and frequency) according to the network dynamics, while compromising with each other to improve the convergence of federated learning. To further adapt to the dynamic community in MEC, we propose a meta-learning-based scheme where new nodes can learn from other nodes and quickly perform scene migration to further accelerate the convergence of federated learning. Numerical results show that the proposed framework outperforms the benchmarks in terms of convergence speed, learning accuracy, and resource consumption.
引用
收藏
页码:1769 / 1784
页数:16
相关论文
共 50 条
  • [41] Accelerating Federated Learning With Data and Model Parallelism in Edge Computing
    Liao, Yunming
    Xu, Yang
    Xu, Hongli
    Yao, Zhiwei
    Wang, Lun
    Qiao, Chunming
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (01) : 904 - 918
  • [42] FedQClip: Accelerating Federated Learning via Quantized Clipped SGD
    Qu, Zhihao
    Jia, Ninghui
    Ye, Baoliu
    Hu, Shihong
    Guo, Song
    IEEE TRANSACTIONS ON COMPUTERS, 2025, 74 (02) : 717 - 730
  • [43] Accelerating Federated Learning with Two-phase Gradient Adjustment
    Wang, Jiajun
    Mao, Yingchi
    He, Xiaoming
    Zhou, Tong
    Wu, Jun
    Wu, Jie
    2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS, 2022, : 810 - 817
  • [44] Accelerating Split Federated Learning Over Wireless Communication Networks
    Xu, Ce
    Li, Jinxuan
    Liu, Yuan
    Ling, Yushi
    Wen, Miaowen
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 5587 - 5599
  • [45] MOHAWK: Mobility and Heterogeneity-Aware Dynamic Community Selection for Hierarchical Federated Learning
    Farcas, Allen-Jasmin
    Lee, Myungjin
    Kompella, Ramana Rao
    Latapie, Hugo
    de Veciana, Gustavo
    Marculescu, Radu
    PROCEEDINGS 8TH ACM/IEEE CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION, IOTDI 2023, 2023, : 249 - 261
  • [46] The Role of Communication Time in the Convergence of Federated Edge Learning
    Zhou, Yipeng
    Fu, Yao
    Luo, Zhenxiao
    Hu, Miao
    Wu, Di
    Sheng, Quan Z.
    Yu, Shui
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 3241 - 3254
  • [47] Device Scheduling with Fast Convergence for Wireless Federated Learning
    Shi, Wenqi
    Zhou, Sheng
    Niu, Zhisheng
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [48] FLAC: Federated Learning with Autoencoder Compression and Convergence Guarantee
    Beitollahi, Mahdi
    Lu, Ning
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 4589 - 4594
  • [49] On the Convergence of Hierarchical Federated Learning with Partial Worker Participation
    Jiang, Xiaohan
    Zhu, Hongbin
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2024, 244 : 1797 - 1824
  • [50] Convergence Analysis for Wireless Federated Learning with Gradient Recycling
    Chen, Zhixiong
    Yi, Wenqiang
    Liu, Yuanwei
    Nallanathan, Arumugam
    2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 1232 - 1237