Accelerating Convergence of Federated Learning in MEC With Dynamic Community

被引:25
|
作者
Sun, Wen [1 ]
Zhao, Yong [1 ]
Ma, Wenqiang [1 ]
Guo, Bin [2 ]
Xu, Lexi [3 ]
Duong, Trung Q. [4 ]
机构
[1] Northwestern Polytech Univ, Dept Cybersecur, Xian 710060, Peoples R China
[2] Northwestern Polytech Univ, Dept Comp Sci, Xian 710060, Peoples R China
[3] China United Network Commun Corp, Res Inst, Beijing 100140, Peoples R China
[4] Queens Univ Belfast, Belfast BT7 1NN, North Ireland
基金
中国国家自然科学基金;
关键词
Federated learning; Training; Adaptation models; Convergence; Task analysis; Reinforcement learning; Heuristic algorithms; Deep reinforcement learning; edge intelligence; federated learning; resource allocation; COMMUNICATION;
D O I
10.1109/TMC.2023.3241770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) brings computational resources to the edge of network that triggers the paradigm shift of centralized machine learning towards federated learning. Federated learning enables edge nodes to collaboratively train a shared prediction model without sharing data. In MEC, heterogeneous edge nodes may join or leave the training phase during the federated learning process, resulting in slow convergence of dynamic communities and federated learning. In this paper, we propose a fine-grained training strategy for federated learning to accelerate its convergence rate in MEC with dynamic community. Based on multi-agent reinforcement learning, the proposed scheme enables each edge node to adaptively adjust its training strategy (aggregation timing and frequency) according to the network dynamics, while compromising with each other to improve the convergence of federated learning. To further adapt to the dynamic community in MEC, we propose a meta-learning-based scheme where new nodes can learn from other nodes and quickly perform scene migration to further accelerate the convergence of federated learning. Numerical results show that the proposed framework outperforms the benchmarks in terms of convergence speed, learning accuracy, and resource consumption.
引用
收藏
页码:1769 / 1784
页数:16
相关论文
共 50 条
  • [31] Fast Convergence Algorithm for Analog Federated Learning
    Xia, Shuhao
    Zhu, Jingyang
    Yang, Yuhan
    Zhou, Yong
    Shi, Yuanming
    Chen, Wei
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [32] Convergence of Federated Learning Over a Noisy Downlink
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (03) : 1422 - 1437
  • [33] Global Convergence of Federated Learning for Mixed Regression
    Su, Lili
    Xu, Jiaming
    Yang, Pengkun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [34] FedSVRG Based Communication Efficient Scheme for Federated Learning in MEC Networks
    Chen, Dawei
    Hong, Choong Seon
    Zha, Yiyong
    Zhang, Yunfei
    Liu, Xin
    Han, Zhu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (07) : 7300 - 7304
  • [35] Scheduling Policy and Power Allocation for Federated Learning in NOMA Based MEC
    Ma, Xiang
    Sun, Haijian
    Hu, Rose Qingyang
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [36] Task Scheduling with Collaborative Computing of MEC System Based on Federated Learning
    Shi, Tianyi
    Tian, Hongfeng
    Zhang, Tiankui
    Loo, Jonathan
    Ou, Jiangtao
    Fan, Chengyuan
    Yang, Dingcheng
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [37] FLchain: Federated Learning via MEC-enabled Blockchain Network
    Majeed, Umer
    Hong, Choong Seon
    2019 20TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2019,
  • [38] VARF: An Incentive Mechanism of Cross-Silo Federated Learning in MEC
    Li, Ying
    Wang, Xingwei
    Zeng, Rongfei
    Yang, Mingzhou
    Li, Kexin
    Huang, Min
    Dustdar, Schahram
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15115 - 15132
  • [39] A Method of Accelerating the Convergence of Temporal Difference Learning
    He B.
    Liu Q.
    Zhang L.-L.
    Shi S.-M.
    Chen H.-M.
    Yan Y.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (07): : 1679 - 1688
  • [40] Accelerating DNN Training in Wireless Federated Edge Learning Systems
    Ren, Jinke
    Yu, Guanding
    Ding, Guangyao
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (01) : 219 - 232