Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

被引:0
|
作者
Sha, Xiaobao [1 ,2 ]
Sun, Wenjian [1 ]
Liu, Xiang [1 ]
Luo, Yang [1 ,2 ]
Luo, Chunbo [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst Huzhou, Huzhou 313001, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
关键词
federated learning; edge computing; Non-IID data;
D O I
10.3390/electronics13112135
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is widely regarded as highly promising because it enables the collaborative training of high-performance machine learning models among a large number of clients while preserving data privacy by keeping the data local. However, many existing FL frameworks have a two-layered architecture, thus requiring the frequent exchange of large-scale model parameters between clients and remote cloud servers over often unstable networks and resulting in significant communication overhead and latency. To address this issue, we propose to introduce edge servers between the clients and the cloud server to assist in aggregating local models, thus combining asynchronous client-edge model aggregation with synchronous edge-cloud model aggregation. By leveraging the clients' idle time to accelerate training, the proposed framework can achieve faster convergence and reduce the amount of communication traffic. To make full use of the grouping properties inherent in three-layer FL, we propose a similarity matching strategy between edges and clients, thus improving the effect of asynchronous training. We further propose to introduce model-contrastive learning into the loss function and personalize the clients' local models to address the potential learning issues resulting from asynchronous local training in order to further improve the convergence speed. Extensive experiments confirm that our method exhibits significant improvements in model accuracy and convergence speed when compared with other state-of-the-art federated learning architectures.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] EAPS: Edge-Assisted Privacy-Preserving Federated Prediction Systems
    Feng, Daquan
    Huang, Guanxin
    Feng, Chenyuan
    Cao, Bin
    Wang, Zhenzhong
    Xia, Xiang-Gen
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [22] Energy-Aware Device Scheduling for Joint Federated Learning in Edge-assisted Internet of Agriculture Things
    Yu, Chong
    Shen, Shuaiqi
    Zhang, Kuan
    Zhao, Hai
    Shi, Yeyin
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1140 - 1145
  • [24] Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation
    Toghani, Mohammad Taha
    Uribe, Cesar A.
    2022 58TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2022,
  • [25] Federated Edge-assisted Mobile Clouds for Service Provisioning in Heterogeneous IoT Environments
    Farris, Ivan
    Militano, Leonardo
    Nitti, Michele
    Iera, Antonio
    Atzori, Luigi
    2015 IEEE 2ND WORLD FORUM ON INTERNET OF THINGS (WF-IOT), 2015, : 591 - 596
  • [26] An Efficient Asynchronous Federated Learning Protocol for Edge Devices
    Li, Qian
    Gao, Ziyi
    Sun, Yetao
    Wang, Yan
    Wang, Rui
    Zhu, Haiyan
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28798 - 28808
  • [27] Optimized Edge Aggregation for Hierarchical Federated Learning
    Xu, Bo
    Xia, Wenchao
    Wen, Wanli
    Zhao, Haitao
    Zhu, Hongbo
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [28] FedLC: Accelerating Asynchronous Federated Learning in Edge Computing
    Xu, Yang
    Ma, Zhenguo
    Xu, Hongli
    Chen, Suo
    Liu, Jianchun
    Xue, Yinxing
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 5327 - 5343
  • [29] An Asynchronous Federated Learning Mechanism for Edge Network Computing
    Lu X.
    Liao Y.
    Lio P.
    Pan H.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (12): : 2571 - 2582
  • [30] Edge-assisted classical decorrelator for multiuser asynchronous DS-CDMA channel
    Gulhane, Sanjay M.
    Pathak, Sant S.
    SIGNAL PROCESSING, 2010, 90 (03) : 914 - 925