Robust Asynchronous Federated Learning With Time-Weighted and Stale Model Aggregation

被引:1
|
作者
Miao, Yinbin [1 ]
Liu, Ziteng [1 ]
Li, Xinghua [2 ,3 ]
Li, Meng [4 ]
Li, Hongwei [5 ]
Choo, Kim-Kwang Raymond [6 ]
Deng, Robert H. [7 ]
机构
[1] Xidian Univ, Sch Cyber Engn, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Xidian Univ, Engn Res Ctr Big data Secur, Minist Educ, Xian 710071, Peoples R China
[4] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230002, Peoples R China
[5] Univ Elect Sci & Technol China, Dept Comp Sci & Engn, Chengdu 610051, Peoples R China
[6] Univ Texas San Antonio, Dept Informat Syst & Cyber Secur, San Antonio, TX 78249 USA
[7] Singapore Management Univ, Sch Informat Syst, Singapore 178902, Singapore
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Privacy; Computational modeling; Training; Federated learning; Servers; Homomorphic encryption; Convergence; heterogeneity; symmetric homomorphic encryption; privacy; lightweight computing;
D O I
10.1109/TDSC.2023.3304788
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) ensures collaborative learning among multiple clients while maintaining data locally. However, the traditional synchronous FL solutions have lower accuracy and require more communication time in scenarios where most devices drop out during learning. Therefore, we propose an Asynchronous Federated Learning (AsyFL) scheme using time-weighted and stale model aggregation, which effectively solves the problem of poor model performance due to the heterogeneity of devices. Then, we integrate Symmetric Homomorphic Encryption (SHE) into AsyFL to propose Asynchronous Privacy-Preserving Federated Learning (Asy-PPFL), which protects the privacy of clients and achieves lightweight computing. Privacy analysis shows that Asy-PPFL is indistinguishable under Known Plaintext Attack (KPA) and convergence analysis proves the effectiveness of our schemes. A large number of experiments show that AsyFL and Asy-PPFL can achieve the highest accuracy of 58.40% and 58.26% on Cifar-10 dataset when most clients (i.e., 80%) are offline or delayed, respectively.
引用
收藏
页码:2361 / 2375
页数:15
相关论文
共 50 条
  • [1] Asynchronous Robust Aggregation Method with Privacy Protection for IoV Federated Learning
    Zhou, Antong
    Jiang, Ning
    Tang, Tong
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (01):
  • [2] Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation
    Chen, Yang
    Sun, Xiaoyan
    Jin, Yaochu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (10) : 4229 - 4238
  • [3] Federated Learning with Buffered Asynchronous Aggregation
    Nguyen, John
    Malik, Kshitiz
    Zhan, Hongyuan
    Yousefpour, Ashkan
    Rabbat, Michael
    Malek, Mani
    Huba, Dzmitry
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [4] Robust Aggregation for Federated Learning
    Pillutla, Krishna
    Kakade, Sham M.
    Harchaoui, Zaid
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 1142 - 1154
  • [5] Clustered Federated Learning with Weighted Model Aggregation for Imbalanced Data
    Dong Wang
    Naifu Zhang
    Meixia Tao
    China Communications, 2022, (08) : 41 - 56
  • [6] Clustered Federated Learning with Weighted Model Aggregation for Imbalanced Data
    Wang, Dong
    Zhang, Naifu
    Tao, Meixia
    CHINA COMMUNICATIONS, 2022, 19 (08) : 41 - 56
  • [7] Adapted Weighted Aggregation in Federated Learning
    Tang, Yitong
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23763 - 23765
  • [8] Robust Federated Learning with Parameter Classification and Weighted Aggregation against Noisy Labels
    Li, Qun
    Duan, Congying
    Chen, Siguang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2445 - 2450
  • [9] Robust Aggregation Function in Federated Learning
    Taheri, Rahim
    Arabikhan, Farzad
    Gegov, Alexander
    Akbari, Negar
    ADVANCES IN INFORMATION SYSTEMS, ARTIFICIAL INTELLIGENCE AND KNOWLEDGE MANAGEMENT, ICIKS 2023, 2024, 486 : 168 - 175
  • [10] Robust federated learning under statistical heterogeneity via hessian-weighted aggregation
    Adnan Ahmad
    Wei Luo
    Antonio Robles-Kelly
    Machine Learning, 2023, 112 : 633 - 654