Contribution-wise Byzantine-robust aggregation for Class-Balanced Federated Learning

被引:0
|
作者
Li, Yanli [1 ]
Ding, Weiping [3 ]
Chen, Huaming [1 ]
Bao, Wei [2 ]
Yuan, Dong [1 ]
机构
[1] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[2] Univ Sydney, Sch Comp Sci, Sydney, NSW 2006, Australia
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
关键词
Federated learning (FL); Poisoning attack; Byzantine-robust aggregation; Adversarial machine learning; Non-independent identical (non-IID);
D O I
10.1016/j.ins.2024.120475
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a promising approach that allows many clients to jointly train a model without sharing the raw data. Due to the clients' different preferences, the class imbalance issue frequently occurs in real -world FL problems and poses threats for poisoning attacks to the existing FL methods. In this work, we first propose a new attack called Class Imbalance Attack that can degrade the testing accuracy of a particular class(es) to even 0 under the state-of-the-art robust FL methods. To defend against such attacks, we further propose a Class -Balanced FL method with a novel contribution -wise Byzantine -robust aggregation rule. In the designed rule, an honest score and a contribution score will be assigned to each client dynamically according to the server model. The server itself will be initiated with a small dataset, and a model (called server model) will be maintained. These two scores will be subsequently used to calculate the weighted average of the client gradients for each training iteration. The experiments are conducted on five datasets against state-of-the-art poisoning attacks, including the Class Imbalance Attack. The empirical results demonstrate the effectiveness of the proposed Class -Balanced FL method.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Byzantine-Robust Aggregation for Federated Learning with Reinforcement Learning
    Yan, Sizheng
    Du, Junping
    Xue, Zhe
    Li, Ang
    WEB AND BIG DATA, APWEB-WAIM 2024, PT IV, 2024, 14964 : 152 - 166
  • [2] CareFL: Contribution Guided Byzantine-Robust Federated Learning
    Dong, Qihao
    Yang, Shengyuan
    Dai, Zhiyang
    Gao, Yansong
    Wang, Shang
    Cao, Yuan
    Fu, Anmin
    Susilo, Willy
    IEEE Transactions on Information Forensics and Security, 2024, 19 : 9714 - 9729
  • [3] Byzantine-Robust Aggregation in Federated Learning Empowered Industrial IoT
    Li, Shenghui
    Ngai, Edith
    Voigt, Thiemo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1165 - 1175
  • [4] An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learning
    Li, Shenghui
    Ngai, Edith
    Voigt, Thiemo
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (06) : 975 - 988
  • [5] SEAR: Secure and Efficient Aggregation for Byzantine-Robust Federated Learning
    Zhao, Lingchen
    Jiang, Jianlin
    Feng, Bo
    Wang, Qian
    Shen, Chao
    Li, Qi
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2022, 19 (05) : 3329 - 3342
  • [6] Byzantine-robust Federated Learning via Cosine Similarity Aggregation
    Zhu, Tengteng
    Guo, Zehua
    Yao, Chao
    Tan, Jiaxin
    Dou, Songshi
    Wang, Wenrun
    Han, Zhenzhen
    COMPUTER NETWORKS, 2024, 254
  • [7] AFLGuard: Byzantine-robust Asynchronous Federated Learning
    Fang, Minghong
    Liu, Jia
    Gong, Neil Zhenqiang
    Bentley, Elizabeth S.
    PROCEEDINGS OF THE 38TH ANNUAL COMPUTER SECURITY APPLICATIONS CONFERENCE, ACSAC 2022, 2022, : 632 - 646
  • [8] Differentially Private Byzantine-Robust Federated Learning
    Ma, Xu
    Sun, Xiaoqian
    Wu, Yuduo
    Liu, Zheli
    Chen, Xiaofeng
    Dong, Changyu
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 3690 - 3701
  • [9] An Enclave-Aided Byzantine-Robust Federated Aggregation Framework
    Yao, Jingyi
    Song, Chen
    Li, Hongjia
    Wang, Yuxiang
    Yang, Qian
    Wang, Liming
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [10] FedSuper: A Byzantine-Robust Federated Learning Under Supervision
    Zhao, Ping
    Jiang, Jin
    Zhang, Guanglin
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2024, 20 (02)