SEAR: Secure and Efficient Aggregation for Byzantine-Robust Federated Learning

被引:42
|
作者
Zhao, Lingchen [1 ]
Jiang, Jianlin [2 ]
Feng, Bo [3 ]
Wang, Qian [1 ]
Shen, Chao [4 ]
Li, Qi [5 ,6 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Key Lab Aerosp Informat Secur & Trusted Comp, Minist Educ, Wuhan 430072, Hubei, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
[4] Xi An Jiao Tong Univ, Sch Cyber Sci & Engn, MOE Key Lab Intelligent Networks & Network Secur, Xian 710049, Shaanxi, Peoples R China
[5] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[6] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
基金
国家重点研发计划;
关键词
Servers; Computational modeling; Collaborative work; Data models; Privacy; Cryptography; Training data; Federated learning; secure aggregation; trusted execution environment;
D O I
10.1109/TDSC.2021.3093711
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning facilitates the collaborative training of a global model among distributed clients without sharing their training data. Secure aggregation, a new security primitive for federated learning, aims to preserve the confidentiality of both local models and training data. Unfortunately, existing secure aggregation solutions fail to defend against Byzantine failures that are common in distributed computing systems. In this work, we propose a new secure and efficient aggregation framework, SEAR, for Byzantine-robust federated learning. Relying on the trusted execution environment, i.e., Intel SGX, SEAR protects clients' private models while enabling Byzantine resilience. Considering the limitation of the current Intel SGX's architecture (i.e., the limited trusted memory), we propose two data storage modes to efficiently implement aggregation algorithms efficiently in SGX. Moreover, to balance the efficiency and performance of aggregation, we propose a sampling-based method to efficiently detect Byzantine failures without degrading the global model's performance. We implement and evaluate SEAR in a LAN environment, and the experiment results show that SEAR is computationally efficient and robust to Byzantine adversaries. Compared to the previous practical secure aggregation framework, SEAR improves aggregation efficiency by 4-6 times while supporting Byzantine resilience at the same time.
引用
收藏
页码:3329 / 3342
页数:14
相关论文
共 50 条
  • [1] rFedFW: Secure and trustable aggregation scheme for Byzantine-robust federated learning in Internet of Things
    Ni, Lina
    Gong, Xu
    Li, Jufeng
    Tang, Yuncan
    Luan, Zhuang
    Zhang, Jinquan
    [J]. INFORMATION SCIENCES, 2024, 653
  • [2] Byzantine-Robust and Efficient Federated Learning for the Internet of Things
    Jin, Rui
    Hu, Jia
    Min, Geyong
    Lin, Hui
    [J]. IEEE Internet of Things Magazine, 2022, 5 (01): : 114 - 118
  • [3] Byzantine-Robust Aggregation in Federated Learning Empowered Industrial IoT
    Li, Shenghui
    Ngai, Edith
    Voigt, Thiemo
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1165 - 1175
  • [4] Byzantine-robust Federated Learning via Cosine Similarity Aggregation
    Zhu, Tengteng
    Guo, Zehua
    Yao, Chao
    Tan, Jiaxin
    Dou, Songshi
    Wang, Wenrun
    Han, Zhenzhen
    [J]. COMPUTER NETWORKS, 2024, 254
  • [5] Efficient and Privacy-Preserving Byzantine-robust Federated Learning
    Luan, Shijie
    Lu, Xiang
    Zhang, Zhuangzhuang
    Chang, Guangsheng
    Guo, Yunchuan
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2202 - 2208
  • [6] Communication-Efficient and Byzantine-Robust Differentially Private Federated Learning
    Li, Min
    Xiao, Di
    Liang, Jia
    Huang, Hui
    [J]. IEEE COMMUNICATIONS LETTERS, 2022, 26 (08) : 1725 - 1729
  • [7] AFLGuard: Byzantine-robust Asynchronous Federated Learning
    Fang, Minghong
    Liu, Jia
    Gong, Neil Zhenqiang
    Bentley, Elizabeth S.
    [J]. PROCEEDINGS OF THE 38TH ANNUAL COMPUTER SECURITY APPLICATIONS CONFERENCE, ACSAC 2022, 2022, : 632 - 646
  • [8] Differentially Private Byzantine-Robust Federated Learning
    Ma, Xu
    Sun, Xiaoqian
    Wu, Yuduo
    Liu, Zheli
    Chen, Xiaofeng
    Dong, Changyu
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 3690 - 3701
  • [9] RSAM: Byzantine-Robust and Secure Model Aggregation in Federated Learning for Internet of Vehicles Using Private Approximate Median
    He, Yuanyuan
    Li, Peizhi
    Ni, Jianbing
    Deng, Xianjun
    Lu, Hongwei
    Zhang, Jie
    Yang, Laurence T.
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 6714 - 6726
  • [10] An Enclave-Aided Byzantine-Robust Federated Aggregation Framework
    Yao, Jingyi
    Song, Chen
    Li, Hongjia
    Wang, Yuxiang
    Yang, Qian
    Wang, Liming
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,