Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

被引:111
|
作者
Li, Yong [1 ,2 ,3 ]
Zhou, Yipeng [3 ]
Jolfaei, Alireza [3 ]
Yu, Dongjin [4 ]
Xu, Gaochao [1 ]
Zheng, Xi [3 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[2] Changchun Univ Technol, Coll Comp Sci & Engn, Changchun 130012, Peoples R China
[3] Macquarie Univ, Dept Comp, Sydney, NSW 2109, Australia
[4] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
基金
澳大利亚研究理事会;
关键词
FedAVG algorithm; federated learning (FL); privacy preservation; secure multiparty computing (SMC);
D O I
10.1109/JIOT.2020.3022911
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a promising new technology in the field of IoT intelligence. However, exchanging model-related data in FL may leak the sensitive information of participants. To address this problem, we propose a novel privacy-preserving FL framework based on an innovative chained secure multiparty computing technique, named chain-PPFL. Our scheme mainly leverages two mechanisms: 1) single-masking mechanism that protects information exchanged between participants and 2) chained-communication mechanism that enables masked information to be transferred between participants with a serial chain frame. We conduct extensive simulation-based experiments using two public data sets (MNIST and CIFAR-100) by comparing both training accuracy and leak defence with other state-of-the-art schemes. We set two data sample distributions (IID and NonIID) and three training models (CNN, MLP, and L-BFGS) in our experiments. The experimental results demonstrate that the chain-PPFL scheme can achieve practical privacy preservation (equivalent to differential privacy with epsilon approaching zero) for FL with some cost of communication and without impairing the accuracy and convergence speed of the training model.
引用
收藏
页码:6178 / 6186
页数:9
相关论文
共 50 条
  • [21] Secure, privacy-preserving and federated machine learning in medical imaging
    Georgios A. Kaissis
    Marcus R. Makowski
    Daniel Rückert
    Rickmer F. Braren
    [J]. Nature Machine Intelligence, 2020, 2 : 305 - 311
  • [22] Secure, privacy-preserving and federated machine learning in medical imaging
    Kaissis, Georgios A.
    Makowski, Marcus R.
    Ruckert, Daniel
    Braren, Rickmer F.
    [J]. NATURE MACHINE INTELLIGENCE, 2020, 2 (06) : 305 - 311
  • [23] Privacy-Preserving Machine Learning Using Federated Learning and Secure Aggregation
    Lia, Dragos
    Togan, Mihai
    [J]. PROCEEDINGS OF THE 2020 12TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTERS AND ARTIFICIAL INTELLIGENCE (ECAI-2020), 2020,
  • [24] TAPFed: Threshold Secure Aggregation for Privacy-Preserving Federated Learning
    Xu, Runhua
    Li, Bo
    Li, Chao
    Joshi, James B. D.
    Ma, Shuai
    Li, Jianxin
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (05) : 4309 - 4323
  • [25] A flexible and privacy-preserving federated learning framework based on logistic regression
    Wang, Junkai
    Xiong, Ling
    Liu, Zhicai
    Wang, Huan
    Li, Chunlin
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 116
  • [26] G-VCFL: Grouped Verifiable Chained Privacy-Preserving Federated Learning
    Zhang, Zhuangzhuang
    Wu, Libing
    He, Debiao
    Wang, Qian
    Wu, Dan
    Shi, Xiaochuan
    Ma, Chao
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4219 - 4231
  • [27] Practical Federated Learning Infrastructure for Privacy-Preserving Scientific Computing
    Wang, Lesi
    Zhao, Dongfang
    [J]. 2022 IEEE/ACM INTERNATIONAL WORKSHOP ON ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR SCIENTIFIC APPLICATIONS (AI4S), 2022, : 38 - 43
  • [28] Towards robust and privacy-preserving federated learning in edge computing
    Zhou, Hongliang
    Zheng, Yifeng
    Jia, Xiaohua
    [J]. COMPUTER NETWORKS, 2024, 243
  • [29] Practical Privacy-Preserving Federated Learning in Vehicular Fog Computing
    Li, Yiran
    Li, Hongwei
    Xu, Guowen
    Xiang, Tao
    Lu, Rongxing
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4692 - 4705
  • [30] Privacy-Preserving Feature Selection with Secure Multiparty Computation
    Li, Xiling
    Dowsley, Rafael
    De Cock, Martine
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139