Pain-FL: Personalized Privacy-Preserving Incentive for Federated Learning

被引:51
|
作者
Sun, Peng [1 ,2 ]
Che, Haoxuan [3 ]
Wang, Zhibo [4 ,5 ]
Wang, Yuwei [1 ]
Wang, Tao [6 ]
Wu, Liantao [7 ]
Shao, Huajie [8 ]
机构
[1] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[2] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian 710129, Peoples R China
[4] Zhejiang Univ, Sch Cyber Sci & Technol, Hangzhou 310027, Peoples R China
[5] Zhejiang Univ, Key Lab Blockchain & Cyberspace Governance Zhejia, Hangzhou 310027, Peoples R China
[6] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[7] ShanghaiTech Univ, Shanghai Inst Fog Comp Technol SHIFT, Shanghai 201210, Peoples R China
[8] Coll William & Mary, Dept Comp Sci, Williamsburg, VA 23185 USA
基金
中国国家自然科学基金;
关键词
Privacy; Biological system modeling; Servers; Costs; Contracts; Computational modeling; Data models; Federated learning; differential privacy; incentive mechanism; contracts;
D O I
10.1109/JSAC.2021.3118354
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) is a privacy-preserving distributed machine learning framework, which involves training statistical models over a number of mobile users (i.e., workers) while keeping data localized. However, recent works have demonstrated that workers engaged in FL are still susceptible to advanced inference attacks when sharing model updates or gradients, which would discourage them from participating. Most of the existing incentive mechanisms for FL mainly account for workers' resource cost, while the cost incurred by potential privacy leakage resulting from inference attacks has rarely been incorporated. To address these issues, in this paper, we propose a contract-based personalized privacy-preserving incentive for FL, named Pain-FL, to provide customized payments for workers with different privacy preferences as compensation for privacy leakage cost while ensuring satisfactory convergence performance of FL models. The core idea of Pain-FL is that each worker agrees on a customized contract, which specifies a kind of privacy-preserving level (PPL) and the corresponding payment, with the server in each round of FL. Then, the worker perturbs her calculated stochastic gradients to be uploaded with that PPL in exchange for that payment. In particular, we respectively derive a set of optimal contracts analytically under both complete and incomplete information models, which could optimize the convergence performance of the finally learned global model, while bearing some desired economic properties, i.e., budget feasibility, individual rationality, and incentive compatibility. An exhaustive experimental evaluation of Pain-FL is conducted, and the results corroborate its practicability and effectiveness.
引用
收藏
页码:3805 / 3820
页数:16
相关论文
共 50 条
  • [1] Privacy-Preserving Personalized Federated Learning
    Hu, Rui
    Guo, Yuanxiong
    Li, Hongning
    Pei, Qingqi
    Gong, Yanmin
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [2] A Personalized Privacy-Preserving Scheme for Federated Learning
    Li, Zhenyu
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 1352 - 1356
  • [3] PPFed: A Privacy-Preserving and Personalized Federated Learning Framework
    Zhang, Guangsheng
    Liu, Bo
    Zhu, Tianqing
    Ding, Ming
    Zhou, Wanlei
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19380 - 19393
  • [4] Privacy-preserving patient clustering for personalized federated learning
    Elhussein, Ahmed
    Gursoy, Gamze
    [J]. MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 219, 2023, 219
  • [5] Communication-Efficient Personalized Federated Learning With Privacy-Preserving
    Wang, Qian
    Chen, Siguang
    Wu, Meng
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (02): : 2374 - 2388
  • [6] A Privacy-Preserving Incentive Mechanism for Federated Cloud-Edge Learning
    Liu, Tianyu
    Di, Boya
    Wang, Shupeng
    Song, Lingyang
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [7] PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework
    Zhao, Jiaqi
    Zhu, Hui
    Wang, Fengwei
    Lu, Rongxing
    Liu, Zhe
    Li, Hui
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 2059 - 2073
  • [8] DeTrust-FL: Privacy-Preserving Federated Learning in Decentralized Trust Setting
    Xu, Runhua
    Baracaldo, Nathalie
    Zhou, Yi
    Anwar, Ali
    Kadhe, Swanand
    Ludwig, Heiko
    [J]. 2022 IEEE 15TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (IEEE CLOUD 2022), 2022, : 417 - 426
  • [9] Privacy-Preserving Incentive Scheme Design for UAV-Enabled Federated Learning
    Wang, Rui
    Liu, Xin
    Xie, Liang
    Liu, Yiliang
    Su, Zhou
    Liu, Donglan
    Zhang, Hao
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [10] Privacy-Preserving Incentive Mechanism Design for Federated Cloud-Edge Learning
    Liu, Tianyu
    Di, Boya
    An, Peng
    Song, Lingyang
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (03): : 2588 - 2600