SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning

被引:0
|
作者
Liang Z. [1 ]
Jin Q. [1 ]
Wang Z. [1 ]
Chen Z. [2 ,3 ,4 ]
Gu Z. [3 ,4 ,5 ]
Lu Y. [4 ,6 ]
Zhang F. [1 ]
机构
[1] Zhejiang University, Hangzhou
[2] Peking University, Beijing
[3] DAMO Academy, Alibaba group, Beijing
[4] Hupan Lab, Hangzhou
[5] Tsinghua University, Beijing
[6] Alibaba Group, Shanghai
基金
中国国家自然科学基金;
关键词
Additive Homomorphic Encryption; Hardware Accelerator; Multi-Party Computation; Privacy-Preserving Machine Learning;
D O I
10.46586/tches.v2024.i2.819-843
中图分类号
学科分类号
摘要
Secure multi-party computation and homomorphic encryption are two primary security primitives in privacy-preserving machine learning, whose wide adop-tion is, nevertheless, constrained by the computation and network communication overheads. This paper proposes a hybrid Secret-sharing and Homomorphic encryption Architecture for Privacy-pERsevering machine learning (SHAPER). SHAPER protects sensitive data in encrypted or randomly shared domains instead of rely-ing on a trusted third party. The proposed algorithm-protocol-hardware co-design methodology explores techniques such as plaintext Single Instruction Multiple Data (SIMD) and fine-grained scheduling, to minimize end-to-end latency in various network settings. SHAPER also supports secure domain computing acceleration and the conversion between mainstream privacy-preserving primitives, making it ready for general and distinctive data characteristics. SHAPER is evaluated by FPGA prototyping with a comprehensive hyper-parameter exploration, demonstrating a 94× speed-up over CPU clusters on large-scale logistic regression training tasks. © 2024, Ruhr-University of Bochum. All rights reserved.
引用
收藏
页码:819 / 843
页数:24
相关论文
共 50 条
  • [1] Cryptographic Primitives in Privacy-Preserving Machine Learning: A Survey
    Qin, Hong
    He, Debiao
    Feng, Qi
    Khan, Muhammad Khurram
    Luo, Min
    Choo, Kim-Kwang Raymond
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (05) : 1919 - 1934
  • [2] Practical Secure Aggregation for Privacy-Preserving Machine Learning
    Bonawitz, Keith
    Ivanov, Vladimir
    Kreuter, Ben
    Marcedone, Antonio
    McMahan, H. Brendan
    Patel, Sarvar
    Ramage, Daniel
    Segal, Aaron
    Seth, Karn
    CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, : 1175 - 1191
  • [3] GuardNN: Secure Accelerator Architecture for Privacy-Preserving Deep Learning
    Hua, Weizhe
    Umar, Muhammad
    Zhang, Zhiru
    Suh, G. Edward
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 349 - 354
  • [4] Secure, privacy-preserving and federated machine learning in medical imaging
    Georgios A. Kaissis
    Marcus R. Makowski
    Daniel Rückert
    Rickmer F. Braren
    Nature Machine Intelligence, 2020, 2 : 305 - 311
  • [5] Privacy-Preserving Machine Learning Using Federated Learning and Secure Aggregation
    Lia, Dragos
    Togan, Mihai
    PROCEEDINGS OF THE 2020 12TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTERS AND ARTIFICIAL INTELLIGENCE (ECAI-2020), 2020,
  • [6] Secure, privacy-preserving and federated machine learning in medical imaging
    Kaissis, Georgios A.
    Makowski, Marcus R.
    Ruckert, Daniel
    Braren, Rickmer F.
    NATURE MACHINE INTELLIGENCE, 2020, 2 (06) : 305 - 311
  • [7] Privacy-Preserving Machine Learning
    Chow, Sherman S. M.
    FRONTIERS IN CYBER SECURITY, 2018, 879 : 3 - 6
  • [8] Privacy-preserving techniques for decentralized and secure machine learning in drug discovery
    Smajic, Aljosa
    Grandits, Melanie
    Ecker, Gerhard F.
    DRUG DISCOVERY TODAY, 2023, 28 (12)
  • [9] Privacy-Preserving Machine Learning [Cryptography]
    Kerschbaum, Florian
    Lukas, Nils
    IEEE SECURITY & PRIVACY, 2023, 21 (06) : 90 - 94
  • [10] Survey on Privacy-Preserving Machine Learning
    Liu J.
    Meng X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (02): : 346 - 362