More Practical Privacy-Preserving Machine Learning as A Service via Efficient Secure Matrix Multiplication

被引:15
|
作者
Lu, Wen-jie [1 ]
Sakuma, Jun [2 ]
机构
[1] Univ Tsukuba, Tsukuba, Ibaraki, Japan
[2] Univ Tsukuba, Japan Sci & Technol, CREST RIKEN API Ctr, Tsukuba, Ibaraki, Japan
基金
日本学术振兴会;
关键词
Secure Two-party Computation; Multiplication Triple; Homomorphic Encryption; Privacy-Preserving Machine Learning; COMPUTATION;
D O I
10.1145/3267973.3267976
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An efficient secure two-party computation protocol of matrix multiplication allows privacy-preserving cloud-aid machine learning services such as face recognition and traffic-aware navigation. We use homomorphic encryption to construct a secure matrix multiplication protocol with a small communication overhead and computation overhead on the client's side, which works particularly well when a large number of clients access to the server simultaneously. The fastest secure matrix multiplication protocols have been constructed using tools such as oblivious transfer, but a potential limitation of these methods is the needs of using a wide network bandwidth between the client and the server, e.g., 10 Gbps. This is of particular concern when thousands of clients interact with the server concurrently. Under this setting, the performance oblivious transfer-based methods will decrease significantly, since the server can only allocate a small ratio of its outgoing bandwidth for each client. With three proposed optimizations, our matrix multiplication protocol can run very fast even under the high concurrent setting. Our benchmarks show that it takes an Amazon instance (i.e., 72 CPUs and 25 Gbps outgoing bandwidth) less than 50 seconds to complete 1000 concurrent secure matrix multiplications with 128 x 128 entries. In addition, our method reduces more than 74% - 97% of the precomputation time of two privacy-preserving machine learning frameworks, SecureML (S&P'17) and MiniONN (CCS'17).
引用
收藏
页码:25 / 36
页数:12
相关论文
共 50 条
  • [1] Practical Secure Aggregation for Privacy-Preserving Machine Learning
    Bonawitz, Keith
    Ivanov, Vladimir
    Kreuter, Ben
    Marcedone, Antonio
    McMahan, H. Brendan
    Patel, Sarvar
    Ramage, Daniel
    Segal, Aaron
    Seth, Karn
    [J]. CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, : 1175 - 1191
  • [2] A novel privacy-preserving graph convolutional network via secure matrix multiplication
    Zhang, Hai-Feng
    Zhang, Feng
    Wang, Huan
    Ma, Chuang
    Zhu, Pei-Can
    [J]. INFORMATION SCIENCES, 2024, 657
  • [3] Towards Practical Secure Privacy-Preserving Machine (Deep) Learning with Distributed Data
    Kumar, Mohit
    Moser, Bernhard
    Fischer, Lukas
    Freudenthaler, Bernhard
    [J]. DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022 WORKSHOPS, 2022, 1633 : 55 - 66
  • [4] Coded Computing for Resilient, Secure, and Privacy-Preserving Distributed Matrix Multiplication
    Yu, Qian
    Avestimehr, A. Salman
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (01) : 59 - 72
  • [5] PrivColl: Practical Privacy-Preserving Collaborative Machine Learning
    Zhang, Yanjun
    Bai, Guangdong
    Li, Xue
    Curtis, Caitlin
    Chen, Chen
    Ko, Ryan K. L.
    [J]. COMPUTER SECURITY - ESORICS 2020, PT I, 2020, 12308 : 399 - 418
  • [6] Hyperdimensional Computing as a Rescue for Efficient Privacy-Preserving Machine Learning-as-a-Service
    Park, Jaewoo
    Quan, Chenghao
    Moon, Hyungon
    Lee, Jongeun
    [J]. 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2023,
  • [7] Privacy-Preserving Machine Learning as a Service: Challenges and Opportunities
    Zhang, Qiao
    Xiang, Tao
    Cai, Yifei
    Zhao, Zhichao
    Wang, Ning
    Wu, Hongyi
    [J]. IEEE NETWORK, 2023, 37 (06): : 214 - 223
  • [8] Secure, privacy-preserving and federated machine learning in medical imaging
    Georgios A. Kaissis
    Marcus R. Makowski
    Daniel Rückert
    Rickmer F. Braren
    [J]. Nature Machine Intelligence, 2020, 2 : 305 - 311
  • [9] Privacy-Preserving Machine Learning Using Federated Learning and Secure Aggregation
    Lia, Dragos
    Togan, Mihai
    [J]. PROCEEDINGS OF THE 2020 12TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTERS AND ARTIFICIAL INTELLIGENCE (ECAI-2020), 2020,
  • [10] Secure, privacy-preserving and federated machine learning in medical imaging
    Kaissis, Georgios A.
    Makowski, Marcus R.
    Ruckert, Daniel
    Braren, Rickmer F.
    [J]. NATURE MACHINE INTELLIGENCE, 2020, 2 (06) : 305 - 311