Practical Federated Learning Infrastructure for Privacy-Preserving Scientific Computing

被引：0
|
作者：
Wang, Lesi [1 ]
Zhao, Dongfang [1 ]
机构：
[1] Univ Nevada, Dept Comp Sci & Engn, Reno, NV 89557 USA
来源：
2022 IEEE/ACM INTERNATIONAL WORKSHOP ON ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR SCIENTIFIC APPLICATIONS (AI4S) | 2022年
关键词：
MULTIPARTY COMPUTATION;
D O I：
10.1109/AI4S56813.2022.00012
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Federated learning (FL) is deemed a promising paradigm for privacy-preserving data analytics in collaborative scientific computing. However, there lacks an effective and easy-to-use FL infrastructure for scientific computing and high-performance computing (HPC) environments. The objective of this position paper is two-fold. Firstly, we identify three missing pieces of a scientific FL infrastructure: (i) a native MPI programming interface that can be seamlessly integrated into existing scientific applications, (ii) an independent data layer for the FL system such that the user can pick the persistent medium for her own choice, such as parallel file systems and multidimensional databases, and (iii) efficient encryption protocols that are optimized for scientific workflows. The second objective of this paper is to present a work-in-progress FL infrastructure, namely MPI-FL, which is implemented with PyTorch and MPI4py. We deploy MPI-FL on 1,000 CPU cores and evaluate it with four standard benchmarks: MNIST, Fashion-MNIST, CIFAR-10, and SVHN-extra. It is our hope that the scientific computing and HPC community would find MPI-FL useful for their FL-related projects.
引用
收藏
页码：38 / 43
页数：6
相关论文
共 50 条
  • [21] Privacy-Preserving and Low-Latency Federated Learning in Edge Computing
    He, Chunrong
    Liu, Guiyan
    Guo, Songtao
    Yang, Yuanyuan
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20): : 20149 - 20159
  • [22] An Efficient and Dynamic Privacy-Preserving Federated Learning System for Edge Computing
    Tang, Xinyu
    Guo, Cheng
    Choo, Kim-Kwang Raymond
    Liu, Yining
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 207 - 220
  • [23] Towards Privacy-Preserving Federated Deep Learning infrastructure : proof-of-concept
    Zhang, C.
    Choudhury, A.
    Bermejo, I.
    Dekker, A.
    RADIOTHERAPY AND ONCOLOGY, 2022, 170 : S949 - S950
  • [24] The Blockchain-Based Edge Computing Framework for Privacy-Preserving Federated Learning
    Hu, Shili
    Li, Jiangfeng
    Zhang, Chenxi
    Zhao, Qinpei
    Ye, Wei
    2021 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN (BLOCKCHAIN 2021), 2021, : 566 - 571
  • [25] Privacy-Preserving and Reliable Decentralized Federated Learning
    Gao, Yuanyuan
    Zhang, Lei
    Wang, Lulu
    Choo, Kim-Kwang Raymond
    Zhang, Rui
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) : 2879 - 2891
  • [26] Privacy-preserving federated learning on lattice quantization
    Zhang, Lingjie
    Zhang, Hai
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (06)
  • [27] Privacy-Preserving Federated Deep Learning for Cooperative Hierarchical Caching in Fog Computing
    Yu, Zhengxin
    Hu, Jia
    Min, Geyong
    Wang, Zi
    Miao, Wang
    Li, Shancang
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22): : 22246 - 22255
  • [28] Privacy-preserving Heterogeneous Federated Transfer Learning
    Gao, Dashan
    Liu, Yang
    Huang, Anbu
    Ju, Ce
    Yu, Han
    Yang, Qiang
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2552 - 2559
  • [29] A Personalized Privacy-Preserving Scheme for Federated Learning
    Li, Zhenyu
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 1352 - 1356
  • [30] PEPFL: A framework for a practical and ef fi cient privacy-preserving federated learning
    Chen, Yange
    Wang, Baocang
    Jiang, Hang
    Duan, Pu
    Ping, Yuan
    Hong, Zhiyong
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (02) : 355 - 368
12345