FS-REAL: A Real-World Cross-Device Federated Learning Platform

被引:2
|
作者
Gao, Dawei [1 ]
Chen, Daoyuan [1 ]
Li, Zitao [1 ]
Xie, Yuexiang [1 ]
Pan, Xuchen [1 ]
Li, Yaliang [1 ]
Ding, Bolin [1 ]
Zhou, Jingren [1 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
关键词
D O I
10.14778/3611540.3611617
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a general distributed machine learning paradigm that provides solutions for tasks where data cannot be shared directly. Due to the difficulties in communication management and heterogeneity of distributed data and devices, initiating and using an FL algorithm for real-world cross-device scenarios requires significant repetitive effort but may not be transferable to similar projects. To reduce the effort required for developing and deploying FL algorithms, we present FS-REAL., an open-source FL platform designed to address the need of a general and efficient infrastructure for real-world cross-device FL. In this paper, we introduce the key components of FS-REAL. and demonstrate that FS-REAL has the following capabilities: 1) reducing the programming burden of FL algorithm development with plug-and-play and adaptable runtimes on Android and other Internet of Things (IoT) devices; 2) handling a large number of heterogeneous devices efficiently and robustly with our communication management components; 3) supporting a wide range of advanced FL algorithms with flexible configuration and extension; 4) alleviating the costs and efforts for deployment, evaluation, simulation, and performance optimization of FL algorithms with automatized tool kits.
引用
收藏
页码:4046 / 4049
页数:4
相关论文
共 50 条
  • [1] FS-REAL: Towards Real-World Cross-Device Federated Learning
    Chen, Daoyuan
    Gao, Dawei
    Xie, Yuexiang
    Pan, Xuchen
    Li, Zitao
    Li, Yaliang
    Ding, Bolin
    Zhou, Jingren
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 3829 - 3841
  • [2] Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
    Xu, Xiaoqian
    Wei, Pengxu
    Chen, Weikai
    Liu, Yang
    Mao, Mingzhi
    Lin, Liang
    Li, Guanbin
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5657 - 5666
  • [3] FairFed: Cross-Device Fair Federated Learning
    Rehman, Muhammad Habib Ur
    Dirir, Ahmed Mukhtar
    Salah, Khaled
    Svetinovic, Davor
    [J]. 2020 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR): TRUSTED COMPUTING, PRIVACY, AND SECURING MULTIMEDIA, 2020,
  • [4] A global federated real-world data and analytics platform for research
    Palchuk, Matvey B.
    London, Jack W.
    Perez-Rey, David
    Drebert, Zuzanna J.
    Winer-Jones, Jessamine P.
    Thompson, Courtney N.
    Esposito, John
    Claerhout, Brecht
    [J]. JAMIA OPEN, 2023, 6 (02)
  • [5] Breaking the centralized barrier for cross-device federated learning
    Karimireddy, Sai Praneeth
    Jaggi, Martin
    Kale, Satyen
    Mohri, Mehryar
    Reddi, Sashank J.
    Stich, Sebastian U.
    Suresh, Ananda Theertha
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] Federated Learning for Breast Density Classification: A Real-World Implementation
    Roth, Holger R.
    Chang, Ken
    Singh, Praveer
    Neumark, Nir
    Li, Wenqi
    Gupta, Vikash
    Gupta, Sharut
    Qu, Liangqiong
    Ihsani, Alvin
    Bizzo, Bernardo C.
    Wen, Yuhong
    Buch, Varun
    Shah, Meesam
    Kitamura, Felipe
    Mendonca, Matheus
    Lavor, Vitor
    Harouni, Ahmed
    Compas, Colin
    Tetreault, Jesse
    Dogra, Prerna
    Cheng, Yan
    Erdal, Selnur
    White, Richard
    Hashemian, Behrooz
    Schultz, Thomas
    Zhang, Miao
    McCarthy, Adam
    Yun, B. Min
    Sharaf, Elshaimaa
    Hoebel, Katharina V.
    Patel, Jay B.
    Chen, Bryan
    Ko, Sean
    Leibovitz, Evan
    Pisano, Etta D.
    Coombs, Laura
    Xu, Daguang
    Dreyer, Keith J.
    Dayan, Ittai
    Naidu, Ram C.
    Flores, Mona
    Rubin, Daniel
    Kalpathy-Cramer, Jayashree
    [J]. DOMAIN ADAPTATION AND REPRESENTATION TRANSFER, AND DISTRIBUTED AND COLLABORATIVE LEARNING, DART 2020, DCL 2020, 2020, 12444 : 181 - 191
  • [7] VERSA: Verifiable Secure Aggregation for Cross-Device Federated Learning
    Hahn, Changhee
    Kim, Hodong
    Kim, Minjae
    Hur, Junbeom
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (01) : 36 - 52
  • [8] Scaling Language Model Size in Cross-Device Federated Learning
    Ro, Jae Hun
    Breiner, Theresa
    McConnaughey, Lara
    Chen, Mingqing
    Suresh, Ananda Theertha
    Kumar, Shankar
    Mathews, Rajiv
    [J]. PROCEEDINGS OF THE FIRST WORKSHOP ON FEDERATED LEARNING FOR NATURAL LANGUAGE PROCESSING (FL4NLP 2022), 2022, : 6 - 20
  • [9] Empirical Evaluation of Federated Learning with Local Privacy for Real-World Application
    Li, Paul Luo
    Chai, Xiaoyu
    Wadsworth, W. Duncan
    Liao, Jilong
    Paddock, Brandon
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 1574 - 1583
  • [10] FEDLEGAL: The First Real-World Federated Learning Benchmark for Legal NLP
    Zhang, Zhuo
    Hu, Xiangjing
    Zhang, Jingyuan
    Zhang, Yating
    Wang, Hui
    Qu, Lizhen
    Xu, Zenglin
    [J]. PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 3492 - 3507