Brief Announcement: Byzantine-Tolerant Machine Learning

被引：2
|
作者：
Blanchard, Peva [1 ]
El Mhamdi, El Mahdi [1 ]
Guerraoui, Rachid [1 ]
Stainer, Julien [1 ]
机构：
[1] Swiss Fed Inst Technol, Lausanne, Switzerland
来源：
PROCEEDINGS OF THE ACM SYMPOSIUM ON PRINCIPLES OF DISTRIBUTED COMPUTING (PODC'17) | 2017年
基金：
瑞士国家科学基金会;
关键词：
Distributed Stochastic Gradient Descent; Adversarial Machine Learning;
D O I：
10.1145/3087801.3087861
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We report on Krum, the first provably Byzantine-tolerant aggregation rule for distributed Stochastic Gradient Descent (SGD). Krum guarantees the convergence of SGD even in a distributed setting where (asymptotically) up to half of the workers can be malicious adversaries trying to attack the learning system.
引用
收藏
页码：455 / 457
页数：3
相关论文
共 50 条
  • [1] Brief Announcement: Certified Impossibility Results for Byzantine-Tolerant Mobile Robots
    Auger, Cedric
    Bouzid, Zohir
    Courtieu, Pierre
    Tixeuil, Sebastien
    Urbain, Xavier
    DISTRIBUTED COMPUTING, 2013, 8205 : 575 - 576
  • [2] Bounded Delay in Byzantine-Tolerant State Machine Replication
    Milosevic, Zarko
    Biely, Martin
    Schiper, Andre
    2013 IEEE 32ND INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS 2013), 2013, : 61 - 70
  • [3] Brief Announcement: Optimal Self-stabilizing Mobile Byzantine-Tolerant Regular Register with Bounded Timestamps
    Bonomi, Silvia
    Del Pozzo, Antonella
    Potop-Butucaru, Maria
    Tixeuil, Sebastien
    STABILIZATION, SAFETY, AND SECURITY OF DISTRIBUTED SYSTEMS, SSS 2018, 2018, 11201 : 398 - 403
  • [4] Byzantine-tolerant causal broadcast
    Auvolat, Alex
    Frey, Davide
    Raynal, Michel
    Taiani, Francois
    THEORETICAL COMPUTER SCIENCE, 2021, 885 : 55 - 68
  • [5] Byzantine-Tolerant Distributed Coordinate Descent
    Data, Deepesh
    Diggavi, Suhas
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 2724 - 2728
  • [6] Self-stabilizing Byzantine-Tolerant Distributed Replicated State Machine
    Binun, Alexander
    Coupaye, Thierry
    Dolev, Shlomi
    Kassi-Lahlou, Mohammed
    Lacoste, Marc
    Palesandro, Alex
    Yagel, Reuven
    Yankulin, Leonid
    STABILIZATION, SAFETY, AND SECURITY OF DISTRIBUTED SYSTEMS, SSS 2016, 2016, 10083 : 36 - 53
  • [7] An Analysis of Byzantine-Tolerant Aggregation Mechanisms on Model Poisoning in Federated Learning
    Roszel, Mary
    Norvill, Robert
    State, Radu
    MODELING DECISIONS FOR ARTIFICIAL INTELLIGENCE, MDAI 2022, 2022, 13408 : 143 - 155
  • [8] Byzantine-Tolerant Methods for Distributed Variational Inequalities
    Tupitsa, Nazarii
    Almansoori, Abdulla Jasem
    Wu, Yanlin
    Takac, Martin
    Nandakumar, Karthik
    Horvath, Samuel
    Gorbunov, Eduard
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Byzantine-Tolerant Causal Ordering for Unicasts, Multicasts, and Broadcasts
    Misra, Anshuman
    Kshemkalyani, Ajay D.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (05) : 814 - 828
  • [10] Certified Impossibility Results for Byzantine-Tolerant Mobile Robots
    Auger, Cedric
    Bouzid, Zohir
    Courtieu, Pierre
    Tixeuil, Sebastien
    Urbain, Xavier
    STABILIZATION, SAFETY, AND SECURITY OF DISTRIBUTED SYSTEMS, SSS 2013, 2013, 8255 : 178 - 190
12345