Brief Announcement: Byzantine-Tolerant Machine Learning

被引:2
|
作者
Blanchard, Peva [1 ]
El Mhamdi, El Mahdi [1 ]
Guerraoui, Rachid [1 ]
Stainer, Julien [1 ]
机构
[1] Swiss Fed Inst Technol, Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
Distributed Stochastic Gradient Descent; Adversarial Machine Learning;
D O I
10.1145/3087801.3087861
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We report on Krum, the first provably Byzantine-tolerant aggregation rule for distributed Stochastic Gradient Descent (SGD). Krum guarantees the convergence of SGD even in a distributed setting where (asymptotically) up to half of the workers can be malicious adversaries trying to attack the learning system.
引用
收藏
页码:455 / 457
页数:3
相关论文
共 50 条
  • [21] Enhancing efficiency of Byzantine-tolerant coordination protocols via hash functions
    Tulone, D
    EURO-PAR 2004 PARALLEL PROCESSING, PROCEEDINGS, 2004, 3149 : 587 - 595
  • [22] Byzantine-Tolerant Gathering of Mobile Agents in Arbitrary Networks with Authenticated Whiteboards
    Tsuchida, Masashi
    Ooshita, Fukuhito
    Inoue, Michiko
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (03): : 602 - 610
  • [23] Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent
    Blanchard, Peva
    El Mhamdi, El Mandi
    Guerraoui, Rachid
    Stainer, Julien
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [24] Brief Announcement: Byzantine Agreement with Homonyms
    Delporte-Gallet, Carole
    Fauconnier, Hugues
    Guerraoui, Rachid
    Kermarrec, Anne-Marie
    SPAA '10: PROCEEDINGS OF THE TWENTY-SECOND ANNUAL SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES, 2010, : 74 - 75
  • [25] Brief Announcement: Leaderless Byzantine Paxos
    Lamport, Leslie
    DISTRIBUTED COMPUTING, 2011, 6950 : 141 - 142
  • [26] Brief Announcement: Coded State Machine - Scaling State Machine Execution under Byzantine Faults
    Li, Songze
    Sahraei, Saeid
    Yu, Mingchao
    Avestimehr, Salman
    Kannan, Sreeram
    Viswanath, Pramod
    PROCEEDINGS OF THE 2019 ACM SYMPOSIUM ON PRINCIPLES OF DISTRIBUTED COMPUTING (PODC '19), 2019, : 150 - 152
  • [27] Byzantine-Tolerant Inference in Distributed Deep Intelligent System: Challenges and Opportunities
    Choi, Jinhang
    Hakimi, Zeinab
    Narayanan, Vijaykrishnan
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (03) : 509 - 519
  • [28] Governance and Regulations Implications on Machine Learning (Brief Announcement)
    Nadler, Sima
    Raz, Orna
    Zalmanovici, Marcel
    CYBER SECURITY CRYPTOGRAPHY AND MACHINE LEARNING, CSCML 2019, 2019, 11527 : 208 - 211
  • [29] Byzantine-Tolerant Gathering of Mobile Agents in Asynchronous Arbitrary Networks with Authenticated Whiteboards
    Tsuchida, Masashi
    Ooshita, Fukuhito
    Inoue, Michiko
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (07) : 1672 - 1682
  • [30] Pando: Efficient Byzantine-Tolerant Distributed Sensor Fusion using Forest Ensembles
    Behrens, Hans Walter
    Candan, K. Selcuk
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,