Taming the Contention in Consensus-Based Distributed Systems

被引:0
|
作者
Arun, Balaji [1 ]
Peluso, Sebastiano [2 ]
Palmieri, Roberto [3 ]
Losa, Giuliano [4 ]
Ravindran, Binoy [1 ]
机构
[1] Virginia Tech, Bradley Dept Elect & Comp Engn, Blacksburg, VA 24061 USA
[2] Facebook Inc, Seattle, WA 98109 USA
[3] Lehigh Univ, Bethlehem, PA 18015 USA
[4] Galois Inc, Portland, OR 97204 USA
基金
美国国家科学基金会;
关键词
Consensus protocol; Delays; Computer crashes; Switches; Runtime; Fault tolerance; Distributed systems; fault tolerance; consensus; leaderless consensus; contention-agnostic consensus;
D O I
10.1109/TDSC.2020.2970186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Contention plays a crucial role in the design of consensus protocols. State-of-the-art solutions optimize their performance for either very low or high contention situations. We propose Caesar, a novel multi-leader Generalized Consensus protocol, most suitable for geographical replication, that is optimized for low-to-moderate contention. With an evaluation study, we show that Caesar outperforms other multi-leader (e.g., EPaxos) and single-leader (e.g., Multi-Paxos) competitors by up to 1.7x and 3.5x, respectively, in the presence of 30 percent conflicting requests, in a geo-replicated setting. Furthermore, we acknowledge that there is no one-size-fits- all consensus solution, especially for all levels of contentious workloads. Thus, we also propose Spectrum, a consensus framework that is able to switch consensus protocols at runtime to enable a dynamic reaction to changes in the workload and deployment characteristics. We show empirically that Spectrum can guarantee high availability even during periods of transition between consensus protocols.
引用
收藏
页码:2907 / 2925
页数:19
相关论文
共 50 条
  • [1] Consensus-based Data Statistics in Distributed Network Systems
    Cai, Yifan
    He, Jianping
    Yu, Wenbin
    Guan, Xinping
    [J]. 2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 4206 - 4211
  • [2] Consensus-based evaluation framework for distributed information retrieval systems
    Jung, Jason J.
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2009, 18 (02) : 199 - 211
  • [3] Consensus-based evaluation framework for distributed information retrieval systems
    Jason J. Jung
    [J]. Knowledge and Information Systems, 2009, 18 : 199 - 211
  • [4] Consensus-based distributed algorithm for GEP
    Lv, Kexin
    He, Fan
    Huang, Xiaolin
    Yang, Jie
    [J]. SIGNAL PROCESSING, 2024, 216
  • [5] Consensus-Based Distributed Linear Filtering
    Matei, Ion
    Baras, John S.
    [J]. 49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 7009 - 7014
  • [6] Consensus-based linear distributed filtering
    Matei, Ion
    Baras, John S.
    [J]. AUTOMATICA, 2012, 48 (08) : 1776 - 1782
  • [7] CONSENSUS-BASED DISTRIBUTED CLUSTERING FOR IOT
    Chen, Hui
    Yu, Hao
    Zhao, Shengjie
    Shi, Qingjiang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8324 - 8328
  • [8] A Consensus-Based Approach to the Distributed Learning
    Czarnowski, Ireneusz
    Jedrzejowicz, Piotr
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2011, : 936 - 941
  • [9] Consensus-based algorithms for distributed filtering
    Battistelli, Giorgio
    Chisci, Luigi
    Mugnai, Giovanni
    Farina, Alfonso
    Graziano, Antonio
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 794 - 799
  • [10] Consensus-Based Distributed Economic Dispatch Control Method in Power Systems
    Li, Qiao
    Gao, David Wenzhong
    Zhang, Huaguang
    Wu, Ziping
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (01) : 941 - 954