ARES: Adaptive, Reconfigurable, Erasure coded, Atomic Storage

被引:0
|
作者
Nicolaou, Nicolas [1 ]
Cadambe, Viveck [2 ]
Prakash, N. [3 ]
Trigeorgi, Andria [4 ]
Konwar, Kishori [5 ]
Medard, Muriel [5 ]
Lynch, Nancy [5 ]
机构
[1] Algolysis Ltd, Ellados 12A, CY-4630 Erimi, Limassol, Cyprus
[2] Penn State Univ, University Pk, PA 16802 USA
[3] Intel Corp, 5200 NE Elam Young Pkwy, Hillsboro, OR 97124 USA
[4] Univ Cyprus, Kallipoleos 75, CY-1678 Nicosia, Cyprus
[5] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
关键词
Atomicity; distributed storage; reconfiguration; fault-tolerance; erasure-codes; IMPLEMENTATIONS;
D O I
10.1145/3510613
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Emulating a shared atomic, read/write storage system is a fundamental problem in distributed computing. Replicating atomic objects among a set of data hosts was the norm for traditional implementations (e.g., [11]) in order to guarantee the availability and accessibility of the data despite host failures. As replication is highly storage demanding, recent approaches suggested the use of erasure-codes to offer the same fault-tolerance while optimizing storage usage at the hosts. Initial works focused on a fixed set of data hosts. To guarantee longevity and scalability, a storage service should be able to dynamically mask hosts failures by allowing new hosts to join, and failed host to be removed without service interruptions. This work presents the first erasure-code -based atomic algorithm, called Ares, which allows the set of hosts to be modified in the course of an execution. Ares is composed of three main components: (i) a reconfiguration protocol, (ii) a read/write protocol, and (iii) a set of data access primitives (DAPs). The design of Ares is modular and is such to accommodate the usage of various erasure-code parameters on a per-configuration basis. We provide bounds on the latency of read/write operations and analyze the storage and communication costs of the Ares algorithm.
引用
收藏
页数:39
相关论文
共 50 条
  • [1] ARES: Adaptive, Reconfigurable, Erasure coded, atomic Storage
    Nicolaou, Nicolas
    Cadambe, Viveck
    Prakash, N.
    Konwar, Kishori M.
    Medard, Muriel
    Lynch, Nancy
    2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, : 2195 - 2205
  • [2] An erasure coded archival storage system
    Misra, Prateep
    Roy, Nilanjan
    Naskar, Soumitra
    Dey, Swarnava
    PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 720 - 721
  • [3] Adaptive Updates for Erasure-Coded Storage Systems Based on Data Delta and Logging
    Wei, Bing
    Wu, Jigang
    Su, Xiaosong
    Huang, Qiang
    Liu, Yujun
    PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT 2021, 2022, 13148 : 187 - 197
  • [4] An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm
    Wang, Zizhong
    Wang, Haixia
    Shao, Airan
    Wang, Dongsheng
    PROCEEDINGS OF THE 49TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2020, 2020,
  • [5] Adaptive Bandwidth-Efficient Recovery Techniques in Erasure-Coded Cloud Storage
    Nachiappan, Rekha
    Javadi, Bahman
    Calheiros, Rodrigo N.
    Matawie, Kenan M.
    EURO-PAR 2018: PARALLEL PROCESSING, 2018, 11014 : 325 - 338
  • [6] An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm
    Wang, Zizhong
    Wang, Haixia
    Shao, Airan
    Wang, Dongsheng
    2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, : 1177 - 1178
  • [7] Repair Pipelining for Erasure-Coded Storage
    Li, Runhui
    Li, Xiaolu
    Lee, Patrick P. C.
    Huang, Qun
    2017 USENIX ANNUAL TECHNICAL CONFERENCE (USENIX ATC '17), 2017, : 567 - 579
  • [8] Optimistic Erasure-Coded Distributed Storage
    Dutta, Partha
    Guerraoui, Rachid
    Levy, Ron R.
    DISTRIBUTED COMPUTING, PROCEEDINGS, 2008, 5218 : 182 - +
  • [9] SwiftER: Elastic Erasure Coded Storage System
    Datta, Anwitaman
    Cho, Wan Hee
    PROCEEDINGS OF 2016 IEEE 35TH SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2016, : 229 - 238
  • [10] Erasure Coded Storage Systems for Cloud Storage Challenges and Opportunities
    Lee, Ojus Thomas
    Kumar, S. D. Madhu
    Chandran, Priya
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON DATA SCIENCE & ENGINEERING (ICDSE), 2016, : 52 - 58