Erasure coding for distributed storage: an overview

被引:0
|
作者
S. B. Balaji
M. Nikhil Krishnan
Myna Vajha
Vinayak Ramkumar
Birenjith Sasidharan
P. Vijay Kumar
机构
[1] Indian Institute of Science,Department of Electrical Communication Engineering
[2] University of Southern California,Ming Hsieh Department of Electrical Engineering
来源
关键词
distributed storage; regenerating codes; locally recoverable codes; codes with locality; erasure codes; node repair;
D O I
暂无
中图分类号
学科分类号
摘要
In a distributed storage system, code symbols are dispersed across space in nodes or storage units as opposed to time. In settings such as that of a large data center, an important consideration is the efficient repair of a failed node. Efficient repair calls for erasure codes that in the face of node failure, are efficient in terms of minimizing the amount of repair data transferred over the network, the amount of data accessed at a helper node as well as the number of helper nodes contacted. Coding theory has evolved to handle these challenges by introducing two new classes of erasure codes, namely regenerating codes and locally recoverable codes as well as by coming up with novel ways to repair the ubiquitous Reed-Solomon code. This survey provides an overview of the efforts in this direction that have taken place over the past decade.
引用
下载
收藏
相关论文
共 50 条
  • [1] Erasure coding for distributed storage: an overview
    Balaji, S. B.
    Krishnan, M. Nikhil
    Vajha, Myna
    Ramkumar, Vinayak
    Sasidharan, Birenjith
    Kumar, P. Vijay
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (10)
  • [2] Erasure coding for distributed storage: an overview
    S.B.BALAJI
    M.Nikhil KRISHNAN
    Myna VAJHA
    Vinayak RAMKUMAR
    Birenjith SASIDHARAN
    P.Vijay KUMAR
    Science China(Information Sciences), 2018, 61 (10) : 7 - 51
  • [3] Adaptive erasure resilient coding in distributed storage
    Li, Jin
    2006 IEEE International Conference on Multimedia and Expo - ICME 2006, Vols 1-5, Proceedings, 2006, : 561 - 564
  • [4] On Data Parallelism of Erasure Coding in Distributed Storage Systems
    Li, Jun
    Li, Baochun
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017), 2017, : 45 - 56
  • [5] Demand-Aware Erasure Coding for Distributed Storage Systems
    Li, Jun
    Li, Baochun
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (02) : 532 - 545
  • [6] Sparsity exploiting erasure coding for distributed storage of versioned data
    Harshan, J.
    Oggier, Frederique
    Datta, Anwitaman
    COMPUTING, 2016, 98 (12) : 1305 - 1329
  • [7] Sparsity exploiting erasure coding for distributed storage of versioned data
    J. Harshan
    Frédérique Oggier
    Anwitaman Datta
    Computing, 2016, 98 : 1305 - 1329
  • [8] Composite Extension Finite Fields for Distributed Storage Erasure Coding
    Heide, Janus
    2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
  • [9] Maintenance-Efficient Erasure Coding for Distributed Archival Storage
    Cuong Pham
    Zhang, Feng
    Tran, Duc A.
    2011 20TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN), 2011,
  • [10] Storage vs Repair Bandwidth for Network Erasure Coding in Distributed Storage Systems
    Singal, Swati Mittal
    Rakesh, Nitin
    Matam, Rakesh
    2015 INTERNATIONAL CONFERENCE ON SOFT COMPUTING TECHNIQUES AND IMPLEMENTATIONS (ICSCTI), 2015,