MDS Code Constructions With Small Sub-Packetization and Near-Optimal Repair Bandwidth

被引:32
|
作者
Rawat, Ankit Singh [1 ]
Tamo, Itzhak [2 ]
Guruswami, Venkatesan [3 ]
Efremenko, Klim [4 ]
机构
[1] MIT, Res Lab Elect, Cambridge, MA 02139 USA
[2] Tel Aviv Univ, Dept Elect Engn Syst, IL-69978 Ramat Aviv, Israel
[3] Carnegie Mellon Univ, Comp Sci Dept, Pittsburgh, PA 15213 USA
[4] Ben Gurion Univ Negev, Dept Comp Sci, IL-84105 Beer Sheva, Israel
关键词
Codes for distributed storage; regenerating codes; sub-packetization level; repair bandwidth; cut-set bound; DISTRIBUTED STORAGE;
D O I
10.1109/TIT.2018.2810095
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper addresses the problem of constructing maximum distance separable (MDS) codes that enable exact reconstruction (repair) of each code block by downloading a small amount of information from the remaining code blocks. The total amount of information flow from the remaining code blocks during this reconstruction process is referred to as repair bandwidth of the underlying code. Existing constructions of exact-repairable MDS codes with optimal repair bandwidth require working with large subpacketization levels, which restrict their applicability in practice. This paper presents two general approaches to construct exact-repairable MDS codes that aim at significantly reducing the required subpacketization level at the cost of slightly suboptimal repair bandwidth. The first approach provides MDS codes that have repair bandwidth at most twice the optimal repair bandwidth. In addition, these codes also have the smallest possible subpacketization level O(r), where r denotes the number of parity blocks. This approach is then generalized to design codes that have their repair bandwidth approaching the optimal repair bandwidth at the cost of graceful increment in the required subpacketization level. The second approach transforms an MDS code with optimal repair bandwidth and large subpacketization level into a longer MDS code with small subpacketization level and near-optimal repair bandwidth. For a given r, the codes constructed using this approach have their subpacketization level scaling logarithmically with the code length. In addition, the obtained codes require field size only linear in the code length and ensure load balancing among the intact code blocks in terms of the information downloaded from these blocks during the exact reconstruction of a code block.
引用
收藏
页码:6506 / 6525
页数:20
相关论文
共 50 条
  • [21] Minimum Storage Rack-Aware Regenerating Codes with Exact Repair and Small Sub-Packetization
    Hou, Hanxu
    Lee, Patrick P. C.
    Han, Yunghsiang S.
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 554 - 559
  • [22] Building Capacity-Achieving PIR Schemes with Optimal Sub-Packetization over Small Fields
    Xu, Jingke
    Zhang, Zhifang
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 1749 - 1753
  • [23] Constructions of Binary MDS Array Codes With Optimal Repair/Access Bandwidth
    Li, Lei
    Yu, Xinchun
    Chen, Liang
    Dong, Yuanyuan
    Luo, Yuan
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (06) : 3113 - 3125
  • [24] Minimum Storage Partially Cooperative Regenerating Codes With Small Sub-Packetization
    Liu, Yajuan
    Wang, Yanyan
    Cai, Han
    Tang, Xiaohu
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (01) : 38 - 49
  • [25] ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage
    Li, Xiaolu
    Cheng, Keyun
    Tang, Kaicheng
    Lee, Patrick P. C.
    Hu, Yuchong
    Feng, Dan
    Li, Jie
    Wu, Ting-Yi
    PROCEEDINGS OF THE 21ST USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 2023, 2023, : 17 - 31
  • [26] Explicit constructions of MDS array codes and RS codes with optimal repair bandwidth
    Ye, Min
    Barg, Alexander
    2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 1202 - 1206
  • [27] Explicit Constructions of High-Rate MDS Array Codes With Optimal Repair Bandwidth
    Ye, Min
    Barg, Alexander
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (04) : 2001 - 2014
  • [28] The Optimal Sub-Packetization of Linear Capacity-Achieving PIR Schemes With Colluding Servers
    Zhang, Zhifang
    Xu, Jingke
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (05) : 2723 - 2735
  • [29] MDS Array Codes With (Near) Optimal Repair Bandwidth for All Admissible Repair Degrees
    Li, Jie
    Liu, Yi
    Tang, Xiaohu
    Han, Yunghsiang S.
    Bai, Bo
    Zhang, Gong
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (10) : 5633 - 5646
  • [30] Constructions of Batch Codes with Near-Optimal Redundancy
    Vardy, Alexander
    Yaakobi, Eitan
    2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 1197 - 1201