General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System

被引:3
|
作者
Liu, Qing [1 ]
Feng, Dan [1 ]
Shi, Zhan [1 ]
Fu, Min [1 ]
机构
[1] HUST, Sch Comp, Wuhan Natl Lab Optoelect, Wuhan, Peoples R China
关键词
Regenerating codes; Storage system; Uncoded repair; Repair bandwidth; Performance and evaluation;
D O I
10.1109/CCGrid.2015.38
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Erasure codes are widely used in modern distributed storage systems to prevent data loss and server failures. Regenerating codes are a class of erasure codes that trades storage efficiency and computation for repair bandwidth reduction. However, their non-unified coding parameters and huge computation overhead prohibit their applications. Hence, we first propose a family of Functional Regenerating Codes (FRCs) with uncoded repair, balancing storage efficiency and repair bandwidth with general parameters. FRCs take advantage of a heuristic repair algorithm, which makes efforts to employ as little repair bandwidth as possible. Second, we optimize encoding by constructing the generator matrix with a bitmatrix, so encoding of FRCs can be executed by fast bitwise XORs. Further, we also optimize repairing with the Scheduled Shift Multiplication (SSM) algorithm, which accelerates the matrix product over the Galois field during repair. Compared to the traditional table-lookup multiplication algorithm, our SSM algorithm gains 1.2 similar to 2X speed-up.
引用
收藏
页码:372 / 381
页数:10
相关论文
共 50 条
  • [31] Explicit Construction of Optimal Exact Regenerating Codes for Distributed Storage
    Rashmi, K. V.
    Shah, Nihar B.
    Kumar, P. Vijay
    Ramchandran, Kannan
    2009 47TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1 AND 2, 2009, : 1243 - +
  • [32] Exact Regenerating Codes for Byzantine Fault Tolerance in Distributed Storage
    Han, Yunghsiang S.
    Zheng, Rong
    Mow, Wai Ho
    2012 PROCEEDINGS IEEE INFOCOM, 2012, : 2498 - 2506
  • [33] Securing distributed storage systems based on arbitrary regenerating codes
    Kurihara, Jun
    Miyake, Yutaka
    IEICE COMMUNICATIONS EXPRESS, 2013, 2 (10): : 442 - 446
  • [34] An Improvement of Quasi-cyclic Minimum Storage Regenerating Codes for Distributed Storage
    Li, Chenhui
    Liang, Songtao
    2014 16TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2014, : 1103 - 1107
  • [35] Practical Functional Regenerating Codes for Broadcast Repair of Multiple Nodes
    Mital, Nitish
    Kralevska, Katina
    Ling, Cong
    Gunduz, Deniz
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 221 - 225
  • [36] Ustor: Cloud storage system based on regenerating codes
    Liu, Qing
    Feng, Dan
    Li, Bai
    Tongxin Xuebao/Journal on Communications, 2014, 35 (04): : 166 - 173
  • [37] A Group Repair Codes with Low Recovery-overhead in Distributed Storage System
    Deng, Wenjie
    Li, Cong
    Hong, Tieyuan
    Tang, Dan
    International Journal of Network Security, 2024, 26 (04) : 610 - 621
  • [38] Centralized Multi-Node Repair for Minimum Storage Regenerating Codes
    Zorgui, Marwen
    Wang, Zhiying
    2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017, : 2213 - 2217
  • [39] On Block Security of Regenerating Codes at the MBR Point for Distributed Storage Systems
    Dau, Son Hoang
    Song, Wentu
    Yuen, Chau
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1967 - 1971
  • [40] Interference Alignment in Regenerating Codes for Distributed Storage: Necessity and Code Constructions
    Shah, Nihar B.
    Rashmi, K. V.
    Kumar, P. Vijay
    Ramchandran, Kannan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2012, 58 (04) : 2134 - 2158