General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System

被引:3
|
作者
Liu, Qing [1 ]
Feng, Dan [1 ]
Shi, Zhan [1 ]
Fu, Min [1 ]
机构
[1] HUST, Sch Comp, Wuhan Natl Lab Optoelect, Wuhan, Peoples R China
关键词
Regenerating codes; Storage system; Uncoded repair; Repair bandwidth; Performance and evaluation;
D O I
10.1109/CCGrid.2015.38
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Erasure codes are widely used in modern distributed storage systems to prevent data loss and server failures. Regenerating codes are a class of erasure codes that trades storage efficiency and computation for repair bandwidth reduction. However, their non-unified coding parameters and huge computation overhead prohibit their applications. Hence, we first propose a family of Functional Regenerating Codes (FRCs) with uncoded repair, balancing storage efficiency and repair bandwidth with general parameters. FRCs take advantage of a heuristic repair algorithm, which makes efforts to employ as little repair bandwidth as possible. Second, we optimize encoding by constructing the generator matrix with a bitmatrix, so encoding of FRCs can be executed by fast bitwise XORs. Further, we also optimize repairing with the Scheduled Shift Multiplication (SSM) algorithm, which accelerates the matrix product over the Galois field during repair. Compared to the traditional table-lookup multiplication algorithm, our SSM algorithm gains 1.2 similar to 2X speed-up.
引用
收藏
页码:372 / 381
页数:10
相关论文
共 50 条
  • [1] Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    2013 PROCEEDINGS IEEE INFOCOM, 2013, : 2355 - 2363
  • [2] Proxy-Assisted Regenerating Codes With Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    Zhou, Pan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (04) : 2512 - 2528
  • [3] Heterogeneity-Aware Codes With Uncoded Repair for Distributed Storage Systems
    Zhu, Bing
    Shum, Kenneth W.
    Li, Hui
    IEEE COMMUNICATIONS LETTERS, 2015, 19 (06) : 901 - 904
  • [4] Cooperative Repair with Minimum-Storage Regenerating Codes for Distributed Storage
    Li, Jun
    Li, Baochun
    2014 PROCEEDINGS IEEE INFOCOM, 2014, : 316 - 324
  • [5] Reducing Repair Traffic with Exact and Uncoded Repair in Distributed Storage Systems: Intersecting Zigzag Sets Codes on Hierarchical Codes
    You, Pengfei
    Huang, Zhen
    Wang, Changjian
    Peng, Yuxing
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE), 2014, : 722 - 728
  • [6] Repair Bandwidth Cost of Generalized Regenerating Codes for Clustered Distributed Storage
    Li, Ke
    Gu, Shushi
    Wang, Ye
    Zhang, Qinyu
    Xiang, Wei
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [7] A New Repair Strategy for the Hadamard Minimum Storage Regenerating Codes for Distributed Storage Systems
    Tang, Xiaohu
    Yang, Bin
    Li, Jie
    Hollmann, Henk D. L.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (10) : 5271 - 5279
  • [8] Regenerating Codes for Distributed Storage Networks
    Shah, Nihar B.
    Rashmi, K. V.
    Kumar, P. Vijay
    Ramchandran, Kannan
    ARITHMETIC OF FINITE FIELDS, PROCEEDINGS, 2010, 6087 : 215 - +
  • [9] Exact Cooperative Regenerating Codes with Minimum-Repair-Bandwidth for Distributed Storage
    Wang, Anyu
    Zhang, Zhifang
    2013 PROCEEDINGS IEEE INFOCOM, 2013, : 400 - 404
  • [10] Minimum Storage Regenerating Codes for Scalable Distributed Storage
    Zhang, Huayu
    Li, Hui
    Zhu, Bing
    Yang, Xin
    Li, Shuo-Yen Robert
    IEEE ACCESS, 2017, 5 : 7149 - 7155