A New Minimize Matrix Computation Coding Method for Distributed Storage Systems

被引:0
|
作者
Yin, Chao [1 ]
Lv, Haitao [1 ]
Li, Tongfang [1 ]
Qu, Xiaoping [1 ]
Wang, Jianzong [2 ]
Gao, Guangyong [3 ]
机构
[1] Jiujiang Univ, Dept Informat Sci & Technol, Jiujiang, Peoples R China
[2] Ping An Technol Shenzhen Co Ltd, Dept Fed Learning Technol, Shenzhen, Guangdong, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Dept Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
CODES;
D O I
10.1155/2019/4163780
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the number of nodes increasing in scale, the requirements of storage space enlarge sharply in distributed storage systems. Failure-tolerance schemes such as Reed-Solomon codes (RS codes in short) and Cauchy Reed-Solomon codes (CRS codes in short) are used to save storage space. However, these failure-tolerance schemes severely degrade the system performance. In this paper, we propose optimal RS codes (OptRS codes in short) based on RS codes and CRS codes that can offer better performance for encoding and decoding as well as maximizing the utilization of storage space. OptRS codes can speed up the matrix computation which is regarded as the most important factor to impact the efficiency of coding by transferring the matrix computation from the Galois field mapping to the XOR operation. OptRS codes employ an algorithm called row elimination scheme (RE scheme in short), which can eliminate the same XOR operation to minimize the number of XOR operations. We analyze optimal matrices (OM in short) in theory, which prove the optimal performance of OptRS codes over the Galois field. Our method is implemented on the top of the distributed storage system, and code parameters were carefully chosen. The test result shows that OptRS codes can improve the performance in different data block numbers, parity block numbers, block size, normal reading, and degraded reading, compared with RS codes and CRS codes.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A New Adaptive Coding Selection Method for Distributed Storage Systems
    Wei, Bing
    Xiao, Li-Min
    Wei, Wei
    Song, Yao
    Zhou, Bing-Yu
    IEEE ACCESS, 2018, 6 : 13350 - 13357
  • [2] Graftage Coding for Distributed Storage Systems
    Rui, Jiayi
    Huang, Qin
    Wang, Zulin
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (04) : 2192 - 2205
  • [3] Network coding for distributed storage systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wainwright, Martin J.
    Ramchandran, Kannan
    INFOCOM 2007, VOLS 1-5, 2007, : 2000 - +
  • [4] Graftage Coding for Distributed Storage Systems
    Huang, Qin
    Rui, Jiayi
    Song, Liyuan
    Wang, Zulin
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [5] Network Coding for Distributed Storage Systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wu, Yunnan
    Wainwright, Martin J.
    Ramchandran, Kannan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) : 4539 - 4551
  • [6] CodedSketch: A Coding Scheme for Distributed Computation of Approximated Matrix Multiplication
    Jahani-Nezhad, Tayyebeh
    Maddah-Ali, Mohammad Ali
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (06) : 4185 - 4196
  • [7] On Data Parallelism of Erasure Coding in Distributed Storage Systems
    Li, Jun
    Li, Baochun
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017), 2017, : 45 - 56
  • [8] Coding Techniques for Repairability in Networked Distributed Storage Systems
    Oggier, Frederique
    Datta, Anwitaman
    FOUNDATIONS AND TRENDS IN COMMUNICATIONS AND INFORMATION THEORY, 2012, 9 (04): : 383 - 466
  • [9] Efficient Random Network Coding for Distributed Storage Systems
    Visegradi, Adam
    Kacsuk, Peter
    EURO-PAR 2013: PARALLEL PROCESSING WORKSHOPS, 2014, 8374 : 385 - 394
  • [10] Anytime Coding for Distributed Computation
    Ferdinand, Nuwan S.
    Draper, Stark C.
    2016 54TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2016, : 954 - 960