A New Minimize Matrix Computation Coding Method for Distributed Storage Systems

被引:0
|
作者
Yin, Chao [1 ]
Lv, Haitao [1 ]
Li, Tongfang [1 ]
Qu, Xiaoping [1 ]
Wang, Jianzong [2 ]
Gao, Guangyong [3 ]
机构
[1] Jiujiang Univ, Dept Informat Sci & Technol, Jiujiang, Peoples R China
[2] Ping An Technol Shenzhen Co Ltd, Dept Fed Learning Technol, Shenzhen, Guangdong, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Dept Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
CODES;
D O I
10.1155/2019/4163780
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the number of nodes increasing in scale, the requirements of storage space enlarge sharply in distributed storage systems. Failure-tolerance schemes such as Reed-Solomon codes (RS codes in short) and Cauchy Reed-Solomon codes (CRS codes in short) are used to save storage space. However, these failure-tolerance schemes severely degrade the system performance. In this paper, we propose optimal RS codes (OptRS codes in short) based on RS codes and CRS codes that can offer better performance for encoding and decoding as well as maximizing the utilization of storage space. OptRS codes can speed up the matrix computation which is regarded as the most important factor to impact the efficiency of coding by transferring the matrix computation from the Galois field mapping to the XOR operation. OptRS codes employ an algorithm called row elimination scheme (RE scheme in short), which can eliminate the same XOR operation to minimize the number of XOR operations. We analyze optimal matrices (OM in short) in theory, which prove the optimal performance of OptRS codes over the Galois field. Our method is implemented on the top of the distributed storage system, and code parameters were carefully chosen. The test result shows that OptRS codes can improve the performance in different data block numbers, parity block numbers, block size, normal reading, and degraded reading, compared with RS codes and CRS codes.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] COMMUNICATION SYSTEMS WHICH MINIMIZE CODING NOISE
    MCMILLAN, B
    BELL SYSTEM TECHNICAL JOURNAL, 1969, 48 (09): : 3091 - +
  • [32] Exploiting Matrix Dependency for Efficient Distributed Matrix Computation
    Yu, Lele
    Shao, Yingxia
    Cui, Bin
    SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 93 - 105
  • [33] Optimal allocation of distributed energy storage systems to enhance voltage stability and minimize total cost
    Hany, Ramy Mohamed
    Mahmoud, Tarek
    Osman, El Said Abd El Aziz
    Abd El Rehim, Abo El Fotouh
    Seoudy, Hatem M.
    PLOS ONE, 2024, 19 (01):
  • [34] Combined source/channel coding and a new coding scheme for data storage systems
    Lee, J
    IEEE TRANSACTIONS ON MAGNETICS, 1999, 35 (05) : 4372 - 4377
  • [35] Erasure coding for distributed storage: an overview
    S.B.BALAJI
    M.Nikhil KRISHNAN
    Myna VAJHA
    Vinayak RAMKUMAR
    Birenjith SASIDHARAN
    P.Vijay KUMAR
    Science China(Information Sciences), 2018, 61 (10) : 7 - 51
  • [36] Special focus on distributed storage coding
    Tang, Xiaohu
    Xia, Shu-Tao
    Tian, Chao
    Huang, Qin
    Xia, Xiang-Gen
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (10)
  • [37] Special focus on distributed storage coding
    Xiaohu TANG
    Shu-Tao XIA
    Chao TIAN
    Qin HUANG
    Xiang-Gen XIA
    Science China(Information Sciences), 2018, 61 (10) : 5 - 6
  • [38] Special focus on distributed storage coding
    Xiaohu Tang
    Shu-Tao Xia
    Chao Tian
    Qin Huang
    Xiang-Gen Xia
    Science China Information Sciences, 2018, 61
  • [39] Erasure coding for distributed storage: an overview
    S. B. Balaji
    M. Nikhil Krishnan
    Myna Vajha
    Vinayak Ramkumar
    Birenjith Sasidharan
    P. Vijay Kumar
    Science China Information Sciences, 2018, 61
  • [40] Erasure coding for distributed storage: an overview
    Balaji, S. B.
    Krishnan, M. Nikhil
    Vajha, Myna
    Ramkumar, Vinayak
    Sasidharan, Birenjith
    Kumar, P. Vijay
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (10)