A New Minimize Matrix Computation Coding Method for Distributed Storage Systems

被引:0
|
作者
Yin, Chao [1 ]
Lv, Haitao [1 ]
Li, Tongfang [1 ]
Qu, Xiaoping [1 ]
Wang, Jianzong [2 ]
Gao, Guangyong [3 ]
机构
[1] Jiujiang Univ, Dept Informat Sci & Technol, Jiujiang, Peoples R China
[2] Ping An Technol Shenzhen Co Ltd, Dept Fed Learning Technol, Shenzhen, Guangdong, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Dept Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
CODES;
D O I
10.1155/2019/4163780
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the number of nodes increasing in scale, the requirements of storage space enlarge sharply in distributed storage systems. Failure-tolerance schemes such as Reed-Solomon codes (RS codes in short) and Cauchy Reed-Solomon codes (CRS codes in short) are used to save storage space. However, these failure-tolerance schemes severely degrade the system performance. In this paper, we propose optimal RS codes (OptRS codes in short) based on RS codes and CRS codes that can offer better performance for encoding and decoding as well as maximizing the utilization of storage space. OptRS codes can speed up the matrix computation which is regarded as the most important factor to impact the efficiency of coding by transferring the matrix computation from the Galois field mapping to the XOR operation. OptRS codes employ an algorithm called row elimination scheme (RE scheme in short), which can eliminate the same XOR operation to minimize the number of XOR operations. We analyze optimal matrices (OM in short) in theory, which prove the optimal performance of OptRS codes over the Galois field. Our method is implemented on the top of the distributed storage system, and code parameters were carefully chosen. The test result shows that OptRS codes can improve the performance in different data block numbers, parity block numbers, block size, normal reading, and degraded reading, compared with RS codes and CRS codes.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Unequal Failure Protection Coding Technique for Distributed Cloud Storage Systems
    Hu, Yupeng
    Liu, Yonghe
    Li, Wenjia
    Li, Keqin
    Li, Kenli
    Xiao, Nong
    Qin, Zheng
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (01) : 386 - 400
  • [22] Zebra: Demand-aware Erasure Coding for Distributed Storage Systems
    Li, Jun
    Li, Baochun
    2016 IEEE/ACM 24TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2016,
  • [23] Distributed Error Correction Coding Scheme for Low Storage Blockchain Systems
    Wu, Huihui
    Ashikhmin, Alexei
    Wang, Xiaodong
    Li, Chong
    Yang, Sichao
    Zhang, Lei
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) : 7054 - 7071
  • [24] Experiences Building Network-Coding-Based Distributed Storage Systems
    Lee, Patrick P. C.
    2014 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA), 2014, : 200 - 201
  • [25] Cross-Object Coding and Allocation (COCA) for Distributed Storage Systems
    Fang, Luoyang
    Zhang, Rongqing
    Cheng, Xiang
    Yang, Liuqing
    2017 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2017,
  • [26] On the Impact of Pollution Attacks on Coding-Based Distributed Storage Systems
    Gaeta, Rossano
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 292 - 302
  • [27] Efficiently Coding Replicas to Erasure Coded Blocks in Distributed Storage Systems
    Yuan, Zimu
    Liu, Huiying
    IEEE COMMUNICATIONS LETTERS, 2017, 21 (09) : 1897 - 1900
  • [28] An Anti-forensic Method Based on RS Coding and Distributed Storage
    Jiang, Xuhang
    Wang, Yujue
    Ding, Yong
    Liang, Hai
    Wang, Huiyong
    Li, Zhenyu
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT II, 2022, 13156 : 240 - 254
  • [29] Linear Coding Schemes for the Distributed Computation of Subspaces
    Lalitha, V.
    Prakash, N.
    Vinodh, K.
    Kumar, P. Vijay
    Pradhan, S. Sandeep
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2013, 31 (04) : 678 - 690
  • [30] Redundancy Elimination in Distributed Matrix Computation
    Chen, Zihao
    Han, Baokun
    Xu, Chen
    Qian, Weining
    Zhou, Aoying
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 573 - 586