Blockchain Storage Optimization Based on Erasure Code

被引:0
|
作者
Fan, Yu-Qi [1 ,2 ]
Sheng, Dong [2 ]
Wang, Lun-Fei [2 ]
机构
[1] Key Laboratory of Knowledge Engineering with Big Data, Hefei University of Technology, Ministry of Education, Hefei,230601, China
[2] School of Computer Science and Information Engineering, Hefei University of Technology, Hefei,230601, China
来源
基金
中国国家自然科学基金;
关键词
Optimal systems - Redundancy - Approximation algorithms - Clustering algorithms - Blockchain - Data reduction - Forward error correction;
D O I
10.11897/SP.J.1016.2022.00858
中图分类号
学科分类号
摘要
Blockchain has the characteristics of decentralization, unforgeability, traceability, transparency, etc. Therefore, blockchain can solve the problem of mutual distrust between nodes in the decentralized network and provide a viable way to build a value-connected platform. However, blockchain requires each node to store a complete copy of data to ensure data reliability with high storage redundancy. Unfortunately, it also brings huge storage pressure to blockchain nodes and reduces the utilization of storage resources, which makes the storage scalability be a bottleneck of blockchain. Meanwhile, with the increasing number of transactions, the size of blockchain also increases rapidly, which hinders the nodes with limited storage capacity to join the blockchain system and hence weakens the decentralization of the system. Using erasure code to encode the data stored in the blockchain can effectively reduce the storage redundancy. Nevertheless, the reduction of storage redundancy will reduce the reliability of the data, incur data recovery costs, and increase the data access delay. The existing work on reducing the storage redundancy in blockchains ignores the impact of inter-node delay and encoded data chunk storage locations on data reliability and data access delay during the data chunk placements, while there is a tradeoff between data storage cost and data access latency. In this paper, we study the decision problem of the number and locations of encoded data chunk copies with the erasure code in BFT permissioned blockchains, with the aim to achieve a good balance between data storage cost and data access latency under the data reliability constraint. We also propose a Latency-aware Encoded data chunks Allocation algorithm (LEA). Firstly, algorithm LEA solves the relaxation problem of the studied problem and the dual problem of the relaxation problem. The relaxation simplifies the problem model and facilitates the solution of the problem. We classify the solutions of the relaxation problem into clusters. Specifically, we select a node as the cluster center based on the optimal solution of the dual problem, and put the nodes into different clusters according to the optimal solution of the relaxation problem. Secondly, at least one node in each cluster is randomly selected to store the copy of the coded data chunk according to the optimal solution of the relaxation problem. Finally, the algorithm adjusts the storage allocation solution to satisfy the constraints of the decision problem. Theoretical analysis proves that algorithm LEA is a ln3+2 approximation algorithm to the data allocation decision problem. We conduct extensive experiments in both the simulation environment and the real permissioned blockchain system. The experimental results show that algorithm LEA can achieve good performance in terms of the tradeoff between data storage cost and data access delay, while satisfying the data reliability constraint. Algorithm LEA can effectively reduce the blockchain storage cost, enhance the blockchain storage capacity with the increase of the number of nodes, and realize the horizontal scalability of the system storage. Compared with the existing algorithms, algorithm LEA can achieve better data access performance in different networks, and the performance improvement can reach 15.2%. In addition, we evaluate the impact of the number of malicious nodes on the performance of the algorithm. When there are malicious nodes in the network, algorithm LEA can still obtain favorable data access performance while ensuring data reliability, which outperforms the existing algorithms by 15.4%. © 2022, Science Press. All right reserved.
引用
收藏
页码:858 / 876
相关论文
共 50 条
  • [1] Erasure code-based low storage blockchain node
    Perard, Doriane
    Lacan, Jerome
    Bachy, Yann
    Detchart, Jonathan
    [J]. IEEE 2018 INTERNATIONAL CONGRESS ON CYBERMATICS / 2018 IEEE CONFERENCES ON INTERNET OF THINGS, GREEN COMPUTING AND COMMUNICATIONS, CYBER, PHYSICAL AND SOCIAL COMPUTING, SMART DATA, BLOCKCHAIN, COMPUTER AND INFORMATION TECHNOLOGY, 2018, : 1622 - 1627
  • [2] CLEC: Combination Locality Based Erasure Code for Permissioned Blockchain Storage
    Wu, Jiabin
    Yang, Boai
    Liu, Yang
    Liu, Fang
    Xiao, Nong
    Li, Shuo
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5137 - 5150
  • [3] Adaptive erasure code based distributed storage systems
    Rai, Brijesh Kumar
    [J]. 2015 IEEE 14TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2015, : 174 - 177
  • [4] The Data Redundancy Method for Distributed Storage based on Erasure Code
    Li, Zhi
    Pan, Chao
    [J]. MIPPR 2015: REMOTE SENSING IMAGE PROCESSING, GEOGRAPHIC INFORMATION SYSTEMS, AND OTHER APPLICATIONS, 2015, 9815
  • [5] An Erasure Code Based Wireless Distributed Storage System Implementation
    Wu, Jiajia
    Wang, Li
    Hua, Chu
    Zhao, Wei
    Wang, Ge
    Chuan, Jianbin
    [J]. 2018 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2018, : 730 - 731
  • [6] A Method for Storage Node Allocation in Erasure Code based Storage Systems.
    Lee, Ojus Thomas
    Akash, G. J.
    Kumar, S. D. Madhu
    Chandran, Priya
    [J]. 2017 IEEE 3RD INTERNATIONAL CONFERENCE ON COLLABORATION AND INTERNET COMPUTING (CIC), 2017, : 449 - 454
  • [7] A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code
    Qin, Mingyuan
    Fu, Zheng
    [J]. 2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021), 2021, : 182 - 186
  • [8] Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems
    Ojus Thomas Lee
    G. J. Akash
    S. D. Madhu Kumar
    Priya Chandran
    [J]. Arabian Journal for Science and Engineering, 2019, 44 : 9127 - 9142
  • [9] Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems
    Lee, Ojus Thomas
    Akash, G. J.
    Kumar, S. D. Madhu
    Chandran, Priya
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2019, 44 (11) : 9127 - 9142
  • [10] A Decentralized Repair Mechanism for Decentralized Erasure Code based Storage Systems
    Lin, Hsiao-Ying
    Tzeng, Wen-Guey
    Lin, Bao-Shuh
    [J]. TRUSTCOM 2011: 2011 INTERNATIONAL JOINT CONFERENCE OF IEEE TRUSTCOM-11/IEEE ICESS-11/FCST-11, 2011, : 613 - 620