Novel Data Placement Algorithm for Distributed Storage System Based on Fault-Tolerant Domain

被引:2
|
作者
Shi L. [1 ]
Wang Z. [2 ]
Li X. [1 ]
机构
[1] School of Cyber Science and Engineering, Shanghai Jiao Tong University, Shanghai
[2] School of Electronic Information Engineering, Shanghai DianJi University, Shanghai
关键词
A; data placement; data reliability; distributed system; failure domain; fault-tolerant domain; storage system; TP; 391;
D O I
10.1007/s12204-020-2253-5
中图分类号
学科分类号
摘要
The 3-replica redundancy strategy is widely used to solve the problem of data reliability in large-scale distributed storage systems. However, its storage capacity utilization is only 33%. In this paper, a data placement algorithm based on fault-tolerant domain (FTD) is proposed. Owing to the fine-grained design of the FTD, the data reliability of systems using two replicas is comparable to that of current mainstream systems using three replicas, and the capacity utilization is increased to 50%. Moreover, the proposed FTD provides a new concept for the design of distributed storage systems. Distributed storage systems can take FTDs as the units for data placement, data migration, data repair and so on. In addition, fault detection can be performed independently and concurrently within the FTDs. © 2020, Shanghai Jiao Tong University and Springer-Verlag GmbH Germany, part of Springer Nature.
引用
收藏
页码:463 / 470
页数:7
相关论文
共 50 条
  • [1] A FAULT-TOLERANT ALGORITHM FOR MUTUAL EXCLUSION IN A DISTRIBUTED SYSTEM
    WONG, J
    THAMBU, P
    STOEN, R
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 1995, 29 (02) : 121 - 134
  • [2] A distributed networked storage system with secure fault-tolerant codes
    Tan, Pengxu
    Chen, Yue
    Jia, Hongyong
    [J]. MECHATRONICS AND INDUSTRIAL INFORMATICS, PTS 1-4, 2013, 321-324 : 2574 - 2577
  • [3] Cyclic storage for fault-tolerant distributed executions
    Marcelin-Jimenez, Ricardo
    Rajsbaum, Sergio
    Stevens, Brett
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2006, 17 (09) : 1028 - 1036
  • [4] Region-Based Fault-Tolerant Distributed File Storage System Design in Networks
    Sen, Arunabha
    Mazumder, Anisha
    Banerjee, Sujogya
    Das, Arun
    Zhou, Chenyang
    Shirazipourazad, Shahrzad
    [J]. NETWORKS, 2015, 66 (04) : 380 - 395
  • [5] Optimal fault-tolerant resource placement in distributed systems
    Kim, JH
    Seong, YR
    Kim, JM
    Lee, CH
    [J]. PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 1272 - 1278
  • [6] A fault-tolerant cooperative distributed system
    Deen, SM
    [J]. NINTH INTERNATIONAL WORKSHOP ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 1998, : 508 - 513
  • [7] Cache Support in a High Performance Fault-tolerant Distributed Storage System for Cloud and Big Data
    Lundberg, Lars
    Grahn, Hakan
    Ilie, Dragos
    Melander, Christian
    [J]. 2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS, 2015, : 537 - 546
  • [8] Quantum-secure fault-tolerant distributed cloud storage system
    Ma, Chun-Li
    Li, Dong-Dong
    Li, Yalin
    Wu, Yinghao
    Ding, Song-Yan
    Wang, Jun
    Li, Pei-Yuan
    Zhang, Song
    Chen, Junjie
    Zhang, Xiaoxing
    Wang, Jia-Yong
    Li, Jin
    Li, Qiang
    Chen, Zhi-Tong
    Zhou, Lei
    Zhao, Mei-Sheng
    Zhao, Yong
    [J]. AIP ADVANCES, 2023, 13 (11)
  • [9] Topology-Aware Data Placement Strategy for Fault-Tolerant Storage Systems
    Xia, Junxu
    Guo, Deke
    Luo, Lailong
    Cheng, Geyao
    [J]. IEEE SYSTEMS JOURNAL, 2020, 14 (03): : 4296 - 4307
  • [10] A fault-tolerant distributed deadlock detection algorithm
    Hansdah, RC
    Gantait, N
    Dey, S
    [J]. DISTRIBUTED COMPUTING, PROCEEDINGS: MOBILE AND WIRELESS COMPUTING, 2002, 2571 : 78 - 87