Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems

被引:5
|
作者
Lee, Ojus Thomas [1 ]
Akash, G. J. [1 ]
Kumar, S. D. Madhu [1 ]
Chandran, Priya [1 ]
机构
[1] Natl Inst Technol Calicut, Calicut, Kerala, India
关键词
Cloud storage systems; Erasure codes; Erasure code; based cloud storage systems; Storage node allocation; Resource allocation; LATENCY;
D O I
10.1007/s13369-019-03983-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Erasure codes, in the recent past, have emerged as an alternative to data replication-based systems for storing big data. Efficient choice of code and data nodes from the numerous available storage nodes is the key to the performance of any storage system. This paper presents the Storage Node Allocation Problem for selecting the suitable set of nodes for holding data and code blocks by representing the storage systems as a complete bipartite graph. Additionally, the paper formally proves that the problem is NP-hard and proposes approximate solutions using greedy, ant colony optimization and clustering-based methods. The solutions accomplish efficient choice of storage nodes by utilizing parameters like bandwidth availability, distance between the nodes, computational load and disk space availability.
引用
收藏
页码:9127 / 9142
页数:16
相关论文
共 50 条
  • [41] EA-EO : Endurance Aware Erasure Code for SSD-based Storage Systems
    Chamazcoti, Saeideh Alinezhad
    Miremadi, Seyed Ghassem
    2014 20TH IEEE PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING (PRDC 2014), 2014, : 76 - 85
  • [42] Erasure-Coding-Based Storage and Recovery for Distributed Exascale Storage Systems
    Kim, Jeong-Joon
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [43] Privacy-preserving dynamic auditing for regenerating code-based storage in cloud-fog-assisted IIoT
    Liu, Dengzhi
    Ding, Yongdong
    Yu, Geng
    Zhong, Zhaoman
    Song, Yuanzhao
    INTERNET OF THINGS, 2024, 25
  • [44] CLEC: Combination Locality Based Erasure Code for Permissioned Blockchain Storage
    Wu, Jiabin
    Yang, Boai
    Liu, Yang
    Liu, Fang
    Xiao, Nong
    Li, Shuo
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5137 - 5150
  • [45] DiVers: An erasure code based storage architecture for versioning exploiting sparsity
    Harshan, J.
    Datta, Anwitaman
    Oggier, Frederique
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2016, 59 : 47 - 62
  • [46] Load Balancing Technology based on Erasure Code in Distributed Storage System
    Ding Caiwei
    Wang Lei
    Sun Liansheng
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 5558 - 5563
  • [47] Cost-Effective Data Placement in Edge Storage Systems With Erasure Code
    Jin, Hai
    Luo, Ruikun
    He, Qiang
    Wu, Song
    Zeng, Zilai
    Xia, Xiaoyu
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (02) : 1039 - 1050
  • [48] Optimal Storage Allocation for Wireless Cloud Caching Systems With a Limited Sum Storage Capacity
    Hong, Bi
    Choi, Wan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (09) : 6010 - 6021
  • [49] Fault Tolerant Erasure Coded Replication for HDFS Based Cloud Storage
    Ko, Aye Chan
    Zaw, Wint Thida
    2014 IEEE FOURTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING (BDCLOUD), 2014, : 104 - 109
  • [50] TTLoC: Taming Tail Latency for Erasure-Coded Cloud Storage Systems
    Al-Abbasi, Abubakr O.
    Aggarwal, Vaneet
    Lan, Tian
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (04): : 1609 - 1623