File block multi-replica management technology in cloud storage

被引:0
|
作者
Qinlu He
Fan Zhang
Genqing Bian
Weiqi Zhang
Zhen Li
Zhimin Yu
Hao Feng
机构
[1] Xi’an University of Architecture and Technology,School of Information and Control Engineering
[2] Shaan Xi Institute of Metrology Science,undefined
[3] Shaan Xi Big DATA Group Co.,undefined
[4] Ltd,undefined
来源
Cluster Computing | 2024年 / 27卷
关键词
Cloud storage; HDFS; Replica management strategy; Replica placement;
D O I
暂无
中图分类号
学科分类号
摘要
With the rapid development of cloud computing technology and the broad application of the Internet, more and more user data are stored in the cloud storage system online. Data copy technology is an effective technical means to manage various data in cloud storage systems, which has the advantages of improving data access speed and enhancing data availability in cloud storage systems. Since a data copy management strategy has an important impact on the performance of cloud storage systems, how to design a data copy management strategy is of great significance to achieving high-quality cloud storage management. Firstly, this paper analyzes the HDFS random copy placement strategy and its shortcomings. Secondly, proposes a copy placement strategy based on evaluation value and load balancing. Thirdly, gives the evaluation function of rack and node by considering multiple evaluation indicators such as node disk space load capacity, node memory utilization, node CPU utilization, rack load rate and network distance between racks. Fourthly, finds suitable nodes through computer shelf evaluation values and node evaluation values when placing replicas. Finally, through simulation experiments, the experimental results of the HDFS random replica placement strategy and the evaluation results and load balancing-based replica placement strategy are compared and analyzed.
引用
收藏
页码:457 / 476
页数:19
相关论文
共 50 条
  • [1] File block multi-replica management technology in cloud storage
    He, Qinlu
    Zhang, Fan
    Bian, Genqing
    Zhang, Weiqi
    Li, Zhen
    Yu, Zhimin
    Feng, Hao
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (01): : 457 - 476
  • [2] Multi-Replica Cloud Data Storage Based on Hierarchical Network Coding
    Xu G.
    Shi C.
    Feng X.
    Luo X.
    Shi X.
    Han S.
    Li W.
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (02): : 293 - 304
  • [3] A Multi-Replica Associated Deleting Scheme in Cloud
    Zhang, Yuanyuan
    Xiong, Jinbo
    Li, Xuan
    Jin, Biao
    Li, Suping
    Wang, Xu An
    [J]. PROCEEDINGS OF 2016 10TH INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT, AND SOFTWARE INTENSIVE SYSTEMS (CISIS), 2016, : 444 - 448
  • [4] CIA: A Collaborative Integrity Auditing Scheme for Cloud Data With Multi-Replica on Multi-Cloud Storage Providers
    Li, Tengfei
    Chu, Jianfeng
    Hu, Liang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (01) : 154 - 162
  • [5] Multi-replica Dynamic Data Verification for Cloud Computing
    Luo, Wenjun
    Liu, Lu
    [J]. INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY, PTS 1-4, 2013, 263-266 : 2939 - 2944
  • [6] Certificateless multi-replica public integrity auditing scheme for dynamic shared data in cloud storage
    Gudeme, Jaya Rao
    Pasupuleti, Syam Kumar
    Kandukuri, Ramesh
    [J]. COMPUTERS & SECURITY, 2021, 103
  • [7] Security sharing and associated deleting scheme for multi-replica in cloud
    Xiong, Jin-Bo
    Shen, Wei-Wei
    Huang, Yang-Qun
    Yao, Zhi-Qiang
    [J]. Tongxin Xuebao/Journal on Communications, 2015, 36
  • [8] Efficient dynamic multi-replica auditing for the cloud with geographic location
    Yu, Haiyang
    Yang, Zhen
    Waqas, Muhammad
    Tu, Shanshan
    Han, Zhu
    Halim, Zahid
    Sinnott, Richard O.
    Parampalli, Udaya
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 125 : 285 - 298
  • [9] Replica Fourier Transforms on ultrametric trees, and block-diagonalizing multi-replica matrices
    DeDominicis, C
    Carlucci, DM
    Temesvari, T
    [J]. JOURNAL DE PHYSIQUE I, 1997, 7 (01): : 105 - 115
  • [10] Efficient dynamic multi-replica auditing for the cloud with geographic location
    Yu, Haiyang
    Yang, Zhen
    Waqas, Muhammad
    Tu, Shanshan
    Han, Zhu
    Halim, Zahid
    Sinnott, Richard O.
    Parampalli, Udaya
    [J]. Future Generation Computer Systems, 2021, 125 : 285 - 298