File block multi-replica management technology in cloud storage

被引:3
|
作者
He, Qinlu [1 ]
Zhang, Fan [1 ]
Bian, Genqing [1 ]
Zhang, Weiqi [1 ]
Li, Zhen [2 ]
Yu, Zhimin [1 ]
Feng, Hao [3 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710054, Peoples R China
[2] Shaan Xi Inst Metrol Sci, Xian 710043, Peoples R China
[3] Shaan Xi Big DATA Grp Co Ltd, Xian 710078, Peoples R China
基金
中国国家自然科学基金;
关键词
Cloud storage; HDFS; Replica management strategy; Replica placement; STRATEGY;
D O I
10.1007/s10586-022-03952-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of cloud computing technology and the broad application of the Internet, more and more user data are stored in the cloud storage system online. Data copy technology is an effective technical means to manage various data in cloud storage systems, which has the advantages of improving data access speed and enhancing data availability in cloud storage systems. Since a data copy management strategy has an important impact on the performance of cloud storage systems, how to design a data copy management strategy is of great significance to achieving high-quality cloud storage management. Firstly, this paper analyzes the HDFS random copy placement strategy and its shortcomings. Secondly, proposes a copy placement strategy based on evaluation value and load balancing. Thirdly, gives the evaluation function of rack and node by considering multiple evaluation indicators such as node disk space load capacity, node memory utilization, node CPU utilization, rack load rate and network distance between racks. Fourthly, finds suitable nodes through computer shelf evaluation values and node evaluation values when placing replicas. Finally, through simulation experiments, the experimental results of the HDFS random replica placement strategy and the evaluation results and load balancing-based replica placement strategy are compared and analyzed.
引用
收藏
页码:457 / 476
页数:20
相关论文
共 50 条
  • [1] File block multi-replica management technology in cloud storage
    Qinlu He
    Fan Zhang
    Genqing Bian
    Weiqi Zhang
    Zhen Li
    Zhimin Yu
    Hao Feng
    [J]. Cluster Computing, 2024, 27 : 457 - 476
  • [2] Multi-Replica Cloud Data Storage Based on Hierarchical Network Coding
    Xu, Guangwei
    Shi, Chunhong
    Feng, Xiangyang
    Luo, Xin
    Shi, Xiujin
    Han, Songhua
    Li, Wei
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (02): : 293 - 304
  • [3] A Multi-Replica Associated Deleting Scheme in Cloud
    Zhang, Yuanyuan
    Xiong, Jinbo
    Li, Xuan
    Jin, Biao
    Li, Suping
    Wang, Xu An
    [J]. PROCEEDINGS OF 2016 10TH INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT, AND SOFTWARE INTENSIVE SYSTEMS (CISIS), 2016, : 444 - 448
  • [4] CIA: A Collaborative Integrity Auditing Scheme for Cloud Data With Multi-Replica on Multi-Cloud Storage Providers
    Li, Tengfei
    Chu, Jianfeng
    Hu, Liang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (01) : 154 - 162
  • [5] Multi-replica Dynamic Data Verification for Cloud Computing
    Luo, Wenjun
    Liu, Lu
    [J]. INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY, PTS 1-4, 2013, 263-266 : 2939 - 2944
  • [6] Certificateless multi-replica public integrity auditing scheme for dynamic shared data in cloud storage
    Gudeme, Jaya Rao
    Pasupuleti, Syam Kumar
    Kandukuri, Ramesh
    [J]. COMPUTERS & SECURITY, 2021, 103
  • [7] Security sharing and associated deleting scheme for multi-replica in cloud
    Xiong, Jin-Bo
    Shen, Wei-Wei
    Huang, Yang-Qun
    Yao, Zhi-Qiang
    [J]. Tongxin Xuebao/Journal on Communications, 2015, 36
  • [8] Efficient dynamic multi-replica auditing for the cloud with geographic location
    Yu, Haiyang
    Yang, Zhen
    Waqas, Muhammad
    Tu, Shanshan
    Han, Zhu
    Halim, Zahid
    Sinnott, Richard O.
    Parampalli, Udaya
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 125 : 285 - 298
  • [9] Replica Fourier Transforms on ultrametric trees, and block-diagonalizing multi-replica matrices
    DeDominicis, C
    Carlucci, DM
    Temesvari, T
    [J]. JOURNAL DE PHYSIQUE I, 1997, 7 (01): : 105 - 115
  • [10] Efficient dynamic multi-replica auditing for the cloud with geographic location
    Yu, Haiyang
    Yang, Zhen
    Waqas, Muhammad
    Tu, Shanshan
    Han, Zhu
    Halim, Zahid
    Sinnott, Richard O.
    Parampalli, Udaya
    [J]. Future Generation Computer Systems, 2021, 125 : 285 - 298