File block multi-replica management technology in cloud storage

被引:3
|
作者
He, Qinlu [1 ]
Zhang, Fan [1 ]
Bian, Genqing [1 ]
Zhang, Weiqi [1 ]
Li, Zhen [2 ]
Yu, Zhimin [1 ]
Feng, Hao [3 ]
机构
[1] Xian Univ Architecture & Technol, Sch Informat & Control Engn, Xian 710054, Peoples R China
[2] Shaan Xi Inst Metrol Sci, Xian 710043, Peoples R China
[3] Shaan Xi Big DATA Grp Co Ltd, Xian 710078, Peoples R China
基金
中国国家自然科学基金;
关键词
Cloud storage; HDFS; Replica management strategy; Replica placement; STRATEGY;
D O I
10.1007/s10586-022-03952-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of cloud computing technology and the broad application of the Internet, more and more user data are stored in the cloud storage system online. Data copy technology is an effective technical means to manage various data in cloud storage systems, which has the advantages of improving data access speed and enhancing data availability in cloud storage systems. Since a data copy management strategy has an important impact on the performance of cloud storage systems, how to design a data copy management strategy is of great significance to achieving high-quality cloud storage management. Firstly, this paper analyzes the HDFS random copy placement strategy and its shortcomings. Secondly, proposes a copy placement strategy based on evaluation value and load balancing. Thirdly, gives the evaluation function of rack and node by considering multiple evaluation indicators such as node disk space load capacity, node memory utilization, node CPU utilization, rack load rate and network distance between racks. Fourthly, finds suitable nodes through computer shelf evaluation values and node evaluation values when placing replicas. Finally, through simulation experiments, the experimental results of the HDFS random replica placement strategy and the evaluation results and load balancing-based replica placement strategy are compared and analyzed.
引用
收藏
页码:457 / 476
页数:20
相关论文
共 50 条
  • [31] Energy-Aware Multi-Replica Routing in Delay Tolerant Mobile Sensor Network
    Zhang Linjuan
    Gao Shuai
    [J]. CHINA COMMUNICATIONS, 2011, 8 (08) : 87 - 97
  • [32] A comprehensive investigation of researchers' shared file management practices in cloud storage
    Oh, Kyong Eun
    [J]. HUMAN-COMPUTER INTERACTION, 2024,
  • [33] Research of Key Management Technology on Cloud Storage
    Song, Ningning
    Wei, Zhiwei
    Xhou, Xianwei
    Liu, Qian
    [J]. INTERNATIONAL JOURNAL OF ONLINE ENGINEERING, 2013, 9 (06) : 58 - 61
  • [34] DRMST: A novel dynamic replica management strategy based on TOPSIS in cloud storage
    [J]. Zhiyong, Yang, 1600, Academic Journals Inc. (08):
  • [35] Clustering-based data integrity verification approach for multi-replica in a fog environment
    K. Uma Maheswari
    S. Mary Saira Bhanu
    Nickolas Savarimuthu
    [J]. The Journal of Supercomputing, 2024, 80 : 3089 - 3113
  • [36] Secure Cloud Storage and File Sharing
    Rawal, Bharat S.
    Vivek, S. Sree
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2017, : 78 - 83
  • [37] A Strategy of Dynamic Replica Creation in Cloud Storage
    Huang, Mengxing
    Ye, Xianglong
    Wei, Sanpeng
    Zhu, Donghai
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013), 2013, 52 : 389 - 392
  • [38] An Effective Revocation Mechanism for Multi-File Sharing Security in Cloud Storage
    Xiao, Min
    Yuan, Shumei
    Liu, Xuejiao
    Zhou, Yousheng
    [J]. PROCEEDINGS OF THE 2013 ASIA-PACIFIC COMPUTATIONAL INTELLIGENCE AND INFORMATION TECHNOLOGY CONFERENCE, 2013, : 412 - 419
  • [39] Research on Replica Strategy in Cloud Storage System
    Huo, Lin
    Yi, Ran
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATIONS (CSA), 2015, : 313 - 317
  • [40] Data Replica Placement in Cloud Storage System
    Zhang Tao
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013), 2013, 52 : 551 - 554