Data Replica Placement Mechanism for Open Heterogeneous Storage Systems

被引:9
|
作者
Xu, X. [1 ,2 ]
Yang, C. [1 ]
Shao, J. [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210023, Jiangsu, Peoples R China
[2] Chinese Acad Sci, State Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Inst Big Data Res Yancheng, Yancheng 224005, Peoples R China
基金
中国国家自然科学基金;
关键词
Data Replica; Replica Placement; Heterogeneous Storage Systems;
D O I
10.1016/j.procs.2017.05.290
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many big data-oriented network storage platforms are open and heterogeneous, which means that the data placement mechanism has a great impact on the system performance. The data replica placement mechanism needs to consider the data availability, the load balance and the quality of service for open heterogeneous storage systems. However, current data placement mechanisms are mainly for simple homogeneous storage systems, not entirely suitable for heterogeneous storage systems. We proposed a novel data replica placement mechanism with the adjustable replica deployment strategy (ARDS) for open heterogeneous data storage systems, which considers the data availability, the data access frequency and the storage capacity. The mechanism takes the data availability as premise of the initialization number of replica, then adjusts the number of replica according to the data access frequency, and places replicas based on the node spare capacity, which effectively avoids the condition of load unbalance. We implemented simulation experiments based on OMNet++. The experimental results show that the ARDS-based mechanism improves the system performance including the system load balance and the rate of successful data access. (C) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:18 / 25
页数:8
相关论文
共 50 条
  • [1] A guideline for data placement in heterogeneous distributed storage systems
    Kaneko, Shun
    Nakamura, Takaki
    Kamei, Hitoshi
    Muraoka, Hiroaki
    [J]. PROCEEDINGS 2016 5TH IIAI INTERNATIONAL CONGRESS ON ADVANCED APPLIED INFORMATICS IIAI-AAI 2016, 2016, : 942 - 945
  • [2] Data Replica Placement in Cloud Storage System
    Zhang Tao
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013), 2013, 52 : 551 - 554
  • [3] Optimal Data Placement for Heterogeneous Cache, Memory, and Storage Systems
    Zhang, Lei
    Karimi, Reza
    Ahmad, Irfan
    Vigfusson, Ymir
    [J]. PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2020, 4 (01)
  • [4] Capability-Aware Data Placement for Heterogeneous Active Storage Systems
    LI Xiangyu
    HE Shuibing
    XU Xianbin
    WANG Yang
    [J]. Wuhan University Journal of Natural Sciences, 2016, 21 (03) : 249 - 256
  • [5] On the impact of replica placement to the reliability of distributed brick storage systems
    Lian, Q
    Chen, W
    Zhang, Z
    [J]. 25th IEEE International Conference on Distributed Computing Systems, Proceedings, 2005, : 187 - 196
  • [6] ROVN: Replica Placement for Distributed Data System with Heterogeneous Memory Devices
    Kim, Leeju
    Lee, Eunji
    [J]. IEICE ELECTRONICS EXPRESS, 2021, 18 (23): : 1 - 5
  • [7] A GA-Based Replica Placement Mechanism for Data Grid
    Almomani, Omar
    Madi, Mohammad
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2014, 5 (10) : 1 - 6
  • [8] Secure Replica Allocation in Cloud Storage Systems with Heterogeneous Vulnerabilities
    Tian, Yun
    Qin, Xiao
    Jia, Yafei
    [J]. PROCEEDINGS OF THE 2015 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE AND STORAGE (NAS), 2015, : 205 - 214
  • [9] A machine learning assisted data placement mechanism for hybrid storage systems
    Ren, Jinting
    Chen, Xianzhang
    Liu, Duo
    Tan, Yujuan
    Duan, Moming
    Li, Ruolan
    Liang, Liang
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2021, 120
  • [10] Intelligent Data Placement Mechanism for Replicas Distribution in Cloud Storage Systems
    Ibrahim, Ibrahim Adel
    Dai, Wei
    Bassiouni, Mostafa
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2016, : 134 - 139