Data Replica Placement Mechanism for Open Heterogeneous Storage Systems

被引:9
|
作者
Xu, X. [1 ,2 ]
Yang, C. [1 ]
Shao, J. [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210023, Jiangsu, Peoples R China
[2] Chinese Acad Sci, State Key Lab Informat Secur, Beijing 100093, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Inst Big Data Res Yancheng, Yancheng 224005, Peoples R China
基金
中国国家自然科学基金;
关键词
Data Replica; Replica Placement; Heterogeneous Storage Systems;
D O I
10.1016/j.procs.2017.05.290
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many big data-oriented network storage platforms are open and heterogeneous, which means that the data placement mechanism has a great impact on the system performance. The data replica placement mechanism needs to consider the data availability, the load balance and the quality of service for open heterogeneous storage systems. However, current data placement mechanisms are mainly for simple homogeneous storage systems, not entirely suitable for heterogeneous storage systems. We proposed a novel data replica placement mechanism with the adjustable replica deployment strategy (ARDS) for open heterogeneous data storage systems, which considers the data availability, the data access frequency and the storage capacity. The mechanism takes the data availability as premise of the initialization number of replica, then adjusts the number of replica according to the data access frequency, and places replicas based on the node spare capacity, which effectively avoids the condition of load unbalance. We implemented simulation experiments based on OMNet++. The experimental results show that the ARDS-based mechanism improves the system performance including the system load balance and the rate of successful data access. (C) 2017 The Authors. Published by Elsevier B.V.
引用
收藏
页码:18 / 25
页数:8
相关论文
共 50 条
  • [21] Data Distribution for Heterogeneous Storage Systems
    Zhou, Jiang
    Chen, Yong
    Zheng, Mai
    Wang, Weiping
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (06) : 1747 - 1762
  • [22] Replica Placement Strategies in Data Grid
    Rahman, Rashedur M.
    Barker, Ken
    Alhajj, Reda
    [J]. JOURNAL OF GRID COMPUTING, 2008, 6 (01) : 103 - 123
  • [23] Replica Placement Strategies in Data Grid
    Rashedur M. Rahman
    Ken Barker
    Reda Alhajj
    [J]. Journal of Grid Computing, 2008, 6 : 103 - 123
  • [24] Replica Placement Strategy Based on VCG Mechanism
    Wang Hongxia
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2015, : 72 - 76
  • [25] DATA PLACEMENT AND MIGRATION STRATEGIES FOR VIRTUALISED DATA STORAGE SYSTEMS
    Bond, H. A.
    Dingle, N. J.
    Franciosi, F.
    Harrison, P. G.
    Knottenbelt, W. J.
    [J]. EUROPEAN SIMULATION AND MODELLING CONFERENCE 2009, 2009, : 231 - 237
  • [26] Data Placement Strategy in Data Center Distributed Storage Systems
    Qin, Yang
    Ai, Xiao
    Chen, Lingjian
    Yang, Weihong
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS (ICCS), 2016,
  • [27] Application of VCG in Replica Placement Strategy of Cloud Storage
    Wang Hongxia
    [J]. INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2016, 9 (04): : 27 - 39
  • [28] Mechanism Design for Replica Placement in Peer-assisted Content Delivery Networks with Heterogeneous Behavior Models
    Guo, Minzhe
    Bhattacharya, Prabir
    [J]. PROCEEDINGS 2016 IEEE 40TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS, VOL 1, 2016, : 500 - 501
  • [29] SWORD: workload-aware data placement and replica selection for cloud data management systems
    K. Ashwin Kumar
    Abdul Quamar
    Amol Deshpande
    Samir Khuller
    [J]. The VLDB Journal, 2014, 23 : 845 - 870
  • [30] SWORD: workload-aware data placement and replica selection for cloud data management systems
    Kumar, K. Ashwin
    Quamar, Abdul
    Deshpande, Amol
    Khuller, Samir
    [J]. VLDB JOURNAL, 2014, 23 (06): : 845 - 870