Performance-Aware Based Correlated Datasets Replication Strategy

被引:0
|
作者
Ye, Lin [1 ]
Luan, Zhongzhi [1 ]
Yang, Hailong [1 ]
机构
[1] Beihang Univ, Sinogerman Joint Software Inst, Beijing 100191, Peoples R China
关键词
Correlated data; Performance-aware; Elastic replica management; AVAILABILITY;
D O I
10.1007/978-3-662-47401-3_42
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Performance-aware based correlated datasets replication strategy (PCDRS) has been put forward to solve the issue of how to place datasets at a wide area distributed environment to support researchers on interdisciplinary scientific research. The issue is addressed from three parts. First of all, we gave out the replica number based on the performance requirement of the datasets. Secondly, according to the performance of the datanode, we determined the location for placing the datasets replica. Thirdly, we distinguished data from hot and cold to control the number of replicas elastically. The strategy has been put into tests on a HDFS cluster. The result shows that our strategy is performance effective in maintaining the reliability of datasets and promoting the access performance of the cluster.
引用
收藏
页码:322 / 327
页数:6
相关论文
共 50 条
  • [1] Performance-Aware Replication of Distributed Pre-Recorded IPTV Content
    Lee, Seung-Bum
    Muntean, Gabriel-Miro
    Smeaton, Alan F.
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2009, 55 (02) : 516 - 526
  • [2] Performance-Aware Multicore Programming
    Lo, Chia-Tien Dan
    [J]. PROCEEDINGS OF THE 49TH ANNUAL ASSOCIATION FOR COMPUTING MACHINERY SOUTHEAST CONFERENCE (ACMSE '11), 2011, : 126 - 131
  • [3] Method of network slicing deployment based on performance-aware
    Huang, Kaizhi
    Pan, Qirun
    Yuan, Quan
    You, Wei
    Tang, Hongbo
    [J]. Tongxin Xuebao/Journal on Communications, 2019, 40 (08): : 114 - 122
  • [4] Performance-aware load balancing for multiclusters
    He, LG
    Jarvis, SA
    Bacigalupo, D
    Spooner, DP
    Nudd, GR
    [J]. PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, PROCEEDINGS, 2004, 3358 : 635 - 647
  • [5] Performance-aware composition framework for GPU-based systems
    Dastgeer, Usman
    Kessler, Christoph
    [J]. JOURNAL OF SUPERCOMPUTING, 2015, 71 (12): : 4646 - 4662
  • [6] Performance-aware composition framework for GPU-based systems
    Usman Dastgeer
    Christoph Kessler
    [J]. The Journal of Supercomputing, 2015, 71 : 4646 - 4662
  • [7] A Framework for Performance-aware Composition of Applications for GPU-based Systems
    Dastgeer, Usman
    Kessler, Christoph
    [J]. 2013 42ND ANNUAL INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2013, : 698 - 707
  • [8] Performance-Aware Refactoring of Cloud-based Big Data Applications
    Li, Chen
    Casale, Giuliano
    [J]. PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2017, : 1505 - 1510
  • [9] Roofline Model Based Performance-Aware Energy Management for Scientific Computing
    Wang, Yunlan
    Zhao, Tianhai
    Li, Lu
    Hou, Zhengxiong
    Gu, Jianhua
    [J]. 2018 9TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES, ALGORITHMS AND PROGRAMMING (PAAP 2018), 2018, : 74 - 80
  • [10] Performance-Aware Reliability Assessment of Heterogeneous Chips
    Chatzidimitriou, Athanasios
    Kaliorakis, Manolis
    Tselonis, Sotiris
    Gizopoulos, Dimitris
    [J]. 2017 IEEE 35TH VLSI TEST SYMPOSIUM (VTS), 2017,