Performance-Aware Based Correlated Datasets Replication Strategy

被引:0
|
作者
Ye, Lin [1 ]
Luan, Zhongzhi [1 ]
Yang, Hailong [1 ]
机构
[1] Beihang Univ, Sinogerman Joint Software Inst, Beijing 100191, Peoples R China
关键词
Correlated data; Performance-aware; Elastic replica management; AVAILABILITY;
D O I
10.1007/978-3-662-47401-3_42
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Performance-aware based correlated datasets replication strategy (PCDRS) has been put forward to solve the issue of how to place datasets at a wide area distributed environment to support researchers on interdisciplinary scientific research. The issue is addressed from three parts. First of all, we gave out the replica number based on the performance requirement of the datasets. Secondly, according to the performance of the datanode, we determined the location for placing the datasets replica. Thirdly, we distinguished data from hot and cold to control the number of replicas elastically. The strategy has been put into tests on a HDFS cluster. The result shows that our strategy is performance effective in maintaining the reliability of datasets and promoting the access performance of the cluster.
引用
收藏
页码:322 / 327
页数:6
相关论文
共 50 条
  • [31] A performance-aware yield analysis and optimization of manycore architectures
    Lee, Jeong-Gun
    Kwak, Sanghoon
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2016, 54 : 40 - 52
  • [32] Hybrid metaheuristic model based performance-aware optimization for map reduce scheduling
    Kumar, Vishal
    Kushwaha, Sumit
    [J]. International Journal of Computers and Applications, 2023, 45 (12) : 776 - 788
  • [33] Goal-driven Optimization Strategy for Energy and Performance-Aware Data Centers for Cloud-Based Wind Farm CMS
    Elijorde, Frank
    Kim, Sungho
    Lee, Jaewan
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2016, 10 (03): : 1362 - 1376
  • [34] Pearl: Performance-Aware Wear Leveling for Nonvolatile FPGAs
    Zhang, Hao
    Liu, Ke
    Zhao, Mengying
    Shen, Zhaoyan
    Cai, Xiaojun
    Jia, Zhiping
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2021, 40 (02) : 274 - 286
  • [35] Performance-Aware Energy Saving for Data Center Networks
    Al-Tarazi, Motassem
    Chang, J. Morris
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (01): : 206 - 219
  • [36] Performance-Aware Device Driver Architecture for Signal Processing
    Sydow, Stefan
    Nabelsee, Mohannad
    Busse, Anselm
    Koch, Sebastian
    Parzyjegla, Helge
    [J]. PROCEEDINGS OF 28TH IEEE INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING, (SBAC-PAD 2016), 2016, : 67 - 75
  • [37] Floorplet: Performance-Aware Floorplan Framework for Chiplet Integration
    Chen, Shixin
    Li, Shanyi
    Zhuang, Zhen
    Zheng, Su
    Liang, Zheng
    Ho, Tsung-Yi
    Yu, Bei
    Sangiovanni-Vincentelli, Alberto L.
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (06) : 1638 - 1649
  • [38] The PEPPHER composition tool: performance-aware composition for GPU-based systems
    Usman Dastgeer
    Lu Li
    Christoph Kessler
    [J]. Computing, 2014, 96 : 1195 - 1211
  • [39] FCloudless: A Performance-Aware Collaborative Mechanism for JointCloud Serverless
    Liu, Jianfei
    Wang, Huaimin
    Shi, Peichang
    Li, Yaojie
    Ma, Penghui
    Yi, Guodong
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON JOINT CLOUD COMPUTING, JCC, 2023, : 93 - 94
  • [40] A Framework for Performance-Aware Composition of Explicitly Parallel Components
    Kessler, Christoph W.
    Lowe, Welf
    [J]. PARALLEL COMPUTING: ARCHITECTURES, ALGORITHMS AND APPLICATIONS, 2008, 15 : 227 - +