Performance-Aware Based Correlated Datasets Replication Strategy

被引:0
|
作者
Ye, Lin [1 ]
Luan, Zhongzhi [1 ]
Yang, Hailong [1 ]
机构
[1] Beihang Univ, Sinogerman Joint Software Inst, Beijing 100191, Peoples R China
关键词
Correlated data; Performance-aware; Elastic replica management; AVAILABILITY;
D O I
10.1007/978-3-662-47401-3_42
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Performance-aware based correlated datasets replication strategy (PCDRS) has been put forward to solve the issue of how to place datasets at a wide area distributed environment to support researchers on interdisciplinary scientific research. The issue is addressed from three parts. First of all, we gave out the replica number based on the performance requirement of the datasets. Secondly, according to the performance of the datanode, we determined the location for placing the datasets replica. Thirdly, we distinguished data from hot and cold to control the number of replicas elastically. The strategy has been put into tests on a HDFS cluster. The result shows that our strategy is performance effective in maintaining the reliability of datasets and promoting the access performance of the cluster.
引用
收藏
页码:322 / 327
页数:6
相关论文
共 50 条
  • [21] Towards Performance-Aware Management of P4-based Cloud Environments
    Harkous, Hasanin
    Hosn, Bassel Aboul
    He, Mu
    Jarschel, Michael
    Pries, Rastin
    Kellerer, Wolfgang
    [J]. 2021 IEEE CONFERENCE ON NETWORK FUNCTION VIRTUALIZATION AND SOFTWARE DEFINED NETWORKS (IEEE NFV-SDN), 2021, : 87 - 90
  • [22] Performance-Aware Orchestration of P4-Based Heterogeneous Cloud Environments
    Harkous, Hasanin
    Hosn, Bassel Aboul
    He, Mu
    Jarschel, Michael
    Pries, Rastin
    Kellerer, Wolfgang
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (04): : 4765 - 4778
  • [23] The PEPPHER composition tool: performance-aware composition for GPU-based systems
    Dastgeer, Usman
    Li, Lu
    Kessler, Christoph
    [J]. COMPUTING, 2014, 96 (12) : 1195 - 1211
  • [24] Performance-Aware Trust-Based Access Control for Protecting Sensitive Attributes
    Salji, Mohd Rafiz
    Udzir, Nur Izura
    Ninggal, Mohd Izuan Hafez
    Sani, Nor Fazlida Mohd.
    Ibrahim, Hamidah
    [J]. RECENT ADVANCES ON SOFT COMPUTING AND DATA MINING, 2017, 549 : 560 - 569
  • [25] Microservice based Video Cloud Platform with Performance-aware Service Path Selection
    Zhang, Haitao
    Yang, Ning
    Xu, Zhengjun
    Tang, Bingchang
    Ma, Huadong
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES (IEEE ICWS 2018), 2018, : 306 - 309
  • [26] Performance-aware Lightweight Dynamic Early-Exit-based Gait Authentication
    Zouridakis, Pavlos
    Dinakarrao, Sai Manoj Pudukotai
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 466 - 470
  • [27] Towards A Performance-Aware Model of Manufacturing Information Sharing
    Zhou, Zude
    Hu, Peng
    Liu, Quan
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 869 - 872
  • [28] A performance-aware yield analysis and optimization of manycore architectures
    Lee, Jeong-Gun
    Kwak, Sanghoon
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2016, 54 : 40 - 52
  • [29] Performance-aware Scale Analysis with Reserve for Homomorphic Encryption
    Lee, Yongwoo
    Cheon, Seonyoung
    Kim, Dongkwan
    Lee, Dongyoon
    Kim, Hanjun
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, ASPLOS 2024, VOL 1, 2024, : 302 - 317
  • [30] Goal-driven Optimization Strategy for Energy and Performance-Aware Data Centers for Cloud-Based Wind Farm CMS
    Elijorde, Frank
    Kim, Sungho
    Lee, Jaewan
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2016, 10 (03): : 1362 - 1376