Dynamic File Replica Location and Selection Strategy in Data Grids

被引:1
|
作者
Cheng, Kuo-Yang
Wang, Hsiao-Hsi
Wen, Chia-Hsien
Lin, Yaw-Ling
Li, Kuan-Ching
Wang, Cho-Li
机构
关键词
D O I
10.1109/UMEDIA.2008.4570940
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present the design of PU-DG Optimizer toolbox (also known as PU-DG Optibox), which not only finds out the best strategy according to huge amount of simulation results but also proposes the Min-Max Balancing Workload method to upgrade the efficiency of execution in Data Grid environments. Data Grid is one of key factors to build up large-scale dataset storage system and providing high performance computing capacity, by connecting scattered computing and storage resources located dispersedly in the Grid. One major challenge in data grids is how to provide good and timely access to huge amount of data in distributed locations, given the high latency of interconnection networks. In this paper, we present the design framework of PU-DG Optibox for Data Grid environments. The proposed toolbox is a package containing a number of high-end techniques and methods running as middleware on top of data grid platforms, in order to optimize file downloads, by improving its efficiency and performance. The PU-DG Optibox provides users and developers possibilities for setting their own priority strategies. In addition, Min-Max Balancing Workload method is proposed to avoid that one computing node with lower network bandwidth to receive a job that has high complexity of job factor. Experimental results of techniques packaged in the proposed toolbox demonstrate its effectiveness.
引用
收藏
页码:484 / 489
页数:6
相关论文
共 50 条
  • [31] A DYNAMIC REPLICA STRATEGY BASED ON MARKOV MODEL FOR HADOOP DISTRIBUTED FILE SYSTEM (HDFS)
    Qu, Kaiyang
    Meng, Luoming
    Yang, Yang
    PROCEEDINGS OF 2016 4TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (IEEE CCIS 2016), 2016, : 337 - 342
  • [32] Dynamic Replica Creation Strategy Based on File Heat and Node Load in Hybrid Cloud
    Zhao, YaHui
    Li, ChunLin
    Li, LaYuan
    Zhang, Peng
    2017 19TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATIONS TECHNOLOGY (ICACT) - OPENING NEW ERA OF SMART SOCIETY, 2017, : 213 - 220
  • [33] Eliminating replica selection - Using multiple replicas to accelerate data transfer on grids
    Feng, J
    Humphrey, M
    TENTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, PROCEEDINGS, 2004, : 359 - 366
  • [34] Multiple users replica selection in data grids for fair user satisfaction: A hybrid approach
    Jaradat, Ayman
    Alhussian, Hitham
    Patel, Ahmed
    Fati, Suliman Mohamed
    COMPUTER STANDARDS & INTERFACES, 2020, 71 (71)
  • [35] A study on performance of dynamic file replication algorithms for real-time file access in Data Grids
    Dogan, Atakan
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2009, 25 (08): : 829 - 839
  • [36] CFS: A New Dynamic Replication Strategy for Data Grids
    Hanandeh, Feras
    Khazaaleh, Mutaz
    Ibrahim, Hamidah
    Latip, Rohaya
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2012, 9 (01) : 94 - 99
  • [37] File and object replication in Data Grids
    Stockinger, H
    Samar, A
    Allcock, B
    Foster, I
    Holtman, K
    Tierney, B
    10TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, PROCEEDINGS, 2001, : 76 - 86
  • [38] Predictive File Replication on the Data Grids
    Liao, ChenHan
    Helian, Na
    Wu, Sining
    Rashid, Mamunur M.
    INTERNATIONAL JOURNAL OF GRID AND HIGH PERFORMANCE COMPUTING, 2010, 2 (01) : 69 - 86
  • [39] File and Object Replication in Data Grids
    Heinz Stockinger
    Asad Samar
    Koen Holtman
    Bill Allcock
    Ian Foster
    Brian Tierney
    Cluster Computing, 2002, 5 (3) : 305 - 314
  • [40] An Innovative Replica Consistency Model in Data Grids
    Chang, Jih-Sheng
    Chang, Ruay-Shiung
    PROCEEDINGS OF THE 2008 INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS, 2008, : 3 - 10