Dynamic File Replica Location and Selection Strategy in Data Grids

被引:1
|
作者
Cheng, Kuo-Yang
Wang, Hsiao-Hsi
Wen, Chia-Hsien
Lin, Yaw-Ling
Li, Kuan-Ching
Wang, Cho-Li
机构
关键词
D O I
10.1109/UMEDIA.2008.4570940
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present the design of PU-DG Optimizer toolbox (also known as PU-DG Optibox), which not only finds out the best strategy according to huge amount of simulation results but also proposes the Min-Max Balancing Workload method to upgrade the efficiency of execution in Data Grid environments. Data Grid is one of key factors to build up large-scale dataset storage system and providing high performance computing capacity, by connecting scattered computing and storage resources located dispersedly in the Grid. One major challenge in data grids is how to provide good and timely access to huge amount of data in distributed locations, given the high latency of interconnection networks. In this paper, we present the design framework of PU-DG Optibox for Data Grid environments. The proposed toolbox is a package containing a number of high-end techniques and methods running as middleware on top of data grid platforms, in order to optimize file downloads, by improving its efficiency and performance. The PU-DG Optibox provides users and developers possibilities for setting their own priority strategies. In addition, Min-Max Balancing Workload method is proposed to avoid that one computing node with lower network bandwidth to receive a job that has high complexity of job factor. Experimental results of techniques packaged in the proposed toolbox demonstrate its effectiveness.
引用
收藏
页码:484 / 489
页数:6
相关论文
共 50 条
  • [1] A dynamic file replication strategy in data grids
    Yang, Chao-Tung
    Fu, Chun-Pin
    Huang, Chien-Jung
    [J]. TENCON 2007 - 2007 IEEE REGION 10 CONFERENCE, VOLS 1-3, 2007, : 538 - 542
  • [2] A dynamic adjustment strategy for file transformation in data grids
    Yang, Chao-Tung
    Wang, Shih-Yu
    Fu, Chun-Pin
    [J]. NETWORK AND PARALLEL COMPUTING, PROCEEDINGS, 2007, 4672 : 61 - +
  • [3] An efficient replica placement strategy in highly dynamic data grids
    Ben Charrada, Faouzi
    Ounelli, Habib
    Chettaoui, Hanene
    [J]. INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2011, 2 (02) : 156 - 163
  • [4] Dynamic self-adaptive replica location method in data grids
    Li, DS
    Xiao, N
    Lu, XC
    Wang, YJ
    Lu, K
    [J]. IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, PROCEEDINGS, 2003, : 442 - 445
  • [5] A Weight-Based Dynamic Replica Replacement Strategy in Data Grids
    Zhao, Wuqing
    Xu, Xianbin
    Xiong, Naixue
    Wang, Zhuowei
    [J]. 2008 IEEE ASIA-PACIFIC SERVICES COMPUTING CONFERENCE, VOLS 1-3, PROCEEDINGS, 2008, : 1544 - +
  • [6] Fragmented replica selection and retrieval in data grids
    Chang, RS
    Wang, CM
    Chen, PH
    [J]. GCA '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON GRID COMPUTING AND APPLICATIONS, 2005, : 154 - 160
  • [7] Dynamic replica placement and selection strategies in data grids-A comprehensive survey
    Grace, R. Kingsy
    Manimegalai, R.
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2014, 74 (02) : 2099 - 2108
  • [8] On Fairness, Optimizing Replica Selection in Data Grids
    Al-Mistarihi, Husni Hamad E.
    Yong, Chan Huah
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2009, 20 (08) : 1102 - 1111
  • [9] A survey of dynamic replication and replica selection strategies based on data mining techniques in data grids
    Hamrouni, T.
    Slimani, S.
    Ben Charrada, F.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2016, 48 : 140 - 158
  • [10] A one-way file replica consistency model in data grids
    Yang, Chao-Tung
    Tsai, Wen-Chi
    Chen, Tsui-Ting
    Hsu, Ching-Hsien
    [J]. 2ND IEEE ASIA-PACIFIC SERVICES COMPUTING CONFERENCE, PROCEEDINGS, 2007, : 364 - +