A Hierarchical Approach to Improve Job Scheduling and Data Replication in Data Grid

被引:0
|
作者
Abdi, Somayeh [1 ]
Hashemi, Sayyed [2 ]
机构
[1] Islamic Azad Univ, Eslamabad E Gharb Branch, Dept Comp Engn, Eslamabad E Gharb, Iran
[2] Islamic Azad Univ, Sci & Res Branch, Dept Comp Engn, Tehran, Iran
关键词
Job scheduling; data replication; RC; replica manager; resource discovery; counting bloom filter; PERFORMANCE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In dynamic environment of data grid effective job scheduling methods consider location of required data in dispatching jobs to resources. Also, job scheduling methods are combined with data replication mechanisms to reduce remote data access as well as save network bandwidth. In this paper, we combine job scheduling method and dynamic data replication to reduce data access delay and job execution time. Also, we expand our work by applying bloom filter in job scheduling decision. In data grid, appropriate mechanisms for recording, deleting and inquiring information about data files are required for implementing proper job scheduling method. Therefore, we apply counting bloom filter for recording/deleting and inquiring information about data files in Replica Catalogue (RC). Result of simulation indicates that proposed job scheduling and data replication methods reduce job execution time, also using bloom filter saves network bandwidth and reduces time of gathering information for selecting appropriate resources in job scheduling.
引用
收藏
页码:278 / 285
页数:8
相关论文
共 50 条
  • [1] The impact of data replication on job scheduling performance in the Data Grid
    Tang, M
    Lee, BS
    Tang, XY
    Yeo, CK
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2006, 22 (03): : 254 - 268
  • [2] Job scheduling and dynamic data replication in data grid environment
    Mansouri, Najme
    Dastghaibyfard, Gholam Hosein
    [J]. JOURNAL OF SUPERCOMPUTING, 2013, 64 (01): : 204 - 225
  • [3] Job scheduling and dynamic data replication in data grid environment
    Najme Mansouri
    Gholam Hosein Dastghaibyfard
    [J]. The Journal of Supercomputing, 2013, 64 : 204 - 225
  • [4] Combining data replication algorithms and job scheduling heuristics in the Data Grid
    Tang, M
    Lee, BS
    Tang, XY
    Yeo, CK
    [J]. EURO-PAR 2005 PARALLEL PROCESSING, PROCEEDINGS, 2005, 3648 : 381 - 390
  • [5] The Impact of the Implementation Cost of Replication in Data Grid Job Scheduling
    Nazir, Babar
    Ishaq, Faiza
    Shamshirband, Shahaboddin
    Chronopoulos, Anthony T.
    [J]. MATHEMATICAL AND COMPUTATIONAL APPLICATIONS, 2018, 23 (02)
  • [6] Job Scheduling for Dynamic Data Replication Strategy Based on Federation Data Grid Systems
    Zarina, M.
    Deris, M. Mat
    Rose, ANM. M.
    Isa, A. M.
    [J]. ADVANCES IN WIRELESS, MOBILE NETWORKS AND APPLICATIONS, 2011, 154 : 283 - +
  • [7] Network and data location aware approach for simultaneous job scheduling and data replication in large-scale data grid environments
    Najme Mansouri
    [J]. Frontiers of Computer Science, 2014, 8 : 391 - 408
  • [8] Network and data location aware approach for simultaneous job scheduling and data replication in large-scale data grid environments
    Mansouri, Najme
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2014, 8 (03) : 391 - 408
  • [9] Job scheduling and data replication on data grids
    Chang, Ruay-Shiung
    Chang, Jih-Sheng
    Lin, Shin-Yi
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2007, 23 (07): : 846 - 860
  • [10] DGridSim: A REAL-TIME DATA GRID SIMULATOR WITH HIERARCHICAL JOB AND DATA SCHEDULING
    Tandogan, Safai
    Dogan, Atakan
    Kandemir, Celal Murat
    [J]. SIMULTECH 2011: PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON SIMULATION AND MODELING METHODOLOGIES, TECHNOLOGIES AND APPLICATIONS, 2011, : 174 - 179