DAGMap: efficient and dependable scheduling of DAG workflow job in Grid

被引:26
|
作者
Cao, Haijun [1 ]
Jin, Hai [1 ]
Wu, Xiaoxin [2 ]
Wu, Song [1 ]
Shi, Xuanhua [1 ]
机构
[1] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Sch Comp Sci & Technol, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China
[2] Intel China Res Ctr, Commun Technol Lab, Beijing 100080, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2010年 / 51卷 / 02期
关键词
DAG Grid workflow; Critical task; Adaptive scheduling; Cooperative checkpointing;
D O I
10.1007/s11227-009-0284-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
DAG has been extensively used in Grid workflow modeling. Since Grid resources tend to be heterogeneous and dynamic, efficient and dependable workflow job scheduling becomes essential. It poses great challenges to achieve minimum job accomplishing time and high resource utilization efficiency, while providing fault tolerance. Based on list scheduling and group scheduling, in this paper, we propose a novel scheduling heuristic called DAGMap. DAGMap consists of two phases, namely Static Mapping and Dependable Execution. Four salient features of DAGMap are: (1) Task grouping is based on dependency relationships and task upward priority; (2) Critical tasks are scheduled first; (3) Min-Min and Max-Min selective scheduling are used for independent tasks; and (4) Checkpoint server with cooperative checkpointing is designed for dependable execution. The experimental results show that DAGMap can achieve better performance than other previous algorithms in terms of speedup, efficiency, and dependability.
引用
收藏
页码:201 / 223
页数:23
相关论文
共 50 条
  • [31] A DAG-based scheduling algorithm for dependent tasks in grid
    Sun, Weifeng
    Zhang, Danchuang
    Jia, Yiyang
    Chen, Yuanfang
    Hu, Yan
    Zhu, Xudong
    [J]. International Journal of Digital Content Technology and its Applications, 2012, 6 (15) : 347 - 356
  • [32] Job scheduling in Grid batch farms
    Gellrich, Andreas
    [J]. 20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [33] Optimizing job scheduling in the Grid environment
    Xia, E
    Jurisica, I
    [J]. PROCEEDINGS OF THE 7TH JOINT CONFERENCE ON INFORMATION SCIENCES, 2003, : 447 - 451
  • [34] DSARP: Dependable Scheduling with Active Replica Placement for Workflow Applications in Cloud Computing
    Tao, Ming
    Ota, Kaoru
    Dong, Mianxiong
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2020, 8 (04) : 1069 - 1078
  • [35] Dependable Workflow Scheduling for Microservice QoS Based on Deep Q-Network
    Yu, Xiaoming
    Wu, Wenjun
    Wang, Yangzhou
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES (IEEE ICWS 2022), 2022, : 240 - 245
  • [36] Efficient Workflow Scheduling for Grid Computing Using a Leveled Multi-objective Genetic Algorithm
    Hassan Khajemohammadi
    Ali Fanian
    T. Aaron Gulliver
    [J]. Journal of Grid Computing, 2014, 12 : 637 - 663
  • [37] MCCF: A distributed grid job workflow execution framework
    Feng, YH
    Cai, WT
    [J]. PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, PROCEEDINGS, 2004, 3358 : 274 - 279
  • [38] Efficient Workflow Scheduling for Grid Computing Using a Leveled Multi-objective Genetic Algorithm
    Khajemohammadi, Hassan
    Fanian, Ali
    Gulliver, T. Aaron
    [J]. JOURNAL OF GRID COMPUTING, 2014, 12 (04) : 637 - 663
  • [39] MCCF: A distributed grid job workflow execution framework
    Feng, Yuhong
    Cai, Wentong
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2004, 3358 : 274 - 279
  • [40] Grid job builder - A workflow editor for computing grids
    Jung, C
    Einhoff, M
    Noll, S
    Schiffner, N
    [J]. ITCC 2004: INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY: CODING AND COMPUTING, VOL 2, PROCEEDINGS, 2004, : 95 - 99