DAGMap: efficient and dependable scheduling of DAG workflow job in Grid

被引:26
|
作者
Cao, Haijun [1 ]
Jin, Hai [1 ]
Wu, Xiaoxin [2 ]
Wu, Song [1 ]
Shi, Xuanhua [1 ]
机构
[1] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Sch Comp Sci & Technol, Cluster & Grid Comp Lab, Wuhan 430074, Peoples R China
[2] Intel China Res Ctr, Commun Technol Lab, Beijing 100080, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2010年 / 51卷 / 02期
关键词
DAG Grid workflow; Critical task; Adaptive scheduling; Cooperative checkpointing;
D O I
10.1007/s11227-009-0284-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
DAG has been extensively used in Grid workflow modeling. Since Grid resources tend to be heterogeneous and dynamic, efficient and dependable workflow job scheduling becomes essential. It poses great challenges to achieve minimum job accomplishing time and high resource utilization efficiency, while providing fault tolerance. Based on list scheduling and group scheduling, in this paper, we propose a novel scheduling heuristic called DAGMap. DAGMap consists of two phases, namely Static Mapping and Dependable Execution. Four salient features of DAGMap are: (1) Task grouping is based on dependency relationships and task upward priority; (2) Critical tasks are scheduled first; (3) Min-Min and Max-Min selective scheduling are used for independent tasks; and (4) Checkpoint server with cooperative checkpointing is designed for dependable execution. The experimental results show that DAGMap can achieve better performance than other previous algorithms in terms of speedup, efficiency, and dependability.
引用
收藏
页码:201 / 223
页数:23
相关论文
共 50 条
  • [1] DAGMap: efficient and dependable scheduling of DAG workflow job in Grid
    Haijun Cao
    Hai Jin
    Xiaoxin Wu
    Song Wu
    Xuanhua Shi
    [J]. The Journal of Supercomputing, 2010, 51 : 201 - 223
  • [2] DAGMap: Efficient Scheduling for DAG Grid Workflow Job
    Cao, Haijun
    Jin, Hai
    Wu, Xiaoxin
    Wu, Song
    Shi, Xuanhua
    [J]. 2008 9TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2008, : 17 - +
  • [3] Dependable Grid Workflow Scheduling Based on Resource Availability
    Yongcai Tao
    Hai Jin
    Song Wu
    Xuanhua Shi
    Lei Shi
    [J]. Journal of Grid Computing, 2013, 11 : 47 - 61
  • [4] Dependable Grid Workflow Scheduling Based on Resource Availability
    Tao, Yongcai
    Jin, Hai
    Wu, Song
    Shi, Xuanhua
    Shi, Lei
    [J]. JOURNAL OF GRID COMPUTING, 2013, 11 (01) : 47 - 61
  • [5] GAMESH: A grid architecture for scalable monitoring and enhanced dependable job scheduling
    Bellavista, Paolo
    Cinque, Marcello
    Corradi, Antonio
    Foschini, Luca
    Frattini, Flavio
    Povedano-Molina, Javier
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 71 : 192 - 201
  • [6] An Efficient Genetic Algorithm for DAG Scheduling with Communication Cost in Grid System
    Zhong, Xu
    Qiu, Hongze
    [J]. WORLD SUMMIT ON GENETIC AND EVOLUTIONARY COMPUTATION (GEC 09), 2009, : 1069 - 1072
  • [7] Reactive grid scheduling of dag applicationss
    Hernandez, Israel
    Cole, Murray
    [J]. PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING AND NETWORKS, 2007, : 92 - +
  • [8] An Efficient Memetic Algorithm for Job Scheduling in Computing Grid
    Zhong, Luo
    Long, ZhiXiang
    Zhang, Jun
    Song, HuaZhu
    [J]. INFORMATION AND AUTOMATION, 2011, 86 : 650 - 656
  • [9] Grid workflow scheduling in WOSE
    Patel, Yash
    McGough, Andrew Stephen
    Darlington, John
    [J]. PROCEEDINGS OF THE UK E-SCIENCE ALL HANDS MEETING 2006, 2006, : 566 - 573
  • [10] Genetic Algorithm for DAG Scheduling in Grid Environments
    Pop, Florin
    Dobre, Ciprian
    Cristea, Valentin
    [J]. 2009 IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, PROCEEDINGS, 2009, : 299 - 305