Scheduling parallel jobs with CPU and I/O resource requirements in cluster computing systems

被引:0
|
作者
Abawajy, JH [1 ]
Dandamudi, SP [1 ]
机构
[1] Carleton Univ, Sch Comp Sci, Ottawa, ON K1S 5B6, Canada
关键词
cluster computing; parallel job scheduling; parallel I/O; coordinated CPU-I/O resources scheduling; high-performance computing;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This paper addresses the problem of an on-line coordinated allocation of processor and I/O resources in large-scale shared heterogeneous cluster computing systems. Most research in job scheduling study has focused solely on the allocation of processors to jobs. However, since I/O is also a critical resource for many jobs, the allocation of processor and I/O resources must be coordinated to allow the system to operate most effectively. To this end, we present an efficient job scheduling policy and study its performance under various system and workload parameters. We also compared the performance of the proposed policy with static space time sharing policy. The results show that the proposed policy performs substantially better than the static space time sharing policy.
引用
收藏
页码:336 / 343
页数:8
相关论文
共 50 条
  • [31] Communication Aware Co-scheduling for Parallel Sob Scheduling in Cluster Computing
    Madheswari, A. Neela
    Banu, R. S. D. Wahida
    ADVANCES IN COMPUTING AND COMMUNICATIONS, PT 2, 2011, 191 : 545 - +
  • [32] A new approach to parallel program development and scheduling of parallel jobs on distributed systems
    Petrini, F
    Bassetti, F
    Gerbessiotis, A
    INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, PROCEEDINGS, 1999, : 546 - 552
  • [33] Intelligent Scheduling for Parallel Jobs in Big Data Processing Systems
    Xu, Mingrui
    Wu, Chase Q.
    Hou, Aiqin
    Wang, Yongqiang
    2019 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2019, : 22 - 28
  • [34] Scheduling jobs on parallel systems using a relaxed backfill strategy
    Ward, WA
    Mahood, CL
    West, JE
    JOB SCHEDULING STRATEGIES FOR PARALLEL PROCESSING, 2002, 2537 : 88 - 102
  • [35] scheduling framework for jobs on parallel machines in complex manufacturing systems
    Mönch, L
    WIRTSCHAFTSINFORMATIK, 2004, 46 (06): : 470 - 480
  • [36] Automatic I/O scheduling algorithm selection for parallel file systems
    Boito, Francieli Zanon
    Kassick, Rodrigo Virote
    Navaux, Philippe O. A.
    Denneulin, Yves
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2457 - 2472
  • [37] The dispatch time aligning I/O scheduling for parallel file systems
    Yonggang Liu
    Jing Qin
    Renato Figueiredo
    Cluster Computing, 2015, 18 : 1025 - 1039
  • [38] The dispatch time aligning I/O scheduling for parallel file systems
    Liu, Yonggang
    Qin, Jing
    Figueiredo, Renato
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2015, 18 (03): : 1025 - 1039
  • [39] Energy-Aware Scheduling of Embarrassingly Parallel Jobs and Resource Allocation in Cloud
    Shi, Li
    Zhang, Zhemin
    Robertazzi, Thomas
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (06) : 1607 - 1620
  • [40] Unrelated parallel machines scheduling with deteriorating jobs and resource dependent processing times
    Yin, Na
    Kang, Liying
    Sun, Tian-Chuan
    Yue, Chao
    Wang, Xue-Ru
    APPLIED MATHEMATICAL MODELLING, 2014, 38 (19-20) : 4747 - 4755