Introducing new backfill-based scheduler for SLURM resource manager

被引:4
|
作者
Leonenkov, Sergei [1 ]
Zhumatiy, Sergey [1 ]
机构
[1] Moscow MV Lomonosov State Univ, Res Comp Ctr, Moscow 117234, Russia
关键词
D O I
10.1016/j.procs.2015.11.075
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The work proposes a design for a new external scheduler for SLURM (Simple Linux Utility for Resource Management). Schedulers, included in SLURM by default are good enough for many sites, but big supercomputers serving many users meet limitations of standard SLURM schedulers. In this work we discover methods to break these limitations via implementing new portable SLURM scheduler. We address the problem of maximizing the number of users, whose requests are processed in each given moment of time, and decrease start time of user's first task. Our approach is based on standard backfill algorithm and includes additional features, such as simplification of SLURM priority system, replacing slow SQL-based accounting checks by faster ACL checks and upgrading cluster administration convenience.
引用
收藏
页码:661 / 669
页数:9
相关论文
共 50 条
  • [21] Enhanced exchange heuristic based resource constrained scheduler using ARTMAP
    Song, IR
    Yang, TY
    Chen, JJG
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 1997, 33 (3-4) : 469 - 472
  • [22] ScGridBroker: an Open Grid Resource Scheduler based on Economic Scheduling Algorithms
    Zhang, Honghai
    Chi, Xuebin
    Lu, Zhonghua
    Zhong, Qianli
    Yang, Weiqing
    [J]. PROCEEDINGS OF THE NINTH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING AND SCIENCE (DCABES 2010), 2010, : 346 - 350
  • [23] A Meta-scheduler with Auction Based Resource Allocation for Global Grids
    Garg, Saurabh Kumar
    Venugopal, Srikumar
    Buyya, Rajkumar
    [J]. PROCEEDINGS OF THE 2008 14TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, 2008, : 187 - 194
  • [24] AMBER sched: An analytical model based resource scheduler for programmable routers
    Ficara, Domenico
    Giordano, Stefano
    Pacano, Michele
    Vitucci, Fabio
    Rossi, Federico
    [J]. GLOBECOM 2007: 2007 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-11, 2007, : 220 - +
  • [25] Introducing New Perspectives on Virtual Human Resource Development
    Bennett, Elisabeth E.
    [J]. ADVANCES IN DEVELOPING HUMAN RESOURCES, 2014, 16 (03) : 263 - 280
  • [26] Introducing WIREs Forensic Science: A new resource for the community
    Hemphill, Meghana Kamath
    [J]. WILEY INTERDISCIPLINARY REVIEWS: FORENSIC SCIENCE, 2019, 1 (01):
  • [27] Three new approaches for adjustment and improvement of the RR scheduler in a dynamic resource environment
    Tsiligaridis, J
    Acharya, R
    [J]. COMPUTER COMMUNICATIONS, 2005, 28 (08) : 929 - 946
  • [28] Measurement-based IP transport resource manager demonstrator
    Räisänen, V
    [J]. NETWORKING - ICN 2001, PART II, PROCEEDINGS, 2001, 2094 : 127 - 136
  • [29] Exploring the resource manager role in a project-based organization
    Nesheim, Torstein
    [J]. INTERNATIONAL JOURNAL OF MANAGING PROJECTS IN BUSINESS, 2021, 14 (07) : 1626 - 1641
  • [30] Resource Aware Scheduler for Heterogeneous Workload Based on Estimated Task Processing Time
    Panicker, Athira V.
    Jisha, G.
    [J]. 2015 INTERNATIONAL CONFERENCE ON CONTROL COMMUNICATION & COMPUTING INDIA (ICCC), 2015, : 701 - 704