Introducing new backfill-based scheduler for SLURM resource manager

被引:4
|
作者
Leonenkov, Sergei [1 ]
Zhumatiy, Sergey [1 ]
机构
[1] Moscow MV Lomonosov State Univ, Res Comp Ctr, Moscow 117234, Russia
关键词
D O I
10.1016/j.procs.2015.11.075
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The work proposes a design for a new external scheduler for SLURM (Simple Linux Utility for Resource Management). Schedulers, included in SLURM by default are good enough for many sites, but big supercomputers serving many users meet limitations of standard SLURM schedulers. In this work we discover methods to break these limitations via implementing new portable SLURM scheduler. We address the problem of maximizing the number of users, whose requests are processed in each given moment of time, and decrease start time of user's first task. Our approach is based on standard backfill algorithm and includes additional features, such as simplification of SLURM priority system, replacing slow SQL-based accounting checks by faster ACL checks and upgrading cluster administration convenience.
引用
收藏
页码:661 / 669
页数:9
相关论文
共 50 条
  • [1] Energy-efficient Backfill-based Scheduling Approach for SLURM Resource Manager
    Gvozdetska, Nataliia
    Globa, Larysa
    Prokopets, Volodymyr
    [J]. 2019 IEEE 15TH INTERNATIONAL CONFERENCE ON THE EXPERIENCE OF DESIGNING AND APPLICATION OF CAD SYSTEMS (CADSM'2019), 2019,
  • [2] Integer Programming Based Heterogeneous CPU-GPU Cluster Scheduler for SLURM Resource Manager
    Soner, Seren
    Ozturan, Can
    [J]. 2012 IEEE 14TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2012 IEEE 9TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (HPCC-ICESS), 2012, : 418 - 424
  • [3] Integer programming based heterogeneous CPU-GPU cluster schedulers for SLURM resource manager
    Soner, Seren
    Ozturan, Can
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2015, 81 (01) : 38 - 56
  • [4] Algorithm for BACKFILL-based 'Take Ten Into Five' parallel job scheduling
    Bai, Shu-Ren
    Fu, Yun-Hong
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2007, 34 (01): : 81 - 84
  • [5] A New Resource Scheduler For LTE Systems
    Koyun, Fatih Burak
    Saglam, Mehmet Izzet
    Kartal, Mesut
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ELECO 2019), 2019, : 702 - 706
  • [6] Hybrid Job Scheduling Mechanism Using a Backfill-based Multi-queue Strategy in Distributed Grid Computing
    Park, Kiejin
    Kang, Changhoon
    Kim, Sungsook
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2012, 12 (09): : 39 - 48
  • [7] A KNOWLEDGE BASED RESOURCE SCHEDULER FOR NETWORK MAINTENANCE
    AZARMI, N
    [J]. BRITISH TELECOM TECHNOLOGY JOURNAL, 1991, 9 (03): : 80 - 87
  • [8] VIRTUAL HEALTH CONNECT: A COMMUNITY-BASED IMMUNISATION SCHEDULER AND MANAGER
    Ooi, Keng Siang
    Cheah, Yu-N
    [J]. COMPUTING & INFORMATICS, 4TH INTERNATIONAL CONFERENCE, 2013, 2013, : 441 - 446
  • [9] An Assignment Based Distributed Resource Manager
    Poore, Aubrey B.
    Danford, Scott
    Hilt, Matthew J.
    [J]. SIGNAL AND DATA PROCESSING OF SMALL TARGETS 2010, 2010, 7698
  • [10] Mobile Gaming Experience: An Approach based on Thread Scheduler & Thread Priority Manager
    Basha, Shaik Jani
    Shaik, Sandani
    Nagori, Nazrinbanu
    Shetty, Veerendra
    [J]. 2023 IEEE 30TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, AND ANALYTICS, HIPC 2023, 2023, : 31 - 40