Introducing new backfill-based scheduler for SLURM resource manager

被引:4
|
作者
Leonenkov, Sergei [1 ]
Zhumatiy, Sergey [1 ]
机构
[1] Moscow MV Lomonosov State Univ, Res Comp Ctr, Moscow 117234, Russia
关键词
D O I
10.1016/j.procs.2015.11.075
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The work proposes a design for a new external scheduler for SLURM (Simple Linux Utility for Resource Management). Schedulers, included in SLURM by default are good enough for many sites, but big supercomputers serving many users meet limitations of standard SLURM schedulers. In this work we discover methods to break these limitations via implementing new portable SLURM scheduler. We address the problem of maximizing the number of users, whose requests are processed in each given moment of time, and decrease start time of user's first task. Our approach is based on standard backfill algorithm and includes additional features, such as simplification of SLURM priority system, replacing slow SQL-based accounting checks by faster ACL checks and upgrading cluster administration convenience.
引用
收藏
页码:661 / 669
页数:9
相关论文
共 50 条
  • [31] Resource Aware Scheduler for Heterogeneous Workload Based on Estimated Task Processing Time
    Panicker, Athira V.
    Jisha, G.
    [J]. 2015 INTERNATIONAL CONFERENCE ON CONTROL COMMUNICATION & COMPUTING INDIA (ICCC), 2015, : 701 - 704
  • [32] A Deep Reinforcement Learning-Based Resource Scheduler for Massive MIMO Networks
    An, Qing
    Segarra, Santiago
    Dick, Chris
    Sabharwal, Ashutosh
    Doost-Mohammady, Rahman
    [J]. IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1 : 242 - 257
  • [33] Introducing Telemedicine in Italy: Citizens' Awareness of a New Healthcare Resource
    Galle, Francesca
    Oliva, Stefania
    Covelli, Edoardo
    Del Casale, Antonio
    Da Molin, Giovanna
    Liguori, Giorgio
    Orsi, Giovanni Battista
    Napoli, Christian
    [J]. HEALTHCARE, 2023, 11 (15)
  • [34] Resource cost and QoS achievement in a contract-based resource manager for mobile communications systems
    Le Bodic, G
    Irvine, J
    Dunlop, J
    [J]. IEEE/AFCEA EUROCOMM 2000, CONFERENCE RECORD: INFORMATION SYSTEMS FOR ENHANCED PUBLIC SAFETY AND SECURITY, 2000, : 392 - 397
  • [36] AN ADVANCE RESERVATION-BASED COMPUTATION RESOURCE MANAGER FOR GLOBAL SCHEDULING
    Nakada, Hidemoto
    Takefusa, Atsuko
    Ookubo, Katsuhiko
    Kudoh, Tomohiro
    Tanaka, Yoshio
    Sekiguchi, Satoshi
    [J]. GCA 2007: PROCEEDINGS OF THE 3RD INTERNATIONAL WORKSHOP ON GRID COMPUTING AND APPLICATIONS, 2007, : 3 - 14
  • [37] A resource manager for dynamically reconfigurable FPGA-based embedded systems
    Cervero, T.
    Dondo, J.
    Gomez, A.
    Pena, X.
    Lopez, S.
    Rincon, F.
    Sarmiento, R.
    Lopez, J. C.
    [J]. 16TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD 2013), 2013, : 633 - 640
  • [38] A VXI-MESSAGE-BASED COMMUNICATIONS DRIVER AND RESOURCE MANAGER FOR EPICS
    HILL, JO
    [J]. NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 1994, 352 (1-2): : 221 - 223
  • [39] Introducing the Case-Based Reviews series: a new educational resource for brain tumor clinicians and trainees
    Johnson, Derek Richard
    [J]. NEURO-ONCOLOGY PRACTICE, 2015, 2 (03) : 105 - 105
  • [40] R2_Scheduler: a rescheduling model for limited resource based on Globus framework
    Su, Pei
    Zhang, Yong
    Hu, Yungui
    [J]. Jisuanji Gongcheng/Computer Engineering, 2006, 32 (16): : 109 - 111