A Fair Scheduling Algorithm for Adaptive Heterogeneous Resources in Data Centers

被引:0
|
作者
Liu, Wenbin [1 ]
Chen, Ningjiang [1 ]
Li, Hua [1 ]
Tang, Yusi [1 ]
Liang, Birui [1 ]
机构
[1] Guangxi Univ, Sch Comp & Elect Informat, Nanning, Peoples R China
关键词
Data center; Heterogeneous cluster; Resource scheduling; Mesos; Machine learning; Fairness;
D O I
10.1145/3275219.3275234
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The resource scheduling problem of data center clusters has always been a hot topic in the field of cloud computing. Existing research efforts focus on fairness, resource utilization and energy efficiency, and lack of research on heterogeneous clustering issues. To solve the problem that the traditional DRF algorithm does not consider the classification of machine performance and task type, this paper proposes a fair scheduling algorithm X-DRF that adapts to heterogeneous resources in the data center. The algorithm mainly classifies the performance of physical machines, increases the machine performance scoring factor, and increases the training and job type judgment classification of the XGBoost model. The experiments show that CPU utilization and memory usage increased by 10% and 6%, respectively. The normalized ratio is increased by about 3% compared to the original DRF system. Therefore, the presented fair scheduling algorithm for heterogeneous resources is more fair and reasonable in terms of resource allocation.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Fair Priority Scheduling (FPS): A Process Scheduling Algorithm Based on Skip Ring Data Structure
    Mustafa Aksu
    Ali Karcı
    Arabian Journal for Science and Engineering, 2017, 42 : 677 - 689
  • [32] Fair Scheduling for Time-dependent Resources
    Li, Bo
    Li, Minming
    Zhang, Ruilong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [33] Fair Priority Scheduling (FPS): A Process Scheduling Algorithm Based on Skip Ring Data Structure
    Aksu, Mustafa
    Karci, Ali
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2017, 42 (02) : 677 - 689
  • [34] On fair scheduling in heterogeneous link aggregated services
    Mohanty, SR
    Bhuyan, LN
    ICCCN 2005: 14TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS, PROCEEDINGS, 2005, : 199 - 205
  • [35] Accelerating the scheduling of the network resources of the next-generation optical data centers
    Patronas, G.
    Vlassopoulos, N.
    Bellos, Ph.
    Reisis, D.
    PARALLEL COMPUTING, 2023, 115
  • [36] A NEW PROPORTIONAL FAIR SCHEDULING ALGORITHM
    Huang ZhaoMing
    JOURNAL OF INVESTIGATIVE MEDICINE, 2014, 62 (08) : S106 - S106
  • [37] Energy-Aware Virtual Machine Scheduling on Data Centers with Heterogeneous Bandwidths
    Lago, Daniel Guimaraes
    Madeira, Edmundo R. M.
    Medhi, Deep
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (01) : 83 - 98
  • [38] Multiobjective Workflow Scheduling in a Federation of Heterogeneous Green-Powered Data Centers
    Iturriaga, Santiago
    Nesmachnow, Sergio
    Tchernykh, Andrei
    Dorronsoro, Bernabe
    2016 16TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2016, : 596 - 599
  • [39] Temperature-aware Adaptive VM Allocation in Heterogeneous Data Centers
    Kim, Young Geun
    Kim, Jeong In
    Choi, Seung Hun
    Kim, Seon Young
    Chung, Sung Woo
    2019 IEEE/ACM INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN (ISLPED), 2019,
  • [40] Workload scheduling algorithm for minimizing electricity bills of green data centers
    Dou, Hui
    Qi, Yong
    Wang, Pei-Jian
    Zhang, Kai-Yu
    Ruan Jian Xue Bao/Journal of Software, 2014, 25 (07): : 1448 - 1458