A Fair Scheduling Algorithm for Adaptive Heterogeneous Resources in Data Centers

被引:0
|
作者
Liu, Wenbin [1 ]
Chen, Ningjiang [1 ]
Li, Hua [1 ]
Tang, Yusi [1 ]
Liang, Birui [1 ]
机构
[1] Guangxi Univ, Sch Comp & Elect Informat, Nanning, Peoples R China
关键词
Data center; Heterogeneous cluster; Resource scheduling; Mesos; Machine learning; Fairness;
D O I
10.1145/3275219.3275234
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The resource scheduling problem of data center clusters has always been a hot topic in the field of cloud computing. Existing research efforts focus on fairness, resource utilization and energy efficiency, and lack of research on heterogeneous clustering issues. To solve the problem that the traditional DRF algorithm does not consider the classification of machine performance and task type, this paper proposes a fair scheduling algorithm X-DRF that adapts to heterogeneous resources in the data center. The algorithm mainly classifies the performance of physical machines, increases the machine performance scoring factor, and increases the training and job type judgment classification of the XGBoost model. The experiments show that CPU utilization and memory usage increased by 10% and 6%, respectively. The normalized ratio is increased by about 3% compared to the original DRF system. Therefore, the presented fair scheduling algorithm for heterogeneous resources is more fair and reasonable in terms of resource allocation.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Pricefair: On fair scheduling of heterogeneous resources
    Peri, Aristotelis
    Tomaras, Dimitrios
    Kalogeraki, Vana
    Gunopulos, Dimitrios
    2024 IEEE 40TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOP, ICDEW, 2024, : 209 - 216
  • [2] h-Fair: Asymptotic Scheduling of Heavy Workloads in Heterogeneous Data Centers
    Postoaca, Andrei Vlad
    Pop, Florin
    Prodan, Radu
    2018 18TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2018, : 366 - 369
  • [4] Token Bucket Fair Scheduling Algorithm with Adaptive Rate Allocations for Heterogeneous Wireless Networks
    Salman A. AlQahtani
    Wireless Personal Communications, 2015, 84 : 801 - 819
  • [5] Adaptive Scheduling Algorithm Based Task Loading in Cloud Data Centers
    Mukherjee, Dibyendu
    Ghosh, Shivnath
    Pal, Souvik
    Aly, Ayman A.
    Le, Dac-Nhuong
    IEEE ACCESS, 2022, 10 : 49412 - 49421
  • [6] Fair Scheduling Scheme with Feedback in the Joint Allocation of Heterogeneous Resources
    Yu Hua
    2006 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-12, 2006, : 275 - 280
  • [7] An Approximation Algorithm for Scheduling on Heterogeneous Reconfigurable Resources
    Nahapetian, Ani
    Brisk, Philip
    Ghiasi, Soheil
    Sarrafzadeh, Majid
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2009, 9 (01) : 5
  • [8] A fair scheduling algorithm with adaptive compensation in wireless networks
    Wang, KC
    Chin, YL
    GLOBECOM '01: IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-6, 2001, : 3543 - 3547
  • [9] Adaptive Scheduling of Parallel Jobs on Functionally Heterogeneous Resources
    He, Yuxiong
    Sun, Hongyang
    Hsu, Wen-Jing
    2007 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOPS (ICPP), 2007, : 358 - 365
  • [10] An Adaptive Scheduling Algorithm for Heterogeneous Hadoop Systems
    Han, Jiazhen
    Yuan, Zhengheng
    Han, Yiheng
    Peng, Cheng
    Liu, Jing
    Li, Guangli
    2017 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2017), 2017, : 845 - 850