A Fair Scheduling Algorithm for Adaptive Heterogeneous Resources in Data Centers

被引:0
|
作者
Liu, Wenbin [1 ]
Chen, Ningjiang [1 ]
Li, Hua [1 ]
Tang, Yusi [1 ]
Liang, Birui [1 ]
机构
[1] Guangxi Univ, Sch Comp & Elect Informat, Nanning, Peoples R China
关键词
Data center; Heterogeneous cluster; Resource scheduling; Mesos; Machine learning; Fairness;
D O I
10.1145/3275219.3275234
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The resource scheduling problem of data center clusters has always been a hot topic in the field of cloud computing. Existing research efforts focus on fairness, resource utilization and energy efficiency, and lack of research on heterogeneous clustering issues. To solve the problem that the traditional DRF algorithm does not consider the classification of machine performance and task type, this paper proposes a fair scheduling algorithm X-DRF that adapts to heterogeneous resources in the data center. The algorithm mainly classifies the performance of physical machines, increases the machine performance scoring factor, and increases the training and job type judgment classification of the XGBoost model. The experiments show that CPU utilization and memory usage increased by 10% and 6%, respectively. The normalized ratio is increased by about 3% compared to the original DRF system. Therefore, the presented fair scheduling algorithm for heterogeneous resources is more fair and reasonable in terms of resource allocation.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Algorithm of Mixed Traffic Scheduling Among Data Centers Based on Prediction
    Wang R.
    Zhang Y.
    Wang W.
    Xu K.
    Cui L.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (06): : 1307 - 1317
  • [42] Energy Aware Scheduling using Genetic Algorithm in Cloud Data Centers
    Kar, Ipsita
    Parida, R. N. Ramakant
    Das, Himansu
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 3545 - 3550
  • [43] Utility function based fair data scheduling algorithm for OFDM wireless network
    Guo Kunqi
    Sun Lixin
    Jia Shilou
    JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2007, 18 (04) : 731 - 738
  • [44] A Dynamic and Energy Efficient Greedy Scheduling Algorithm for Cloud Data Centers
    Sarvabhatla, Mrudula
    Konda, Swapnasudha
    Vorugunti, Chandra Sekhar
    Babu, M. M. Naresh
    2017 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM 2017), 2017, : 47 - 52
  • [45] Utility function based fair data scheduling algorithm for OFDM wireless network
    Guo Kunqi
    Dept. of Communication Engineering
    JournalofSystemsEngineeringandElectronics, 2007, (04) : 731 - 738
  • [46] A self-adaptive strategy of data streams scheduling on heterogeneous cluster
    Guo, Wenzhong
    Chen, Guolong
    Xia, Tian
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2009, 21 (08): : 1175 - 1181
  • [47] AdPS: Adaptive Priority Scheduling for Data Services in Heterogeneous Vehicular Networks
    Sharma, Abhilasha
    Awasthi, Lalit Kumar
    COMPUTER COMMUNICATIONS, 2020, 159 : 71 - 82
  • [48] Data-Centric Task Scheduling Algorithm for Hybrid Tasks in Cloud Data Centers
    Li, Xin
    Wang, Liangyuan
    Abawajy, Jemal
    Qin, Xiaolin
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT II, 2018, 11335 : 630 - 644
  • [49] Distributed Algorithm for Balanced VM Placement for Heterogeneous Cloud Data Centers
    Patel, Yashwant Singh
    Misra, Rajiv
    ICDCN'18: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND NETWORKING, 2018,
  • [50] An adaptive scheduling scheme for fair bandwidth allocation
    Liu, W
    Cheng, WQ
    He, JH
    Le, CH
    Yang, ZK
    NETWORK ARCHITECTURES, MANAGEMENT, AND APPLICATIONS II, PTS 1 AND 2, 2005, 5626 : 215 - 223