A multi-parameter scheduling method of dynamic workloads for big data calculation in cloud computing

被引:0
|
作者
Ali Hanani
Amir Masoud Rahmani
Amir Sahafi
机构
[1] Islamic Azad University,Department of Computer Engineering, Science and Research Branch
[2] Islamic Azad University,Department of Computer Engineering, South Tehran Branch
来源
关键词
Cloud computing; Workload scheduling; Big data; Optimization; Virtual clustering; Throughput;
D O I
暂无
中图分类号
学科分类号
摘要
Workload scheduling in cloud computing is currently an active research field. Scheduling plays an important role in cloud computing performance, especially when the platform is used for big data analysis and as less predictable workloads dynamically enter the clouds. Finding the optimized scheduling solution with different parameters in different environments is still a challenging issue. In dynamic environments such as cloud, scheduling strategies should feature rapid altering to be able to adapt more easily to the changes in input workloads. However, achieving an optimized solution is an important issue, which has a trade-off with the speed of finding the solution. In this article, an ordinal optimization method is proposed that considers the volume of workloads, load balancing and the volume of exchanged messages among virtual clusters, considering the replications. The algorithm in the present paper is based on ordinal optimization (OO) and evolutionary OO. In any time periods, a criterion is calculated to determine the similarity of workloads in two-consequence time periods, which is appropriate for timely changes in the scheduling procedure. In this paper, considering more than one parameter, a proper scheduling would be created for each time period. This scheduler is an organization for the number of virtual machines for each virtual cluster, but if there is a desirable similarity between workloads of two-consequence time periods, this procedure would be ignored. The results show that a more optimized solution is obtained in comparison with the rated methods, such as blind pink, OO, Monte Carlo and eOO in a reasonable time. The suggested method is flexible and it is possible to change the weight ratio of the proposed criteria in different environments to be consistent with different environmental conditions. The results show that proposed method achieved up to 28% performance improvement in comparison with eOO.
引用
收藏
页码:4796 / 4822
页数:26
相关论文
共 50 条
  • [1] A multi-parameter scheduling method of dynamic workloads for big data calculation in cloud computing
    Hanani, Ali
    Rahmani, Amir Masoud
    Sahafi, Amir
    [J]. JOURNAL OF SUPERCOMPUTING, 2017, 73 (11): : 4796 - 4822
  • [2] Evolutionary Scheduling of Dynamic Multitasking Workloads for Big-Data Analytics in Elastic Cloud
    Zhang, Fan
    Cao, Junwei
    Tan, Wei
    Khan, Samee U.
    Li, Keqin
    Zomaya, Albert Y.
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2014, 2 (03) : 338 - 351
  • [3] Underwater Sensor Multi-Parameter Scheduling for Heterogenous Computing Nodes
    Elhoseny, Mohamed
    Lakhan, Abdullah
    Rashid, Ahmed
    Mohammed, Mazin
    Abdulkareem, Karrar
    [J]. ACM TRANSACTIONS ON SENSOR NETWORKS, 2022, 18 (03)
  • [4] HPKS: High Performance Kubernetes Scheduling for Dynamic Blockchain Workloads in Cloud Computing
    Shi, Zhenwu
    Jiang, Chenming
    Jiang, Landu
    Liu, Xue
    [J]. 2021 IEEE 14TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2021), 2021, : 456 - 466
  • [5] Enhancement of Task Scheduling Technique of Big Data Cloud Computing
    Abed, Sa'ed
    Shubair, Duha S.
    [J]. 2018 INTERNATIONAL CONFERENCE ON ADVANCES IN BIG DATA, COMPUTING AND DATA COMMUNICATION SYSTEMS (ICABCD), 2018,
  • [6] Classified scheduling algorithm of big data under cloud computing
    Zhang, Yan
    [J]. International Journal of Computers and Applications, 2019, 41 (04): : 262 - 267
  • [7] FSBD: A Framework for Scheduling of Big Data Mining in Cloud Computing
    Ismail, Leila
    Masud, Mohammad M.
    Khan, Latifur
    [J]. 2014 IEEE INTERNATIONAL CONGRESS ON BIG DATA (BIGDATA CONGRESS), 2014, : 513 - 520
  • [8] The research of multimedia cloud computing platform data dynamic task scheduling optimization method in multi core environment
    Qiong Wu
    Guihe Qin
    Biaobing Huang
    [J]. Multimedia Tools and Applications, 2017, 76 : 17163 - 17178
  • [9] The research of multimedia cloud computing platform data dynamic task scheduling optimization method in multi core environment
    Wu, Qiong
    Qin, Guihe
    Huang, Biaobing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (16) : 17163 - 17178
  • [10] Multi-parameter clock skew scheduling
    Zhou, Xingbao
    Luk, Wai-Shing
    Zhou, Hai
    Yang, Fan
    Yan, Changhao
    Zeng, Xuan
    [J]. INTEGRATION-THE VLSI JOURNAL, 2015, 48 : 129 - 137