Dynamic deadline constrained multi-objective workflow scheduling in multi-cloud environments

被引:0
|
作者
Cai, Xingjuan [1 ,2 ]
Zhang, Yan [1 ]
Li, Mengxia [1 ]
Wu, Linjie [1 ]
Zhang, Wensheng [3 ]
Chen, Jinjun [4 ]
机构
[1] Taiyuan Univ Sci & Technol, Shanxi Key Lab Big Data Anal & Parallel Comp, Taiyuan 030024, Shanxi, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing, Peoples R China
[4] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
Multi-cloud; Dynamically constrained multi-objective; optimization; Workflow scheduling; Outage rates; Deadline constraints; ALGORITHM; SPOT;
D O I
10.1016/j.eswa.2024.125168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Workflow scheduling becomes difficult and demanding in multi-cloud systems because of the variety of billing models and resource kinds, as well as the susceptibility of processes to time limitations. In which the execution duration of the workflow needs to be flexibly adjusted according to the urgency or otherwise of the real situation, in this work, we model the workflow scheduling problem with deadline constraints as a dynamically constrained multi-objective optimization problem (DCMOP), where the disruption rate of the special cloud resources and the failure probability in different cloud environments are expressed as the disruption probability of the workflow in a comprehensive manner while considering the execution time and cost. Dynamics arise from price changes for specialized cloud resources and changes in the execution duration of workflows. In addition, an algorithm for dynamically constrained multi-objective optimization (DC-MOEADPDS) is proposed in this paper. The algorithm based on two-population synergy as well as diversity selection. The auxiliary population ignores constraint limitations to help the main population speed up convergence, and diversity selection enables the auxiliary population to have better diversity to assist the general public in looking for more viable areas. Through dynamic constrained workflow simulation experiments in a multi-cloud environment, our algorithm reduces the execution time by an average of 13.29%, the cost by an average of 32.26%, and the interruption probability by 56.75%. In addition, our algorithm outperforms other algorithms in experiments on a dynamically constrained benchmark set.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] A Novel Scheduling Approach for Spark Workflow Tasks with Deadline and Uncertain Performance in Multi-Cloud Networks
    Rajput, Kamran Yaseen
    Li, Xiaoping
    Zhang, Jinquan
    Lakhan, Abdullah
    [J]. IEEE Transactions on Cloud Computing, 2024, 12 (04): : 1145 - 1157
  • [32] Workflow scheduling algorithms for hard-deadline constrained cloud environments
    Visheratin, Alexander A.
    Melnik, Mikhail
    Nasonov, Denis
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE 2016 (ICCS 2016), 2016, 80 : 2098 - 2106
  • [33] Multi-objective Genetic Algorithm for Multi-cloud Brokering
    Amato, Alba
    Di Martino, Beniamino
    Venticinque, Salvatore
    [J]. EURO-PAR 2013: PARALLEL PROCESSING WORKSHOPS, 2014, 8374 : 55 - 64
  • [34] An adaptive multi-objective evolutionary algorithm for constrained workflow scheduling in Clouds
    Zhang, Miao
    Li, Huiqi
    Liu, Li
    Buyya, Rajkumar
    [J]. DISTRIBUTED AND PARALLEL DATABASES, 2018, 36 (02) : 339 - 368
  • [35] An adaptive multi-objective evolutionary algorithm for constrained workflow scheduling in Clouds
    Miao Zhang
    Huiqi Li
    Li Liu
    Rajkumar Buyya
    [J]. Distributed and Parallel Databases, 2018, 36 : 339 - 368
  • [36] Enhanced multi-objective evolutionary algorithm for workflow scheduling on the cloud platform
    Wang Y.
    [J]. Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2019, 46 (01): : 130 - 136
  • [37] A Hybrid Metaheuristic for Multi-Objective Scientific Workflow Scheduling in a Cloud Environment
    Anwar, Nazia
    Deng, Huifang
    [J]. APPLIED SCIENCES-BASEL, 2018, 8 (04):
  • [38] Multi-objective workflow scheduling based on genetic algorithm in cloud environment
    Xia, Xuewen
    Qiu, Huixian
    Xu, Xing
    Zhang, Yinglong
    [J]. INFORMATION SCIENCES, 2022, 606 : 38 - 59
  • [39] A Hybrid Algorithm for Multi-Objective Scientific Workflow Scheduling in IaaS Cloud
    Gao, Yongqiang
    Zhang, Shuyun
    Zhou, Jiantao
    [J]. IEEE ACCESS, 2019, 7 : 125783 - 125795
  • [40] Multi-Objective Optimization of Deadline and Budget-Aware Workflow Scheduling in Uncertain Clouds
    Calzarossa, Maria Carla
    Della Vedova, Marco L.
    Massari, Luisa
    Nebbione, Giuseppe
    Tessera, Daniele
    [J]. IEEE ACCESS, 2021, 9 : 89891 - 89905