Dynamic deadline constrained multi-objective workflow scheduling in multi-cloud environments

被引:0
|
作者
Cai, Xingjuan [1 ,2 ]
Zhang, Yan [1 ]
Li, Mengxia [1 ]
Wu, Linjie [1 ]
Zhang, Wensheng [3 ]
Chen, Jinjun [4 ]
机构
[1] Taiyuan Univ Sci & Technol, Shanxi Key Lab Big Data Anal & Parallel Comp, Taiyuan 030024, Shanxi, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing, Peoples R China
[4] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
Multi-cloud; Dynamically constrained multi-objective; optimization; Workflow scheduling; Outage rates; Deadline constraints; ALGORITHM; SPOT;
D O I
10.1016/j.eswa.2024.125168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Workflow scheduling becomes difficult and demanding in multi-cloud systems because of the variety of billing models and resource kinds, as well as the susceptibility of processes to time limitations. In which the execution duration of the workflow needs to be flexibly adjusted according to the urgency or otherwise of the real situation, in this work, we model the workflow scheduling problem with deadline constraints as a dynamically constrained multi-objective optimization problem (DCMOP), where the disruption rate of the special cloud resources and the failure probability in different cloud environments are expressed as the disruption probability of the workflow in a comprehensive manner while considering the execution time and cost. Dynamics arise from price changes for specialized cloud resources and changes in the execution duration of workflows. In addition, an algorithm for dynamically constrained multi-objective optimization (DC-MOEADPDS) is proposed in this paper. The algorithm based on two-population synergy as well as diversity selection. The auxiliary population ignores constraint limitations to help the main population speed up convergence, and diversity selection enables the auxiliary population to have better diversity to assist the general public in looking for more viable areas. Through dynamic constrained workflow simulation experiments in a multi-cloud environment, our algorithm reduces the execution time by an average of 13.29%, the cost by an average of 32.26%, and the interruption probability by 56.75%. In addition, our algorithm outperforms other algorithms in experiments on a dynamically constrained benchmark set.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Dynamic neighborhood grouping-based multi-objective scheduling algorithm for workflow in hybrid cloud
    Guo, Yulin
    Liu, Bo
    Lin, Weiwei
    Ye, Xiaoying
    Wang, James Z.
    [J]. Future Generation Computer Systems, 2025, 166
  • [42] Neural network based multi-objective evolutionary algorithm for dynamic workflow scheduling in cloud computing
    Ismayilov, Goshgar
    Topcuoglu, Haluk Rahmi
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 102 : 307 - 322
  • [43] Heuristic and Meta-heuristic Workflow Scheduling Algorithms in Multi-Cloud Environments - A Survey
    Nandhakumar, C.
    Ranjithprabhu, K.
    [J]. ICACCS 2015 PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING & COMMUNICATION SYSTEMS, 2015,
  • [44] A Deadline-constrained Scheduling for Dynamic Multi-instances Parameter Sweep Workflow
    Viriyapant, Kanchana
    Smanchat, Sucha
    [J]. 2016 IEEE/ACIS 15TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS), 2016, : 577 - 582
  • [45] Multi-objective optimization for fuzzy workflow scheduling
    Zhu, Jie
    Zhang, Jing
    Lu, Chang
    Huang, Haiping
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2800 - 2805
  • [46] Ensuring Truthfulness for Scheduling Multi-objective Real Time Tasks in Multi Cloud Environments
    Geethanjali, M.
    Sujana, J. Angela Jennifa
    Revathi, T.
    [J]. 2014 INTERNATIONAL CONFERENCE ON RECENT TRENDS IN INFORMATION TECHNOLOGY (ICRTIT), 2014,
  • [47] Knowledge-based multi-objective estimation of distribution algorithm for solving reliability constrained cloud workflow scheduling
    Li, Ming
    Pi, Dechang
    Qin, Shuo
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (02): : 1401 - 1419
  • [48] Knowledge-based multi-objective estimation of distribution algorithm for solving reliability constrained cloud workflow scheduling
    Ming Li
    Dechang Pi
    Shuo Qin
    [J]. Cluster Computing, 2024, 27 : 1401 - 1419
  • [49] Multi-objective dynamic management of virtual machines in cloud environments
    Mahdi Mollamotalebi
    Shahnaz Hajireza
    [J]. Journal of Cloud Computing, 6
  • [50] Multi-objective dynamic management of virtual machines in cloud environments
    Mollamotalebi, Mahdi
    Hajireza, Shahnaz
    [J]. JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2017, 6