Dynamic deadline constrained multi-objective workflow scheduling in multi-cloud environments

被引:0
|
作者
Cai, Xingjuan [1 ,2 ]
Zhang, Yan [1 ]
Li, Mengxia [1 ]
Wu, Linjie [1 ]
Zhang, Wensheng [3 ]
Chen, Jinjun [4 ]
机构
[1] Taiyuan Univ Sci & Technol, Shanxi Key Lab Big Data Anal & Parallel Comp, Taiyuan 030024, Shanxi, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing, Peoples R China
[4] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
Multi-cloud; Dynamically constrained multi-objective; optimization; Workflow scheduling; Outage rates; Deadline constraints; ALGORITHM; SPOT;
D O I
10.1016/j.eswa.2024.125168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Workflow scheduling becomes difficult and demanding in multi-cloud systems because of the variety of billing models and resource kinds, as well as the susceptibility of processes to time limitations. In which the execution duration of the workflow needs to be flexibly adjusted according to the urgency or otherwise of the real situation, in this work, we model the workflow scheduling problem with deadline constraints as a dynamically constrained multi-objective optimization problem (DCMOP), where the disruption rate of the special cloud resources and the failure probability in different cloud environments are expressed as the disruption probability of the workflow in a comprehensive manner while considering the execution time and cost. Dynamics arise from price changes for specialized cloud resources and changes in the execution duration of workflows. In addition, an algorithm for dynamically constrained multi-objective optimization (DC-MOEADPDS) is proposed in this paper. The algorithm based on two-population synergy as well as diversity selection. The auxiliary population ignores constraint limitations to help the main population speed up convergence, and diversity selection enables the auxiliary population to have better diversity to assist the general public in looking for more viable areas. Through dynamic constrained workflow simulation experiments in a multi-cloud environment, our algorithm reduces the execution time by an average of 13.29%, the cost by an average of 32.26%, and the interruption probability by 56.75%. In addition, our algorithm outperforms other algorithms in experiments on a dynamically constrained benchmark set.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Integer linear programming-based multi-objective scheduling for scientific workflows in multi-cloud environments
    Somayeh Mohammadi
    Latif PourKarimi
    Hossein Pedram
    [J]. The Journal of Supercomputing, 2019, 75 : 6683 - 6709
  • [22] Dynamic Multi-Objective Workflow Scheduling for Cloud Computing Based on Evolutionary Algorithms
    Ismayilov, Goshgar
    Topcuoglu, Haluk Rahmi
    [J]. 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION), 2018, : 103 - 108
  • [23] Multi-Objective Approach for Energy-Aware Workflow Scheduling in Cloud Computing Environments
    Yassa, Sonia
    Chelouah, Rachid
    Kadima, Hubert
    Granado, Bertrand
    [J]. SCIENTIFIC WORLD JOURNAL, 2013,
  • [24] Multi-objective secure task scheduling based on SLA in multi-cloud environment
    Jawade, Prashant Balkrishna
    Ramachandram, S.
    [J]. MULTIAGENT AND GRID SYSTEMS, 2022, 18 (01) : 65 - 85
  • [25] Dynamic Multi-objective Scheduling of Microservices in the Cloud
    Fard, Hamid Mohammadi
    Prodan, Radu
    Wolf, Felix
    [J]. 2020 IEEE/ACM 13TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC 2020), 2020, : 386 - 393
  • [26] Evolutionary Multi-Objective Workflow Scheduling for Volatile Resources in the Cloud
    Pham, Thanh-Phuong
    Fahringer, Thomas
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (03) : 1780 - 1791
  • [27] MONWS: Multi-Objective Normalization Workflow Scheduling for Cloud Computing
    Pillareddy, Vamsheedhar Reddy
    Karri, Ganesh Reddy
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [28] An Improved Multi-Objective Optimization for Workflow Scheduling in Cloud Platform
    Prathibha, Soma
    Latha, B.
    Sumathi, G.
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2017, 18 (03): : 589 - 599
  • [29] A New Double Rank-based Multi-workflow Scheduling with Multi-objective Optimization in Cloud Environments
    Li, Feng
    Seok, Moon Gi
    Cai, Wentong
    [J]. 2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 36 - 45
  • [30] Adaptive Resource Allocation and Consolidation for Scientific Workflow Scheduling in Multi-Cloud Environments
    Chen, Zheyi
    Lin, Kai
    Lin, Bing
    Chen, Xing
    Zheng, Xianghan
    Rong, Chunming
    [J]. IEEE ACCESS, 2020, 8 : 190173 - 190183