Dynamic deadline constrained multi-objective workflow scheduling in multi-cloud environments

被引:0
|
作者
Cai, Xingjuan [1 ,2 ]
Zhang, Yan [1 ]
Li, Mengxia [1 ]
Wu, Linjie [1 ]
Zhang, Wensheng [3 ]
Chen, Jinjun [4 ]
机构
[1] Taiyuan Univ Sci & Technol, Shanxi Key Lab Big Data Anal & Parallel Comp, Taiyuan 030024, Shanxi, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing, Peoples R China
[4] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
Multi-cloud; Dynamically constrained multi-objective; optimization; Workflow scheduling; Outage rates; Deadline constraints; ALGORITHM; SPOT;
D O I
10.1016/j.eswa.2024.125168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Workflow scheduling becomes difficult and demanding in multi-cloud systems because of the variety of billing models and resource kinds, as well as the susceptibility of processes to time limitations. In which the execution duration of the workflow needs to be flexibly adjusted according to the urgency or otherwise of the real situation, in this work, we model the workflow scheduling problem with deadline constraints as a dynamically constrained multi-objective optimization problem (DCMOP), where the disruption rate of the special cloud resources and the failure probability in different cloud environments are expressed as the disruption probability of the workflow in a comprehensive manner while considering the execution time and cost. Dynamics arise from price changes for specialized cloud resources and changes in the execution duration of workflows. In addition, an algorithm for dynamically constrained multi-objective optimization (DC-MOEADPDS) is proposed in this paper. The algorithm based on two-population synergy as well as diversity selection. The auxiliary population ignores constraint limitations to help the main population speed up convergence, and diversity selection enables the auxiliary population to have better diversity to assist the general public in looking for more viable areas. Through dynamic constrained workflow simulation experiments in a multi-cloud environment, our algorithm reduces the execution time by an average of 13.29%, the cost by an average of 32.26%, and the interruption probability by 56.75%. In addition, our algorithm outperforms other algorithms in experiments on a dynamically constrained benchmark set.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Multi-Objective Workflow Scheduling to Serverless Architecture in a Multi-Cloud Environment
    Ramesh, Manju
    Chahal, Dheeraj
    Phalak, Chetan
    Singhal, Rekha
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING, IC2E, 2023, : 173 - 183
  • [2] A Deadline-Constrained Multi-Objective Task Scheduling Algorithm in Mobile Cloud Environments
    Liu, Li
    Fan, Qi
    Buyya, Rajkumar
    [J]. IEEE ACCESS, 2018, 6 : 52982 - 52996
  • [3] Decomposition Based Multi-objective Workflow Scheduling for Cloud Environments
    Bugingo, Emmanuel
    Zheng, Wei
    Zhang, Dongzhan
    Qin, Yingsheng
    Zhang, Defu
    [J]. 2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, : 37 - 42
  • [4] Dynamic multi-objective workflow scheduling for combined resources in cloud
    Zhang, Yan
    Wu, Linjie
    Li, Mengxia
    Zhao, Tianhao
    Cai, Xingjuan
    [J]. SIMULATION MODELLING PRACTICE AND THEORY, 2023, 129
  • [5] Scientific workflow scheduling in multi-cloud computing using a hybrid multi-objective optimization algorithm
    Ali Mohammadzadeh
    Mohammad Masdari
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 3509 - 3529
  • [6] Scientific workflow scheduling in multi-cloud computing using a hybrid multi-objective optimization algorithm
    Mohammadzadeh, Ali
    Masdari, Mohammad
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 14 (4) : 3509 - 3529
  • [7] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Qin, Yao
    Wang, Hua
    Yi, Shanwen
    Li, Xiaole
    Zhai, Linbo
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (05)
  • [8] Multi-objective approach of energy efficient workflow scheduling in cloud environments
    Rehman, Attiqa
    Hussain, Syed S.
    Rehman, Zia Ur
    Zia, Seemal
    Shamshirband, Shahaboddin
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (08):
  • [9] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Yao QIN
    Hua WANG
    Shanwen YI
    Xiaole LI
    Linbo ZHAI
    [J]. Frontiers of Computer Science., 2021, (05) - 12
  • [10] A multi-objective reinforcement learning algorithm for deadline constrained scientific workflow scheduling in clouds
    Yao Qin
    Hua Wang
    Shanwen Yi
    Xiaole Li
    Linbo Zhai
    [J]. Frontiers of Computer Science, 2021, 15