Multi Objective Prioritized Workflow Scheduling Using Deep Reinforcement Based Learning in Cloud Computing

被引:0
|
作者
Mangalampalli, Sudheer [1 ]
Hashmi, Syed Shakeel [2 ]
Gupta, Amit [3 ]
Karri, Ganesh Reddy [1 ]
Rajkumar, K. Varada [4 ]
Chakrabarti, Tulika [5 ]
Chakrabarti, Prasun [6 ]
Margala, Martin [7 ]
机构
[1] VIT AP Univ, Sch Comp Sci & Engn, Amaravati 522237, Andhra Pradesh, India
[2] ICFAI Fdn Higher Educ Deemed Univ, Fac Sci & Technol IcfaiTech, Dept Elect & Commun Engn, Hyderabad 501203, Telangana, India
[3] JB Inst Engn & Technol, Dept AI & ML, Hyderabad 500075, Telangana, India
[4] MLR Inst Technol, Dept Comp Sci & Engn, Hyderabad 500043, Telangana, India
[5] Sir Padampat Singhania Univ, Dept Basic Sci, Udaipur 313601, Rajasthan, India
[6] Sir Padampat Singhania Univ, Dept Comp Sci & Engn, Udaipur 313601, Rajasthan, India
[7] Univ Louisiana Lafayette, Sch Comp & Informat, Lafayette, LA USA
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Deep reinforcement learning; cloud computing; workflow scheduling; task dependencies; makespan; energy consumption;
D O I
10.1109/ACCESS.2024.3350741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Workflow Scheduling is a huge challenge in cloud paradigm as many number of workflows dynamically generated from various heterogeneous resources and task dependencies in each workflow varies from each other. Therefore, if a workflow with more number of dependencies is not scheduled onto an appropriate Virtual Machine i.e. with low processing capacity which leads to delay in executing workflows and it results in increase of makespan, cost, energy consumption. In order to effectively schedule complex workflows i.e. with more task dependencies, we propose a novel multi objective workflow scheduling algorithm using Deep reinforcement Learning. Initially, priorities of all workflows calculated based on their dependencies and then calculated priorities of VMs based on electricity cost at datacenters to map workflows onto precise VMs. These priorities are fed to scheduler which uses Deep Q-Network model to dynamically schedule tasks by considering both priorities of tasks and VMs. Extensive simulations carried out on workflowsim by considering realtime scientific workflows (Montage, cybershake, Epigenomics, LIGO). Our proposed MOPWSDRL compared against existing state of art approaches i.e. Heterogeneous Earliest First Deadline, Cat Swarm Optimization, Ant Colony Optimization. Results revealed that our proposed MOPDSWRL outperforms existing state of art algorithms by minimizing makespan, energy consumption.
引用
收藏
页码:5373 / 5392
页数:20
相关论文
共 50 条
  • [41] Multi-Objective Task and Workflow Scheduling Approaches in Cloud Computing: a Comprehensive Review
    Mehdi Hosseinzadeh
    Marwan Yassin Ghafour
    Hawkar Kamaran Hama
    Bay Vo
    Afsane Khoshnevis
    [J]. Journal of Grid Computing, 2020, 18 : 327 - 356
  • [42] Decomposition Based Multi-objective Workflow Scheduling for Cloud Environments
    Bugingo, Emmanuel
    Zheng, Wei
    Zhang, Dongzhan
    Qin, Yingsheng
    Zhang, Defu
    [J]. 2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, : 37 - 42
  • [43] Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing
    Wang, Yugui
    Dong, Shizhong
    Fan, Weibei
    [J]. MATHEMATICS, 2023, 11 (15)
  • [44] Evolutionary Multi-Objective Workflow Scheduling in Cloud
    Zhu, Zhaomeng
    Zhang, Gongxuan
    Li, Miqing
    Liu, Xiaohui
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2016, 27 (05) : 1344 - 1357
  • [45] Multi-objective optimal scheduling of charging stations based on deep reinforcement learning
    Cui, Feifei
    Lin, Xixiang
    Zhang, Ruining
    Yang, Qingyu
    [J]. FRONTIERS IN ENERGY RESEARCH, 2023, 10
  • [46] Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning
    Cheng, Yuqing
    Cao, Zhiying
    Zhang, Xiuguo
    Cao, Qilei
    Zhang, Dezhen
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (05): : 6917 - 6945
  • [47] Optimized intellectual resource scheduling using deep reinforcement Q-learning in cloud computing
    Uma, J.
    Vivekanandan, P.
    Shankar, S.
    [J]. TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (05):
  • [48] Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning
    Yuqing Cheng
    Zhiying Cao
    Xiuguo Zhang
    Qilei Cao
    Dezhen Zhang
    [J]. The Journal of Supercomputing, 2024, 80 : 6917 - 6945
  • [49] Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical Cloud computing
    Zhou G.
    Wen R.
    Tian W.
    Buyya R.
    [J]. Journal of Network and Computer Applications, 2022, 208
  • [50] Enhanced hybrid multi-objective workflow scheduling approach based artificial bee colony in cloud computing
    Zeedan, Maha
    Attiya, Gamal
    El-Fishawy, Nawal
    [J]. COMPUTING, 2023, 105 (01) : 217 - 247