Multi Objective Prioritized Workflow Scheduling Using Deep Reinforcement Based Learning in Cloud Computing

被引:0
|
作者
Mangalampalli, Sudheer [1 ]
Hashmi, Syed Shakeel [2 ]
Gupta, Amit [3 ]
Karri, Ganesh Reddy [1 ]
Rajkumar, K. Varada [4 ]
Chakrabarti, Tulika [5 ]
Chakrabarti, Prasun [6 ]
Margala, Martin [7 ]
机构
[1] VIT AP Univ, Sch Comp Sci & Engn, Amaravati 522237, Andhra Pradesh, India
[2] ICFAI Fdn Higher Educ Deemed Univ, Fac Sci & Technol IcfaiTech, Dept Elect & Commun Engn, Hyderabad 501203, Telangana, India
[3] JB Inst Engn & Technol, Dept AI & ML, Hyderabad 500075, Telangana, India
[4] MLR Inst Technol, Dept Comp Sci & Engn, Hyderabad 500043, Telangana, India
[5] Sir Padampat Singhania Univ, Dept Basic Sci, Udaipur 313601, Rajasthan, India
[6] Sir Padampat Singhania Univ, Dept Comp Sci & Engn, Udaipur 313601, Rajasthan, India
[7] Univ Louisiana Lafayette, Sch Comp & Informat, Lafayette, LA USA
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Deep reinforcement learning; cloud computing; workflow scheduling; task dependencies; makespan; energy consumption;
D O I
10.1109/ACCESS.2024.3350741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Workflow Scheduling is a huge challenge in cloud paradigm as many number of workflows dynamically generated from various heterogeneous resources and task dependencies in each workflow varies from each other. Therefore, if a workflow with more number of dependencies is not scheduled onto an appropriate Virtual Machine i.e. with low processing capacity which leads to delay in executing workflows and it results in increase of makespan, cost, energy consumption. In order to effectively schedule complex workflows i.e. with more task dependencies, we propose a novel multi objective workflow scheduling algorithm using Deep reinforcement Learning. Initially, priorities of all workflows calculated based on their dependencies and then calculated priorities of VMs based on electricity cost at datacenters to map workflows onto precise VMs. These priorities are fed to scheduler which uses Deep Q-Network model to dynamically schedule tasks by considering both priorities of tasks and VMs. Extensive simulations carried out on workflowsim by considering realtime scientific workflows (Montage, cybershake, Epigenomics, LIGO). Our proposed MOPWSDRL compared against existing state of art approaches i.e. Heterogeneous Earliest First Deadline, Cat Swarm Optimization, Ant Colony Optimization. Results revealed that our proposed MOPDSWRL outperforms existing state of art algorithms by minimizing makespan, energy consumption.
引用
收藏
页码:5373 / 5392
页数:20
相关论文
共 50 条
  • [1] Multi Objective Prioritized Workflow Scheduling Using Deep Reinforcement Based Learning in Cloud Computing
    Mangalampalli, Sudheer
    Hashmi, Syed Shakeel
    Gupta, Amit
    Karri, Ganesh Reddy
    Rajkumar, K. Varada
    Chakrabarti, Tulika
    Chakrabarti, Prasun
    Margala, Martin
    [J]. IEEE Access, 2024, 12 : 5373 - 5392
  • [2] Workflow scheduling based on deep reinforcement learning in the cloud environment
    Tingting Dong
    Fei Xue
    Chuangbai Xiao
    Jiangjiang Zhang
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2021, 12 : 10823 - 10835
  • [3] Workflow scheduling based on deep reinforcement learning in the cloud environment
    Dong, Tingting
    Xue, Fei
    Xiao, Chuangbai
    Zhang, Jiangjiang
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (12) : 10823 - 10835
  • [4] Optimizing Multi Objective Based Workflow Scheduling in Cloud Computing Using Black Hole Algorithm
    Ebadifard, Fatemeh
    Babamir, Seyed Morteza
    [J]. 2017 3RD INTERNATIONAL CONFERENCE ON WEB RESEARCH (ICWR), 2017, : 102 - 108
  • [5] Weighted double deep Q-network based reinforcement learning for bi-objective multi-workflow scheduling in the cloud
    Li, Huifang
    Huang, Jianghang
    Wang, Binyang
    Fan, Yushun
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (02): : 751 - 768
  • [6] Weighted double deep Q-network based reinforcement learning for bi-objective multi-workflow scheduling in the cloud
    Huifang Li
    Jianghang Huang
    Binyang Wang
    Yushun Fan
    [J]. Cluster Computing, 2022, 25 : 751 - 768
  • [7] Resource Scheduling for Offline Cloud Computing Using Deep Reinforcement Learning
    El-Boghdadi, Hatem M.
    Ramadan, Rabie A.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (04): : 54 - 60
  • [8] Deep Reinforcement Learning for Dynamic Workflow Scheduling in Cloud Environment
    Dong, Tingting
    Xue, Fei
    Xiao, Changbai
    Zhang, Jiangjiang
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2021), 2021, : 107 - 115
  • [9] Multiobjective Prioritized Workflow Scheduling in Cloud Computing Using Cuckoo Search Algorithm
    Sahu, Babuli
    Swain, Sangram Keshari
    Mangalampalli, Sudheer
    Mishra, Satyasis
    [J]. APPLIED BIONICS AND BIOMECHANICS, 2023, 2023
  • [10] MOWS: Multi-objective workflow scheduling in cloud computing based on heuristic algorithm
    Abazari, Farzaneh
    Analoui, Morteza
    Takabi, Hassan
    Fu, Song
    [J]. SIMULATION MODELLING PRACTICE AND THEORY, 2019, 93 : 119 - 132