Task Scheduling in Cloud Using Deep Reinforcement Learning

被引:26
|
作者
Swarup, Shashank [1 ]
Shakshuki, Elhadi M. [1 ]
Yasar, Ansar [2 ]
机构
[1] Acadia Univ, Jodrey Sch Comp Sci, Wolfville, NS B4P 2R6, Canada
[2] Hasselt Univ, Transportat Res Inst, B-3500 Hasselt, Belgium
关键词
task scheduling; computational cost; energy consumption; deep reinforcement learning; Clipped Double Deep Q-learning (CDDQL);
D O I
10.1016/j.procs.2021.03.016
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing is an emerging technology used in many applications such as data analysis, storage, and Internet of Things (IoT). Due to the increasing number of users in the cloud and the IoT devices that are being integrated with the cloud, the amount of data generated by these users and these devices is increasing ceaselessly. Managing this data over the cloud is no longer an easy task. It is almost impossible to move all data to the cloud datacenters, and this will lead to excessive bandwidth usage, latency, cost, and energy consumption. This makes it evident that allocating resources to users' tasks is an essential quality feature in cloud computing. This is because it provides the customers or the users with high Quality of Service (Qo S) with the best response time, and it also respects the established Service Level Agreement. Therefore, there is a great importance of efficient utilization of computing resources for which an optimal strategy for task scheduling is required. This paper focuses on the problem of task scheduling of cloud-based applications and aims to minimize the computational cost under resource and deadline constraints. Towards this end, we propose a clipped double deep Q-learning algorithm utilizing the target network and experience relay techniques, as we as using the reinforcement learning approach. (C) 2021 The Authors. Published by Elsevier B.V.
引用
收藏
页码:42 / 51
页数:10
相关论文
共 50 条
  • [1] Task scheduling based on deep reinforcement learning in a cloud manufacturing environment
    Dong, Tingting
    Xue, Fei
    Xiao, Chuangbai
    Li, Juntao
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11):
  • [2] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    K. Siddesha
    G. V. Jayaramaiah
    Chandrapal Singh
    [J]. Cluster Computing, 2022, 25 : 4171 - 4188
  • [3] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    Siddesha, K.
    Jayaramaiah, G. V.
    Singh, Chandrapal
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 4171 - 4188
  • [4] Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning
    Ping, Yaoyao
    Liu, Yongkui
    Zhang, Lin
    Wang, Lihui
    Xu, Xun
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2023, 67 : 315 - 337
  • [5] Hybrid Task Scheduling in Cloud Manufacturing With Sparse-Reward Deep Reinforcement Learning
    Wang, Xiaohan
    Laili, Yuanjun
    Zhang, Lin
    Liu, Yongkui
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 1 - 15
  • [6] DRLBTSA: Deep reinforcement learning based task-scheduling algorithm in cloud computing
    Mangalampalli, Sudheer
    Karri, Ganesh Reddy
    Kumar, Mohit
    Khalaf, Osama Ibrahim
    Romero, Carlos Andres Tavera
    Sahib, GhaidaMuttashar Abdul
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 8359 - 8387
  • [7] Logistics-involved task scheduling in cloud manufacturing with offline deep reinforcement learning
    Wang, Xiaohan
    Zhang, Lin
    Liu, Yongkui
    Zhao, Chun
    [J]. JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2023, 34
  • [8] DRLBTSA: Deep reinforcement learning based task-scheduling algorithm in cloud computing
    Sudheer Mangalampalli
    Ganesh Reddy Karri
    Mohit Kumar
    Osama Ibrahim Khalaf
    Carlos Andres Tavera Romero
    GhaidaMuttashar Abdul Sahib
    [J]. Multimedia Tools and Applications, 2024, 83 : 8359 - 8387
  • [9] An improved deep reinforcement learning-based scheduling approach for dynamic task scheduling in cloud manufacturing
    Wang, Xiaohan
    Zhang, Lin
    Liu, Yongkui
    Laili, Yuanjun
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024, 62 (11) : 4014 - 4030
  • [10] Resource Scheduling for Offline Cloud Computing Using Deep Reinforcement Learning
    El-Boghdadi, Hatem M.
    Ramadan, Rabie A.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (04): : 54 - 60