Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning

被引:6
|
作者
Cheng, Yuqing [1 ]
Cao, Zhiying [1 ]
Zhang, Xiuguo [1 ]
Cao, Qilei [2 ]
Zhang, Dezhen [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264003, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 05期
关键词
Edge computing; Deep reinforcement learning; Task scheduling; EDGE; SIMULATION; TOOLKIT; ENERGY;
D O I
10.1007/s11227-023-05714-1
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the stochastic and dynamic edge-cloud collaborative environment, the computing resources of the host are limited, and the resource requirements of computing tasks are random and changeable. Therefore, how to efficiently schedule dynamic tasks and improve system performance becomes challenging. The scheduling algorithm based on deep reinforcement learning optimizes the delay and energy consumption of the system by dynamically interacting with the environment, which can solve the problem of dynamic and changeable environment to a certain extent, but there are still problems such as poor model adaptability, low training efficiency, and unbalanced system load. In this paper, aiming at optimizing the average response time of task scheduling and the average energy consumption of the system, a multi-objective task scheduling model is designed, and a task scheduling policy optimization algorithm based on improved asynchronous advantage actor-critic (A3C) is proposed. The residual convolutional neural network (RCNN) improves the network structure of A3C, using asynchronous multi-threaded training methods to interact with the edge-cloud collaborative environment and capturing the random dynamic characteristics of resources required for computing tasks and heterogeneous edge-cloud hosts resource change characteristics to better adapt to random dynamic environments, and it can quickly updating network parameters, improving training speed, and make full use of host resources to solve system load imbalance problems. Simulation results show that the scheduling algorithm proposed in this paper can effectively reduce task response time and system energy consumption in an edge-cloud collaborative environment.
引用
收藏
页码:6917 / 6945
页数:29
相关论文
共 50 条
  • [1] Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning
    Yuqing Cheng
    Zhiying Cao
    Xiuguo Zhang
    Qilei Cao
    Dezhen Zhang
    [J]. The Journal of Supercomputing, 2024, 80 : 6917 - 6945
  • [2] Scheduling of Continuous Annealing With a Multi-Objective Differential Evolution Algorithm Based on Deep Reinforcement Learning
    Li, Tianyang
    Meng, Ying
    Tang, Lixin
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (02) : 1767 - 1780
  • [3] An adaptive multi-objective multi-task scheduling method by hierarchical deep reinforcement learning
    Zhang, Jianxiong
    Guo, Bing
    Ding, Xuefeng
    Hu, Dasha
    Tang, Jun
    Du, Ke
    Tang, Chao
    Jiang, Yuming
    [J]. APPLIED SOFT COMPUTING, 2024, 154
  • [4] Dynamic multi-objective scheduling for flexible job shop by deep reinforcement learning
    Luo, Shu
    Zhang, Linxuan
    Fan, Yushun
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 159
  • [5] Deep learning and optimization enabled multi-objective for task scheduling in cloud computing
    Komarasamy, Dinesh
    Ramaganthan, Siva Malar
    Kandaswamy, Dharani Molapalayam
    Mony, Gokuldhev
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2024,
  • [6] An Improved Multi-objective Optimization Algorithm Based on Reinforcement Learning
    Liu, Jun
    Zhou, Yi
    Qiu, Yimin
    Li, Zhongfeng
    [J]. ADVANCES IN SWARM INTELLIGENCE, ICSI 2022, PT I, 2022, : 501 - 513
  • [7] Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach
    Wu, Zufa
    Fan, Hongbo
    Sun, Yimeng
    Peng, Manyu
    [J]. PROCESSES, 2023, 11 (07)
  • [8] A Multi-objective Optimization Algorithm of Task Scheduling in WSN
    Dai, L.
    Xu, H. K.
    Chen, T.
    Qian, C.
    Xie, L. J.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2014, 9 (02) : 160 - 171
  • [9] An Intelligent Scheduling Strategy in Fog Computing System Based on Multi-Objective Deep Reinforcement Learning Algorithm
    Ibrahim, Media Ali
    Askar, Shavan
    [J]. IEEE ACCESS, 2023, 11 : 133607 - 133622
  • [10] Multi-task Deep Reinforcement Learning for Scalable Parallel Task Scheduling
    Zhang, Lingxin
    Qi, Qi
    Wang, Jingyu
    Sun, Haifeng
    Liao, Jianxin
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2992 - 3001