Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning

被引:6
|
作者
Cheng, Yuqing [1 ]
Cao, Zhiying [1 ]
Zhang, Xiuguo [1 ]
Cao, Qilei [2 ]
Zhang, Dezhen [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264003, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 05期
关键词
Edge computing; Deep reinforcement learning; Task scheduling; EDGE; SIMULATION; TOOLKIT; ENERGY;
D O I
10.1007/s11227-023-05714-1
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the stochastic and dynamic edge-cloud collaborative environment, the computing resources of the host are limited, and the resource requirements of computing tasks are random and changeable. Therefore, how to efficiently schedule dynamic tasks and improve system performance becomes challenging. The scheduling algorithm based on deep reinforcement learning optimizes the delay and energy consumption of the system by dynamically interacting with the environment, which can solve the problem of dynamic and changeable environment to a certain extent, but there are still problems such as poor model adaptability, low training efficiency, and unbalanced system load. In this paper, aiming at optimizing the average response time of task scheduling and the average energy consumption of the system, a multi-objective task scheduling model is designed, and a task scheduling policy optimization algorithm based on improved asynchronous advantage actor-critic (A3C) is proposed. The residual convolutional neural network (RCNN) improves the network structure of A3C, using asynchronous multi-threaded training methods to interact with the edge-cloud collaborative environment and capturing the random dynamic characteristics of resources required for computing tasks and heterogeneous edge-cloud hosts resource change characteristics to better adapt to random dynamic environments, and it can quickly updating network parameters, improving training speed, and make full use of host resources to solve system load imbalance problems. Simulation results show that the scheduling algorithm proposed in this paper can effectively reduce task response time and system energy consumption in an edge-cloud collaborative environment.
引用
收藏
页码:6917 / 6945
页数:29
相关论文
共 50 条
  • [41] Deep reinforcement learning optimization scheduling algorithm for continuous production line
    Zhu, Guang-He
    Zhu, Zhi-Qiang
    Yuan, Yi-Ping
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (07): : 2086 - 2092
  • [42] A reinforcement learning-based multi-objective optimization in an interval and dynamic environment
    Xu, Yue
    Song, Yuxuan
    Pi, Dechang
    Chen, Yang
    Qin, Shuo
    Zhang, Xiaoge
    Yang, Shengxiang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [43] Particle swarm optimization based multi-task parallel reinforcement learning algorithm
    Duan Junhua
    Zhu Yi-an
    Zhong Dong
    Zhang Lixiang
    Zhang Lin
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 37 (06) : 8567 - 8575
  • [44] Reinforcement Learning in Dynamic Task Scheduling: A Review
    Shyalika C.
    Silva T.
    Karunananda A.
    [J]. SN Computer Science, 2020, 1 (6)
  • [45] Multi-objective Task Scheduling Optimization in Cloud Computing based on Genetic Algorithm and Differential Evolution Algorithm
    Li, Yuqing
    Wang, Shichuan
    Hong, Xin
    Li, Yongzhi
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 4489 - 4494
  • [46] Multi-Objective Optimization of a Task-Scheduling Algorithm for a Secure Cloud
    Li, Wei
    Fan, Qi
    Dang, Fangfang
    Jiang, Yuan
    Wang, Haomin
    Li, Shuai
    Zhang, Xiaoliang
    [J]. INFORMATION, 2022, 13 (02)
  • [47] Task scheduling based on deep reinforcement learning in a cloud manufacturing environment
    Dong, Tingting
    Xue, Fei
    Xiao, Chuangbai
    Li, Juntao
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11):
  • [48] Deep Reinforcement Learning Based Task Scheduling in Edge Computing Networks
    Qi, Fan
    Li Zhuo
    Chen Xin
    [J]. 2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 835 - 840
  • [49] Dynamic optimization of wastewater treatment process based on novel multi-objective ant lion optimization and deep learning algorithm
    Niu, Guoqiang
    Li, Xiaoyong
    Wan, Xin
    He, Xinzhong
    Zhao, Yinzhong
    Yi, Xiaohui
    Chen, Chen
    Xujun, Liang
    Ying, Guangguo
    Huang, Mingzhi
    [J]. JOURNAL OF CLEANER PRODUCTION, 2022, 345
  • [50] Deep Reinforcement Learning Based Multistage Profit Aware Task Scheduling Algorithm for Computing Power Network
    Huang, Xiaoyao
    Liu, Remington R.
    Lei, Bo
    Huang, Guanglun
    Zhang, Baoxian
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3524 - 3529