Multi objective dynamic task scheduling optimization algorithm based on deep reinforcement learning

被引:6
|
作者
Cheng, Yuqing [1 ]
Cao, Zhiying [1 ]
Zhang, Xiuguo [1 ]
Cao, Qilei [2 ]
Zhang, Dezhen [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264003, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 05期
关键词
Edge computing; Deep reinforcement learning; Task scheduling; EDGE; SIMULATION; TOOLKIT; ENERGY;
D O I
10.1007/s11227-023-05714-1
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the stochastic and dynamic edge-cloud collaborative environment, the computing resources of the host are limited, and the resource requirements of computing tasks are random and changeable. Therefore, how to efficiently schedule dynamic tasks and improve system performance becomes challenging. The scheduling algorithm based on deep reinforcement learning optimizes the delay and energy consumption of the system by dynamically interacting with the environment, which can solve the problem of dynamic and changeable environment to a certain extent, but there are still problems such as poor model adaptability, low training efficiency, and unbalanced system load. In this paper, aiming at optimizing the average response time of task scheduling and the average energy consumption of the system, a multi-objective task scheduling model is designed, and a task scheduling policy optimization algorithm based on improved asynchronous advantage actor-critic (A3C) is proposed. The residual convolutional neural network (RCNN) improves the network structure of A3C, using asynchronous multi-threaded training methods to interact with the edge-cloud collaborative environment and capturing the random dynamic characteristics of resources required for computing tasks and heterogeneous edge-cloud hosts resource change characteristics to better adapt to random dynamic environments, and it can quickly updating network parameters, improving training speed, and make full use of host resources to solve system load imbalance problems. Simulation results show that the scheduling algorithm proposed in this paper can effectively reduce task response time and system energy consumption in an edge-cloud collaborative environment.
引用
收藏
页码:6917 / 6945
页数:29
相关论文
共 50 条
  • [31] An Improved Multi-Objective Deep Reinforcement Learning Algorithm Based on Envelope Update
    Hu, Can
    Zhu, Zhengwei
    Wang, Lijia
    Zhu, Chenyang
    Yang, Yanfei
    [J]. ELECTRONICS, 2022, 11 (16)
  • [32] Multi Objective Prioritized Workflow Scheduling Using Deep Reinforcement Based Learning in Cloud Computing
    Mangalampalli, Sudheer
    Hashmi, Syed Shakeel
    Gupta, Amit
    Karri, Ganesh Reddy
    Rajkumar, K. Varada
    Chakrabarti, Tulika
    Chakrabarti, Prasun
    Margala, Martin
    [J]. IEEE Access, 2024, 12 : 5373 - 5392
  • [33] Dynamic Multi-Objective Evolutionary Algorithm Based on Decomposition for Test Task Scheduling Problem
    Lu, Hui
    Xu, Xin
    Zhang, Mengmeng
    Yin, Lijuan
    [J]. 2015 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2015, : 11 - 18
  • [34] Reinforcement Learning-Based Multi-Objective Optimization for Generation Scheduling in Power Systems
    Ebrie, Awol Seid
    Kim, Young Jin
    [J]. SYSTEMS, 2024, 12 (03):
  • [35] Reinforcement Learning-Based Hybrid Multi-Objective Optimization Algorithm Design
    Palm, Herbert
    Arndt, Lorin
    [J]. INFORMATION, 2023, 14 (05)
  • [36] A novel dynamic multi-objective task scheduling optimization based on Dueling DQN and PER
    Chraibi, Amine
    Ben Alla, Said
    Touhafi, Abdellah
    Ezzati, Abdellah
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 21368 - 21423
  • [37] A novel dynamic multi-objective task scheduling optimization based on Dueling DQN and PER
    Amine Chraibi
    Said Ben Alla
    Abdellah Touhafi
    Abdellah Ezzati
    [J]. The Journal of Supercomputing, 2023, 79 : 21368 - 21423
  • [38] A Deep Reinforcement Learning-Based Algorithm for Multi-Objective Agricultural Site Selection and Logistics Optimization Problem
    Liu, Huan
    Zhang, Jizhe
    Zhou, Zhao
    Dai, Yongqiang
    Qin, Lijing
    [J]. Applied Sciences (Switzerland), 14 (18):
  • [39] A deep reinforcement learning based multi-objective optimization for the scheduling of oxygen production system in integrated iron and steel plants
    Che, Gelegen
    Zhang, Yanyan
    Tang, Lixin
    Zhao, Shengnan
    [J]. APPLIED ENERGY, 2023, 345
  • [40] A Multi-object Optimization Cloud Workflow Scheduling Algorithm Based on Reinforcement Learning
    Wu Jiahao
    Peng Zhiping
    Cui Delong
    Li Qirui
    He Jieguang
    [J]. INTELLIGENT COMPUTING THEORIES AND APPLICATION, PT II, 2018, 10955 : 550 - 559