Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

被引:4
|
作者
Zhou, Ping [1 ]
Wu, Gaoxiang [1 ]
Alzahrani, Bander [2 ]
Barnawi, Ahmed [2 ]
Alhindi, Ahmad [3 ]
Chen, Min [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan, Peoples R China
[2] King Abdulaziz Univ, Fac Comp & Informat Technol, Jeddah, Saudi Arabia
[3] Umm Al Qura Univ, Dept Comp Sci, Mecca, Saudi Arabia
关键词
Collaborative Cloud-Edge Computing; Multi-Edge Cloud; Task Placement; Resource Allocation; Reinforcement Learning; Crowd Management; IOT; SUPPORT;
D O I
10.1109/GLOBECOM46510.2021.9685049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advantage of being close to the network, edge cloud-enabled computing mode brings flexibility to task scheduling. However, with the heterogeneity of computing resources between cloud and edge cloud, and the complexity of computing and communication processes between multi-edge cloud, challenges have been brought to the deployment and computing of tasks in cloud-edge collaborative environments. In order to solve this challenge, firstly a deep reinforcement learning controller based cloud-edge collaborative computing framework has been proposed. Then a system QoS model has been established considering both the user benefits and the service provider benefits. By using deep Q-network, a deep reinforcement learning based collaborative task placement algorithm has been proposed for dynamically optimizing the target system utility. Finally, the experimental results show that the proposed method has a good learning ability for the computing cost of cloud and edge cloud as well as the communication cost between multi-edge cloud. In addition, compared with Q-table learning, random computing and cloud computing, a 10% improvement of system utility has been achieved with the proposed method.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning
    Tang, Tiantian
    Li, Chao
    Liu, Fagui
    [J]. COMPUTER COMMUNICATIONS, 2023, 209 : 78 - 90
  • [2] Multi-agent Reinforcement Learning for Task Allocation in Cooperative Edge Cloud Computing
    Ding, Shiyao
    [J]. SERVICE-ORIENTED COMPUTING, ICSOC 2021 WORKSHOPS, 2022, 13236 : 283 - 297
  • [3] Representation and Reinforcement Learning for Task Scheduling in Edge Computing
    Tang, Zhiqing
    Jia, Weijia
    Zhou, Xiaojie
    Yang, Wenmian
    You, Yongjian
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2022, 8 (03) : 795 - 808
  • [4] Asynchronous Deep Reinforcement Learning for Collaborative Task Computing and On-Demand Resource Allocation in Vehicular Edge Computing
    Liu, Lei
    Feng, Jie
    Mu, Xuanyu
    Pei, Qingqi
    Lan, Dapeng
    Xiao, Ming
    [J]. IEEE Transactions on Intelligent Transportation Systems, 2023, 24 (12) : 15513 - 15526
  • [5] Multi-Agent Reinforcement Learning for Cooperative Task Offloading in Distributed Edge Cloud Computing
    Ding, Shiyao
    Lin, Donghui
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (05) : 936 - 945
  • [6] Deep Reinforcement Learning Based Rendering Service Placement for Cloud Gaming in Mobile Edge Computing Systems
    Gao, Yongqiang
    Li, Zhihan
    [J]. 2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 502 - 511
  • [7] Mean Field Game Guided Deep Reinforcement Learning for Task Placement in Cooperative Multiaccess Edge Computing
    Shi, Dian
    Gao, Hao
    Wang, Li
    Pan, Miao
    Han, Zhu
    Poor, H. Vincent
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 9330 - 9340
  • [8] Task Offloading in Computing Continuum Using Collaborative Reinforcement Learning
    Robles-Enciso, Alberto
    Skarmeta, Antonio F.
    [J]. INTERNET OF THINGS, GIOTS 2022, 2022, 13533 : 82 - 95
  • [9] A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing
    Wu, Jiaqi
    Lin, Huang
    Liu, Huaize
    Gao, Lin
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 601 - 606
  • [10] Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks
    Li, Mushu
    Gao, Jie
    Zhao, Lian
    Shen, Xuemin
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (04) : 1122 - 1135