Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

被引:4
|
作者
Zhou, Ping [1 ]
Wu, Gaoxiang [1 ]
Alzahrani, Bander [2 ]
Barnawi, Ahmed [2 ]
Alhindi, Ahmad [3 ]
Chen, Min [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan, Peoples R China
[2] King Abdulaziz Univ, Fac Comp & Informat Technol, Jeddah, Saudi Arabia
[3] Umm Al Qura Univ, Dept Comp Sci, Mecca, Saudi Arabia
关键词
Collaborative Cloud-Edge Computing; Multi-Edge Cloud; Task Placement; Resource Allocation; Reinforcement Learning; Crowd Management; IOT; SUPPORT;
D O I
10.1109/GLOBECOM46510.2021.9685049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advantage of being close to the network, edge cloud-enabled computing mode brings flexibility to task scheduling. However, with the heterogeneity of computing resources between cloud and edge cloud, and the complexity of computing and communication processes between multi-edge cloud, challenges have been brought to the deployment and computing of tasks in cloud-edge collaborative environments. In order to solve this challenge, firstly a deep reinforcement learning controller based cloud-edge collaborative computing framework has been proposed. Then a system QoS model has been established considering both the user benefits and the service provider benefits. By using deep Q-network, a deep reinforcement learning based collaborative task placement algorithm has been proposed for dynamically optimizing the target system utility. Finally, the experimental results show that the proposed method has a good learning ability for the computing cost of cloud and edge cloud as well as the communication cost between multi-edge cloud. In addition, compared with Q-table learning, random computing and cloud computing, a 10% improvement of system utility has been achieved with the proposed method.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] DeepEdge: A Deep Reinforcement Learning Based Task Orchestrator for Edge Computing
    Yamansavascilar, Baris
    Baktir, Ahmet Cihat
    Sonmez, Cagatay
    Ozgovde, Atay
    Ersoy, Cem
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (01): : 538 - 552
  • [42] Graph Convolutional Reinforcement Learning for Dependent Task Allocation in Edge Computing
    Ding, Shiyao
    Lin, Donghui
    Zhou, Xin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON AGENTS (ICA 2021), 2021, : 25 - 30
  • [43] An intelligent task scheduling approach for the enhancement of collaborative learning in cloud computing
    Sathishkumar, P.
    Kumar, Narendra
    Raju, S. Hrushikesava
    Victoria, D. Rosy Salomi
    [J]. SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2024, 43
  • [44] Collaborative Service Placement, Task Scheduling, and Resource Allocation for Task Offloading With Edge-Cloud Cooperation
    Fan, Wenhao
    Zhao, Liang
    Liu, Xun
    Su, Yi
    Li, Shenmeng
    Wu, Fan
    Liu, Yuan'an
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) : 238 - 256
  • [45] Private Computing Offloading in Edge Cloud via Collaborative Online Learning
    Wang, Lin
    Yang, Lei
    Zhang, Mingchuan
    Zhang, Jianxin
    Cao, Zhibin
    Wu, Qingtao
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [46] Security of federated learning for cloud-edge intelligence collaborative computing
    Yang, Jie
    Zheng, Jun
    Zhang, Zheng
    Chen, Q., I
    Wong, Duncan S.
    Li, Yuanzhang
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (11) : 9290 - 9308
  • [47] Collaborative Framework of Accelerating Reinforcement Learning Training with Supervised Learning Based on Edge Computing
    Lin, Yu-Shan
    Lai, Chin-Feng
    Chuang, Chieh-Lin
    Ge, Xiaohu
    Chao, Han-Chieh
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (02): : 229 - 238
  • [49] IoT Application Modules Placement and Dynamic Task Processing in Edge-Cloud Computing
    Fang, Juan
    Ma, Aonan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (16) : 12771 - 12781
  • [50] Optimization of Edge-Cloud Collaborative Computing Resource Management for Internet of Vehicles Based on Multiagent Deep Reinforcement Learning
    Zhang, Tianrong
    Wu, Fan
    Chen, Zeyu
    Chen, Senyang
    [J]. IEEE Internet of Things Journal, 2024, 11 (22) : 36114 - 36126