A Reinforcement Learning-based DAG Tasks Scheduling in Edge-Cloud Collaboration Systems

被引:0
|
作者
Song, Xifei [1 ]
Liu, Lei [1 ,2 ]
Fu, Junqi [1 ]
Zhang, Xueyao [1 ]
Feng, Jie [1 ]
Pei, Qingqi [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510555, Peoples R China
基金
中国国家自然科学基金;
关键词
Task offloading; Reinforcement learning; Deep Q-Network; 6G network; AI;
D O I
10.1109/GLOBECOM54140.2023.10436802
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the continuous development of mobile communication networks and artificial intelligence technology, the number of smart mobile devices has shown an exponential growth trend, and artificial intelligence (AI) jobs have developed unprecedentedly. However, it is difficult for resource-constrained mobile devices to meet the computational demands of these jobs. How to make full use of the dynamic resources in the wireless network to achieve efficient execution of AI jobs is the evolution direction of the next-generation network. To achieve this goal, we model the job as a directed acyclic graph (DAG), partition it into executors based on the type of task, and minimize the execution time of all jobs in 6G wireless networks by optimizing executors deployment. Considering the dynamic features of channel states and DAG topology, the optimization problem is addressed by deep reinforcement learning, i.e., Deep Q-Network (DQN). In the simulation, we manifest the performance of the DQN-based DAG task scheduling in terms of convergence and latency.
引用
收藏
页码:1771 / 1776
页数:6
相关论文
共 50 条
  • [1] SocialEdge: Socialized Learning-Based Request Scheduling for Edge-Cloud Systems
    Wang, Ziwei
    Zhao, Yunfeng
    Qiu, Chao
    He, Qiang
    Wang, Xin
    Wang, Xiaofei
    Hu, Qinghua
    [J]. 2023 IEEE 43RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS, 2023, : 853 - 863
  • [2] Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning
    Sun, Binqi
    Theile, Mirco
    Qin, Ziyuan
    Bernardini, Daniele
    Roy, Debayan
    Bastoni, Andrea
    Caccamo, Marco
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (04) : 1034 - 1047
  • [3] Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System
    Han, Yiwen
    Shen, Shihao
    Wang, Xiaofei
    Wang, Shiqiang
    Leung, Victor C. M.
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [4] Collaborative Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud Network
    Shen, Shihao
    Han, Yiwen
    Wang, Xiaofei
    Wang, Shiqiang
    Leung, Victor C. M.
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (06) : 2950 - 2964
  • [5] A Reinforcement Learning based Edge Cloud Collaboration
    Kobari, Hiroki
    Du, Zhaoyang
    Wu, Celimuge
    Yoshinaga, Tsutomu
    Bao, Wugedele
    [J]. 2021 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES FOR DISASTER MANAGEMENT (ICT-DM), 2021, : 26 - 29
  • [6] Online Scheduling Optimization for DAG-Based Requests Through Reinforcement Learning in Collaboration Edge Networks
    Zhang, Yaqiang
    Zhou, Zhangbing
    Shi, Zhensheng
    Meng, Lin
    Zhang, Zhenjiang
    [J]. IEEE ACCESS, 2020, 8 : 72985 - 72996
  • [7] DMRO: A Deep Meta Reinforcement Learning-Based Task Offloading Framework for Edge-Cloud Computing
    Qu, Guanjin
    Wu, Huaming
    Li, Ruidong
    Jiao, Pengfei
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (03): : 3448 - 3459
  • [8] Learning-Based Joint Optimization of Energy Delay and Privacy in Multiple-User Edge-Cloud Collaboration MEC Systems
    Zhang, Guanglin
    Ni, Sifan
    Zhao, Ping
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (02) : 1491 - 1502
  • [9] Deep reinforcement learning for energy and time optimized scheduling of precedence-constrained tasks in edge-cloud computing environments
    Jayanetti, Amanda
    Halgamuge, Saman
    Buyya, Rajkumar
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 137 : 14 - 30
  • [10] Adaptive DAG Tasks Scheduling with Deep Reinforcement Learning
    Wu, Qing
    Wu, Zhiwei
    Zhuang, Yuehui
    Cheng, Yuxia
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT II, 2018, 11335 : 477 - 490