Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

被引:6
|
作者
Bo, Zitong [1 ,2 ]
Qiao, Ying [1 ]
Leng, Chang [1 ]
Wang, Hongan [1 ]
Guo, Chaoping [1 ]
Zhang, Shaohui [3 ]
机构
[1] Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Beijing Natl Speed Skating Oval Operat Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
real-time scheduling; reinforcement learning; multiprocessor system; deep neural network;
D O I
10.1109/RTAS52030.2021.00019
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Designing scheduling policies for multiprocessor real-time systems is challenging since the multiprocessor scheduling problem is NP-complete. The existing heuristics are customized policies that may achieve poor performance under some specific task loads. Thus, a new design pattern is needed to make the multiprocessor scheduling policies perform well under various task loads. In this paper, we investigate a new real-time scheduling policy based on reinforcement learning. For any given real-time task set, our policy can automatically derive a high performance by online learning. Specifically, we model the real-time scheduling process as a multi-agent cooperative game and propose multi-agent self-cooperative learning that overcomes the curse of dimensionality and credit assignment problems. Simulation results show that our approach can learn high-performance policies for various task/system models.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [1] Distributed Real-Time Scheduling in Cloud Manufacturing by Deep Reinforcement Learning
    Zhang, Lixiang
    Yang, Chen
    Yan, Yan
    Hu, Yaoguang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (12) : 8999 - 9007
  • [2] Application of Deep Reinforcement Learning in Real-time Plan Scheduling of Power Grid
    Liu J.
    Song X.
    Yang N.
    Wan X.
    Cai Y.
    Huang Y.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (14): : 157 - 166
  • [3] TTDeep: Time-Triggered Scheduling for Real-Time Ethernet via Deep Reinforcement Learning
    Jia, Hongyu
    Jiang, Yu
    Zhong, Chunmeng
    Wan, Hai
    Zhao, Xibin
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [4] Deep reinforcement learning task scheduling method based on server real-time performance
    Wang, Jinming
    Li, Shaobo
    Zhang, Xingxing
    Wu, Fengbin
    Xie, Cankun
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [5] Real-time dynamic scheduling for garment sewing process based on deep reinforcement learning
    Liu F.
    Xu J.
    Ke W.
    Fangzhi Xuebao/Journal of Textile Research, 2022, 43 (09): : 41 - 48
  • [6] Real-time optimal scheduling for microgrid systems based on distributed deep reinforcement learning
    Guo F.-H.
    He T.
    Wu X.
    Dong H.
    Liu B.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2022, 39 (10): : 1881 - 1889
  • [7] REAL-TIME SCHEDULING BASED ON SIMULATION AND DEEP REINFORCEMENT LEARNING WITH FEATURED ACTION SPACE
    Xie, Shufang
    Zhang, Tao
    Rose, Oliver
    2022 WINTER SIMULATION CONFERENCE (WSC), 2022, : 1731 - 1739
  • [8] Deep reinforcement learning algorithm for dynamic flow shop real-time scheduling problem
    Yang Y.-Y.
    Hu R.
    Qian B.
    Zhang C.-S.
    Jin H.-P.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (06): : 1047 - 1055
  • [9] Real-time adaptive entry trajectory generation with modular policy and deep reinforcement learning
    Peng, Gaoxiang
    Wang, Bo
    Liu, Lei
    Fan, Huijin
    Cheng, Zhongtao
    AEROSPACE SCIENCE AND TECHNOLOGY, 2023, 142
  • [10] A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem
    Ling, Zhengxuan
    Zhang, Yu
    Chen, Xi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) : 5871 - 5882