Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

被引:6
|
作者
Bo, Zitong [1 ,2 ]
Qiao, Ying [1 ]
Leng, Chang [1 ]
Wang, Hongan [1 ]
Guo, Chaoping [1 ]
Zhang, Shaohui [3 ]
机构
[1] Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Beijing Natl Speed Skating Oval Operat Co Ltd, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
real-time scheduling; reinforcement learning; multiprocessor system; deep neural network;
D O I
10.1109/RTAS52030.2021.00019
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Designing scheduling policies for multiprocessor real-time systems is challenging since the multiprocessor scheduling problem is NP-complete. The existing heuristics are customized policies that may achieve poor performance under some specific task loads. Thus, a new design pattern is needed to make the multiprocessor scheduling policies perform well under various task loads. In this paper, we investigate a new real-time scheduling policy based on reinforcement learning. For any given real-time task set, our policy can automatically derive a high performance by online learning. Specifically, we model the real-time scheduling process as a multi-agent cooperative game and propose multi-agent self-cooperative learning that overcomes the curse of dimensionality and credit assignment problems. Simulation results show that our approach can learn high-performance policies for various task/system models.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [21] Real-time scheduling for distributed permutation flowshops with dynamic job arrivals using deep reinforcement learning
    Yang, Shengluo
    Wang, Junyi
    Xu, Zhigang
    ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [22] Cost-aware real-time job scheduling for hybrid cloud using deep reinforcement learning
    Cheng, Long
    Kalapgar, Archana
    Jain, Amogh
    Wang, Yue
    Qin, Yongtai
    Li, Yuancheng
    Liu, Cong
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (21): : 18579 - 18593
  • [23] Real-time scheduling of power grid digital twin tasks in cloud via deep reinforcement learning
    Qi, Daokun
    Xi, Xiaojuan
    Tang, Yake
    Zheng, Yuesong
    Guo, Zhengwei
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2024, 13 (01):
  • [24] Real-time Scheduling of Electric Bus Flash Charging at Intermediate Stops: A Deep Reinforcement Learning Approach
    Bi X.
    Wang R.
    Ye H.
    Hu Q.
    Bu S.
    Chung E.
    IEEE Transactions on Transportation Electrification, 2024, 10 (03) : 1 - 1
  • [25] Petri-net-based deep reinforcement learning for real-time scheduling of automated manufacturing systems
    Luo, Jiliang
    Yi, Sijia
    Lin, Zexuan
    Zhang, Hongbin
    Zhou, Jiazhong
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 995 - 1008
  • [26] A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling
    Zhang, Chi
    Kuppannagari, Sanmukh R.
    Xiong, Chuanxiu
    Kannan, Rajgopal
    Prasanna, Viktor K.
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION (IOTDI '19), 2019, : 59 - 69
  • [27] Cost-aware real-time job scheduling for hybrid cloud using deep reinforcement learning
    Long Cheng
    Archana Kalapgar
    Amogh Jain
    Yue Wang
    Yongtai Qin
    Yuancheng Li
    Cong Liu
    Neural Computing and Applications, 2022, 34 : 18579 - 18593
  • [28] Real-time Scheduling using Reinforcement Learning Technique for the Connected Vehicles
    Park, Seongjin
    Yoo, Younghwan
    2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [29] Hybrid DVFS Scheduling for Real-Time Systems Based on Reinforcement Learning
    Muhammad, Fakhruddin
    ul Islam, Mahbub
    Lin, Man
    IEEE SYSTEMS JOURNAL, 2017, 11 (02): : 931 - 940
  • [30] Hierarchical Reinforcement-Learning for Real-Time Scheduling of Agile Satellites
    Ren, Lili
    Ning, Xin
    Li, Jiayin
    IEEE ACCESS, 2020, 8 (08): : 220523 - 220532