Deep reinforcement learning for scheduling in large-scale networked control systems

被引:10
|
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [41] Optimal Scheduling of Electric Vehicle Load for Large-scale Battery Charging and Swapping Based on Deep Reinforcement Learning
    Liu D.
    Wang L.
    Wang W.
    Li H.
    Wang W.
    Liu M.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (04): : 36 - 46
  • [42] Stacked Autoencoder-Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks
    Jiang, Feibo
    Wang, Kezhi
    Dong, Li
    Pan, Cunhua
    Yang, Kun
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9278 - 9290
  • [43] Adaptive and large-scale service composition based on deep reinforcement learning
    Wang, Hongbing
    Gu, Mingzhu
    Yu, Qi
    Tao, Yong
    Li, Jiajie
    Fei, Huanhuan
    Yan, Jia
    Zhao, Wei
    Hong, Tianjing
    KNOWLEDGE-BASED SYSTEMS, 2019, 180 : 75 - 90
  • [44] Mode-Dependent Scalable Control for Large-Scale Networked Systems
    Hu, Xiaohui
    Peng, Chen
    Yang, Song
    Shen, Hao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (11) : 4153 - 4157
  • [45] Large-scale dynamic surgical scheduling under uncertainty by hierarchical reinforcement learning
    Zhao, Lixiang
    Zhu, Han
    Zhang, Min
    Tang, Jiafu
    Wang, Yu
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024,
  • [46] Large-Scale Retrieval for Reinforcement Learning
    Humphreys, Peter C.
    Guez, Arthur
    Tieleman, Olivier
    Sifre, Laurent
    Weber, Theophane
    Lillicrap, Timothy
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [47] Aggregate State Control of Large-Scale Systems via Networked Controllers
    Sakurama, Kazunori
    IFAC PAPERSONLINE, 2017, 50 (01): : 2500 - 2504
  • [48] Application of deep reinforcement learning to networked control systems with uncertain network delays
    Ikemoto, Junya
    Ushio, Toshimitsu
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2020, 11 (04): : 480 - 500
  • [49] Dissipativity Analysis of Large-Scale Networked Systems
    Sun, Yuanfei
    Wang, Jirong
    Liu, Huabo
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [50] Loose synchronization for large-scale networked systems
    Albrecht, Jeannie
    Tuttle, Christopher
    Snoeren, Alex C.
    Vahdat, Amin
    USENIX ASSOCIATION PROCEEDINGS OF THE 2006 USENIX ANNUAL TECHNICAL CONFERENCE, 2006, : 301 - +