Deep reinforcement learning for scheduling in large-scale networked control systems

被引:10
|
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [31] Constrained large-scale real-time EV scheduling based on recurrent deep reinforcement learning
    Li, Hang
    Li, Guojie
    Lie, Tek Tjing
    Li, Xingzhi
    Wang, Keyou
    Han, Bei
    Xu, Jin
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 144
  • [32] Deep Forest Reinforcement Learning for Preventive Strategy Considering Automatic Generation Control in Large-Scale Interconnected Power Systems
    Yin, Linfei
    Zhao, Lulin
    Yu, Tao
    Zhang, Xiaoshun
    APPLIED SCIENCES-BASEL, 2018, 8 (11):
  • [33] Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chen, Chacha
    Wei, Hua
    Xu, Nan
    Zheng, Guanjie
    Yang, Ming
    Xiong, Yuanhao
    Xu, Kai
    Li, Zhenhui
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3414 - 3421
  • [34] Efficient and scalable reinforcement learning for large-scale network control
    Ma, Chengdong
    Li, Aming
    Du, Yali
    Dong, Hao
    Yang, Yaodong
    NATURE MACHINE INTELLIGENCE, 2024, 6 (09) : 1006 - 1020
  • [35] Deep Reinforcement Learning for Stabilization of Large-Scale Probabilistic Boolean Networks
    Moschoyiannis, Sotiris
    Chatzaroulas, Evangelos
    Sliogeris, Vytenis
    Wu, Yuhu
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (03): : 1412 - 1423
  • [36] Planning Large-scale Object Rearrangement Using Deep Reinforcement Learning
    Ghosh, Sourav
    Das, Dipanjan
    Chakraborty, Abhishek
    Agarwal, Marichi
    Bhowmick, Brojeshwar
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] Large-scale and adaptive service composition based on deep reinforcement learning
    Liu, Jiang-Wen
    Hu, Li-Qiang
    Cai, Zhao-Quan
    Xing, Li-Ning
    Tan, Xu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 65
  • [38] Deep Reinforcement Learning for Network Service Recovery in Large-scale Failures
    Akashi, Kazuaki
    Fukuda, Nobukazu
    Kanai, Shunsuke
    Tayama, Kenichi
    2023 19TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT, CNSM, 2023,
  • [39] Deep Reinforcement Learning-Based Large-Scale Robot Exploration
    Cao, Yuhong
    Zhao, Rui
    Wang, Yizhuo
    Xiang, Bairan
    Sartoretti, Guillaume
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (05) : 4631 - 4638
  • [40] Large-Scale and Adaptive Service Composition Using Deep Reinforcement Learning
    Wang, Hongbing
    Gu, Mingzhu
    Yu, Qi
    Fei, Huanhuan
    Li, Jiajie
    Tao, Yong
    SERVICE-ORIENTED COMPUTING, ICSOC 2017, 2017, 10601 : 383 - 391