Reinforcement Learning Based Distributed Control of Dissipative Networked Systems

被引:1
|
作者
Kosaraju, Krishna Chaitanya [1 ]
Sivaranjani, S. [2 ]
Suttle, Wesley [3 ,4 ]
Gupta, Vijay [1 ]
Liu, Ji [3 ,4 ]
机构
[1] Univ Notre Dame, Dept Elect Engn, Notre Dame, IN 46556 USA
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77843 USA
[3] SUNY Stony Brook, Dept Appl Math & Stat, Stony Brook, NY 11794 USA
[4] SUNY Stony Brook, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
来源
基金
美国国家科学基金会;
关键词
Reinforcement learning; dissipativity theory; control barrier functions; distributed control; PASSIVITY;
D O I
10.1109/TCNS.2021.3124896
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the problem of designing distributed controllers to stabilize a class of networked systems, where each subsystem is dissipative and designs a reinforcement learning based local controller to maximize an individual cumulative reward function. We develop an approach that enforces dissipativity conditions on these local controllers at each subsystem to guarantee stability of the entire networked system. The proposed approach is illustrated on a dc microgrid example, where the objective is to maintain voltage stability of the network using locally distributed controllers at each generation unit.
引用
收藏
页码:856 / 866
页数:11
相关论文
共 50 条
  • [1] Distributed Reinforcement Learning for Networked Dynamical Systems
    Sadamoto, Tomonori
    Kikuya, Ayafumi
    Chakrabortty, Aranya
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (02): : 1103 - 1115
  • [2] Reinforcement Learning - Based Control Systems For Networked Power Infrastructures
    Saha, Namrata
    Rezapour, Shabnam
    Amini, M. Hadi
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 1113 - 1116
  • [3] Reinforcement Learning-Based Tracking Control for Networked Control Systems With DoS Attacks
    Liu, Jinliang
    Dong, Yanhui
    Zha, Lijuan
    Xie, Xiangpeng
    Tian, Engang
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 4188 - 4197
  • [4] Reinforcement Learning-Based Decentralized Control for Networked Interconnected Systems With Communication and Control Constraints
    Liu, Jinliang
    Zhang, Nan
    Zha, Lijuan
    Xie, Xiangpeng
    Tian, Engang
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, : 1 - 12
  • [5] Thompson-Sampling Based Reinforcement Learning for Networked Control of Unknown Linear Systems
    Sayedana, Borna
    Afshari, Mohammad
    Caines, Peter E.
    Mahajan, Aditya
    [J]. 2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 723 - 730
  • [6] Event-Triggered Dissipative Tracking Control of Networked Control Systems With Distributed Communication Delay
    Gu, Zhou
    Yan, Shen
    Ahn, Choon Ki
    Yue, Dong
    Xie, Xiangpeng
    [J]. IEEE SYSTEMS JOURNAL, 2022, 16 (02): : 3320 - 3330
  • [7] Distributed Control in Networked Systems
    Dumitrache, Ioan
    Necoara, Ion
    [J]. CONTROL ENGINEERING AND APPLIED INFORMATICS, 2009, 11 (03): : 3 - 5
  • [8] Networked control of distributed systems
    Stubbs, A
    Dullerud, GE
    [J]. PROCEEDINGS OF THE 40TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2001, : 203 - 204
  • [9] Optimal Control Design Based on Reinforcement Learning for a Class of Nonlinear Distributed Systems
    He, Zhen
    Liu, YanBin
    [J]. 2013 10TH IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2013, : 384 - 389
  • [10] Quantum optimal control of multilevel dissipative quantum systems with reinforcement learning
    An, Zheng
    Song, Hai-Jing
    He, Qi-Kai
    Zhou, D. L.
    [J]. PHYSICAL REVIEW A, 2021, 103 (01)