Reinforcement Learning-Based Decentralized Safety Control for Constrained Interconnected Nonlinear Safety-Critical Systems

被引:1
|
作者
Qin, Chunbin [1 ]
Wu, Yinliang [1 ]
Zhang, Jishi [2 ]
Zhu, Tianzeng [1 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Peoples R China
[2] Henan Univ, Sch Software, Kaifeng 475000, Peoples R China
关键词
interconnected nonlinear safety-critical systems; barrier function; asymmetric input constraints; safety constraints; decentralized control; TRACKING CONTROL; ROBUST CONTROLLER; DESIGN;
D O I
10.3390/e25081158
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
This paper addresses the problem of decentralized safety control (DSC) of constrained interconnected nonlinear safety-critical systems under reinforcement learning strategies, where asymmetric input constraints and security constraints are considered. To begin with, improved performance functions associated with the actuator estimates for each auxiliary subsystem are constructed. Then, the decentralized control problem with security constraints and asymmetric input constraints is transformed into an equivalent decentralized control problem with asymmetric input constraints using the barrier function. This approach ensures that safety-critical systems operate and learn optimal DSC policies within their safe global domains. Then, the optimal control strategy is shown to ensure that the entire system is uniformly ultimately bounded (UUB). In addition, all signals in the closed-loop auxiliary subsystem, based on Lyapunov theory, are uniformly ultimately bounded, and the effectiveness of the designed method is verified by practical simulation.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems
    Zhao, Yanwei
    Wang, Huanqing
    Xu, Ning
    Zong, Guangdeng
    Zhao, Xudong
    [J]. CHAOS SOLITONS & FRACTALS, 2023, 167
  • [2] Security and Safety-Critical Learning-Based Collaborative Control for Multiagent Systems
    Yan, Bing
    Shi, Peng
    Lim, Chee Peng
    Sun, Yuan
    Agarwal, Ramesh K.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 12
  • [3] Learning-Based Safety-Stability-Driven Control for Safety-Critical Systems under Model Uncertainties
    Zheng, Lei
    Yang, Rui
    Pan, Jiesen
    Cheng, Hui
    Hu, Haifeng
    [J]. 2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 1112 - 1118
  • [4] A predictive safety filter for learning-based control of constrained nonlinear dynamical systems
    Wabersich, Kim Peter
    Zeilinger, Melanie N.
    [J]. AUTOMATICA, 2021, 129
  • [5] Reinforcement Learning-Based Decentralized Control for Networked Interconnected Systems With Communication and Control Constraints
    Liu, Jinliang
    Zhang, Nan
    Zha, Lijuan
    Xie, Xiangpeng
    Tian, Engang
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, : 1 - 12
  • [6] Safety Analysis and Safety-critical Control of Nonlinear Systems: Barrier Function Approach
    Chen, Jie
    Lyu, Zi-Liang
    Huang, Xin-Yuan
    Hong, Yi-Guang
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (03): : 567 - 579
  • [7] Constrained Optimal Control for Nonlinear Multi-Input Safety-Critical Systems with Time-Varying Safety Constraints
    Wang, Jinguang
    Qin, Chunbin
    Qiao, Xiaopeng
    Zhang, Dehua
    Zhang, Zhongwei
    Shang, Ziyang
    Zhu, Heyang
    [J]. MATHEMATICS, 2022, 10 (15)
  • [8] Bayesian Learning-Based Adaptive Control for Safety Critical Systems
    Fan, David D.
    Nguyen, Jennifer
    Thakker, Rohan
    Alatur, Nikhilesh
    Agha-mohammadi, Ali-akbar
    Theodorou, Evangelos A.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 4093 - 4099
  • [9] Safety-Critical Adaptive Control with Nonlinear Reference Model Systems
    Arabi, Ehsan
    Garg, Kunal
    Panagou, Dimitra
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 1749 - 1754
  • [10] Robust safety-critical control of nonlinear systems with small perturbations
    Huang, Xiaomin
    Long, Lijun
    [J]. NONLINEAR DYNAMICS, 2024,