Event-Triggered Near-Optimal Control for Unknown Discrete-Time Nonlinear Systems Using Parallel Control

被引:35
|
作者
Lu, Jingwei [1 ,2 ]
Wei, Qinglai [1 ,2 ]
Zhou, Tianmin [1 ,2 ]
Wang, Ziyang [3 ]
Wang, Fei-Yue [1 ,2 ]
机构
[1] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[3] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonlinear systems; Optimal control; Control systems; Performance analysis; Stability criteria; Iterative algorithms; Heuristic algorithms; Adaptive dynamic programming (ADP); event-triggered control; near-optimal control; parallel control; reinforcement learning (RL); unknown nonlinear systems;
D O I
10.1109/TCYB.2022.3164977
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article uses parallel control to investigate the problem of event-triggered near-optimal control (ETNOC) for unknown discrete-time (DT) nonlinear systems. First, to achieve parallel control, an augmented nonlinear system (ANS) with an augmented performance index (API) is proposed to introduce the control input into the feedback system. The control stability relationship between the ANS and the original system is analyzed, and it is shown that, by choosing a proper API, optimal control of the ANS with the API can be seen as near-optimal control of the original system with the original performance index (OPI). Second, based on parallel control, a novel event-triggered scheme is proposed, and then a novel ETNOC method is developed using the time-triggered optimal value function of the ANS with the API. The control stability is proved, and an upper bound, which is related to the design parameter, is provided for the actual performance index in advance. Then, to implement the developed ETNOC method for unknown DT nonlinear systems, a novel online learning algorithm is developed without reconstructing unknown systems, and neural network (NN) and adaptive dynamic programming (ADP) techniques are employed in the developed algorithm. The convergence of the signals in the closed-loop system (CLS) is shown using the Lyapunov approach, and the assumption of boundedness of input dynamics is not required. Finally, two simulations justify the theoretical conjectures.
引用
收藏
页码:1890 / 1904
页数:15
相关论文
共 50 条
  • [1] Event-Triggered Optimal Parallel Tracking Control for Discrete-Time Nonlinear Systems
    Lu, Jingwei
    Wei, Qinglai
    Liu, Yujia
    Zhou, Tianmin
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (06): : 3772 - 3784
  • [2] Near Optimal Event-Triggered Control of Nonlinear Discrete-Time Systems Using Neurodynamic Programming
    Sahoo, Avimanyu
    Xu, Hao
    Jagannathan, Sarangapani
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (09) : 1801 - 1815
  • [3] Adaptive neural event-triggered near-optimal control for affined uncertain nonlinear discrete-time system
    Li, Xinyu
    Ding, Liang
    Li, Shu
    Yang, Huaiguang
    Qi, Huanan
    Gao, Haibo
    Deng, Zongquan
    [J]. ASIAN JOURNAL OF CONTROL, 2024,
  • [4] Adaptive Event-Triggered Near-Optimal Tracking Control for Unknown Continuous-Time Nonlinear Systems
    Wang, Kunfu
    Gu, Qijia
    Huang, Baiqiao
    Wei, Qinglai
    Zhou, Tianmin
    [J]. IEEE ACCESS, 2022, 10 : 9506 - 9518
  • [5] Event-Triggered Near-Optimal Control of Discrete-Time Constrained Nonlinear Systems With Application to a Boiler-Turbine System
    Wei, Qinglai
    Lu, Jingwei
    Zhou, Tianmin
    Cheng, Xiang
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (06) : 3926 - 3935
  • [6] Event-triggered near-optimal tracking control based on adaptive dynamic programming for discrete-time systems
    Wang, Ziyang
    Lee, Joonhyup
    Wei, Qinglai
    Zhang, Anting
    [J]. NEUROCOMPUTING, 2023, 537 : 187 - 197
  • [7] Adaptive event-triggered control for nonlinear discrete-time systems
    Hu, Songlin
    Yue, Dong
    Yin, Xiuxia
    Xie, Xiangpeng
    Ma, Yong
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2016, 26 (18) : 4104 - 4125
  • [8] Event-Triggered Optimal Control for Discrete-Time Switched Nonlinear Systems With Constrained Control Input
    Han, Xiumei
    Zhao, Xudong
    Sun, Tao
    Wu, Yuhu
    Xu, Ning
    Zong, Guangdeng
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (12): : 7850 - 7859
  • [9] Event-triggered Control for Discrete-Time Systems
    Eqtami, Alina
    Dimarogonas, Dimos V.
    Kyriakopoulos, Kostas J.
    [J]. 2010 AMERICAN CONTROL CONFERENCE, 2010, : 4719 - 4724
  • [10] NEAR-OPTIMAL CONTROL OF DISCRETE-TIME NONLINEAR STOCHASTIC SYSTEMS
    RAO, BVR
    MAHALANA.AK
    [J]. PROCEEDINGS OF THE INSTITUTION OF ELECTRICAL ENGINEERS-LONDON, 1971, 118 (05): : 709 - &