H∞ optimal output tracking control for Markov jump systems: A reinforcement learning-based approach

被引:0
|
作者
Shen, Ying [1 ,2 ]
Yao, Cai-Kang [1 ,2 ]
Chen, Bo [1 ,2 ]
Che, Wei-Wei [3 ]
Wu, Zheng-Guang [4 ]
机构
[1] Zhejiang Univ Technol, Dept Automat, Hangzhou 310023, Peoples R China
[2] Zhejiang Univ Technol, Zhejiang Prov United Key Lab Embedded Syst, Hangzhou, Peoples R China
[3] Qingdao Univ, Inst Complex Sci, Shandong Key Lab Ind Control Technol, Qingdao, Peoples R China
[4] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
H-infinity optimal output tracking control; Markov jump system; TD (lambda)-like algorithm; unknown transition probabilities; H-INFINITY-CONTROL; DISCRETE-TIME-SYSTEMS; LQ-OPTIMAL CONTROL; STOCHASTIC STABILITY; LINEAR-SYSTEMS;
D O I
10.1002/rnc.7255
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, the H-infinity optimal output tracking control problem for Markov jump systems is investigated, where the two cases with known or completely unknown transition probabilities are both considered. Based on game theory and H-infinity performance, quadratic cost is considered, where a discount parameter is introduced into the quadratic cost in order to track unstable systems and eliminate the assumption that the noise energy is bounded. The game coupled algebraic Riccati equation and the corresponding controller are presented by dynamic programming. The stochastic stability of the tracking error system is further investigated. Moreover, iterative and reinforcement learning-based algorithms are proposed for solving the H-infinity optimal tracking controller with known or completely unknown transition probabilities, respectively. Finally, some numerical simulations on a DC motor are performed to validate the effectiveness of the proposed results.
引用
收藏
页码:5149 / 5167
页数:19
相关论文
共 50 条
  • [1] Reinforcement learning-based optimal control for Markov jump systems with completely unknown dynamics
    Shi, Xiongtao
    Li, Yanjie
    Du, Chenglong
    Chen, Chaoyang
    Zong, Guangdeng
    Gui, Weihua
    [J]. AUTOMATICA, 2025, 171
  • [2] Reinforcement Learning-Based Robust Tracking Control for Unknown Markov Jump Systems and its Application
    Shen, Hao
    Wu, Jiacheng
    Wang, Yun
    Wang, Jing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (03) : 1211 - 1215
  • [3] Reinforcement learning-based adaptive optimal tracking algorithm for Markov jump systems with partial unknown dynamics
    Tu, Yidong
    Fang, Haiyang
    Wang, Hai
    Shi, Kaibo
    He, Shuping
    [J]. OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (05): : 1435 - 1449
  • [4] A Reinforcement Learning-Based Approach for Optimal Output Tracking in Uncertain Nonlinear Systems with Mismatched Disturbances
    Tang, Zezhi
    Rossiter, J. Anthony
    Panoutsos, George
    [J]. 2024 UKACC 14TH INTERNATIONAL CONFERENCE ON CONTROL, CONTROL, 2024, : 169 - 174
  • [5] Nonfragile Output Feedback Tracking Control for Markov Jump Fuzzy Systems Based on Integral Reinforcement Learning Scheme
    Wang, Jing
    Wu, Jiacheng
    Cao, Jinde
    Chadli, Mohammed
    Shen, Hao
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (07) : 4521 - 4530
  • [6] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Zhong-Xin Fan
    Lintao Tang
    Shihua Li
    Rongjie Liu
    [J]. Neural Computing and Applications, 2023, 35 : 23987 - 23996
  • [7] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Fan, Zhong-Xin
    Tang, Lintao
    Li, Shihua
    Liu, Rongjie
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (33): : 23987 - 23996
  • [8] Asynchronous Learning-Based Output Feedback Sliding Mode Control for Semi-Markov Jump Systems: A Descriptor Approach
    Zheng Wu
    Yiyun Zhao
    Fanbiao Li
    Tao Yang
    Yang Shi
    Weihua Gui
    [J]. IEEE/CAA Journal of Automatica Sinica, 2024, 11 (06) : 1358 - 1369
  • [9] Asynchronous Learning-Based Output Feedback Sliding Mode Control for Semi-Markov Jump Systems: A Descriptor Approach
    Wu, Zheng
    Zhao, Yiyun
    Li, Fanbiao
    Yang, Tao
    Shi, Yang
    Gui, Weihua
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (06) : 1358 - 1369
  • [10] Reinforcement learning-based composite suboptimal control for Markov jump singularly perturbed systems with unknown dynamics
    Li, Wenqian
    Jia, Guolong
    Wang, Yun
    Su, Lei
    Shen, Hao
    [J]. MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2024, 47 (14) : 11551 - 11564