Data Driven Optimal Stabilization Control and Simulation Based on Reinforcement Learning

被引:0
|
作者
Lu, Chaolun [1 ]
Li, Yongqiang [1 ]
Feng, Yuanjing [1 ]
机构
[1] College of Information Engineering, Zhejiang University of Technology, Hangzhou,310023, China
关键词
Cost functions;
D O I
10.16451/j.cnki.issn1003-6059.201904007
中图分类号
学科分类号
摘要
Q-learning algorithm is used to solve the optimal stabilization control problem while only the data, rather than the model of the plant, is available. Due to the continuity of state space and control space, Q-learning can only be implemented in an approximate manner. Therefore, the proposed approximate Q-learning algorithm can obtain only one suboptimal controller. Although the obtained controller is suboptimal, the simulation shows that the closed-loop domain of attraction of the proposed algorithm is broader and the cost function is also smaller than the linear quadratic regulator and deep deterministic policy gradient method for the strongly nonlinear plant. 2019, Science Press. All right reserved.
引用
收藏
页码:345 / 352
相关论文
共 50 条
  • [1] Reinforcement Learning based Data-driven Optimal Control Strategy for Systems with Disturbance
    Fan, Zhong-Xin
    Li, Shihua
    Liu, Rongjie
    [J]. 2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 567 - 572
  • [2] Data-Driven Flotation Industrial Process Operational Optimal Control Based on Reinforcement Learning
    Jiang, Yi
    Fan, Jialu
    Chai, Tianyou
    Li, Jinna
    Lewis, Frank L.
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (05) : 1974 - 1989
  • [3] Approximate Optimal Stabilization Control of Servo Mechanisms based on Reinforcement Learning Scheme
    Lv, Yongfeng
    Ren, Xuemei
    Hu, Shuangyi
    Xu, Hao
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2019, 17 (10) : 2655 - 2665
  • [4] Approximate Optimal Stabilization Control of Servo Mechanisms based on Reinforcement Learning Scheme
    Yongfeng Lv
    Xuemei Ren
    Shuangyi Hu
    Hao Xu
    [J]. International Journal of Control, Automation and Systems, 2019, 17 : 2655 - 2665
  • [5] Parameter Optimal Iterative Learning Control Design: from Model-based, Data-driven to Reinforcement Learning *
    Zhang, Yueqing
    Chu, Bing
    Shu, Zhan
    [J]. IFAC PAPERSONLINE, 2022, 55 (12): : 494 - 499
  • [6] Reinforcement learning robust optimal control for spacecraft attitude stabilization
    Xiao, Bing
    Zhang, Haichao
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2024, 45 (01):
  • [7] Data-driven constrained reinforcement learning for optimal control of a multistage evaporation process
    Yao, Yao
    Ding, Jinliang
    Zhao, Chunhui
    Wang, Yonggang
    Chai, Tianyou
    [J]. CONTROL ENGINEERING PRACTICE, 2022, 129
  • [8] Data Based Optimal Control with Neural Networks and Data-Efficient Reinforcement Learning
    Runkler, Thomas A.
    Udluft, Steffen
    Duell, Siegmund
    [J]. AT-AUTOMATISIERUNGSTECHNIK, 2012, 60 (10) : 641 - 647
  • [9] Data-driven optimal control of wind turbines using reinforcement learning with function approximation
    Peng, Shenglin
    Feng, Qianmei
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2023, 176
  • [10] Research on Adaptive Optimal Iterative Learning Control Based on Data Driven
    基于数据驱动的自适应最优迭代学习控制研究
    [J]. Yang, Liangliang (yangliangliang@zstu.edu.cn); Yang, Liangliang (yangliangliang@zstu.edu.cn), 2021, Chinese Mechanical Engineering Society (57): : 207 - 216