Data-Driven Optimal Controller Design for Maglev Train: Q-Learning Method

被引:1
|
作者
Xin, Liang [1 ]
Jiang, Hongwei [2 ]
Wen, Tao [1 ]
Long, Zhiqiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
[2] CRRC Zhuzhou Locomot Co Ltd, Zhuzhou 412001, Hunan, Peoples R China
基金
国家重点研发计划;
关键词
Maglev train; Data-Ddriven Optimal Controller; Q-learning; TRACKING CONTROL; REINFORCEMENT; SYSTEMS;
D O I
10.1109/CCDC55256.2022.10033516
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The maglev train is an open-loop and unstable complex nonlinear system. Generally, design of offline controllers based on a single operating state. However, the system of maglev train will influence by various complex factors in actual operation. When the system model changes, the controller is designed and tuned offline will suffer severe performance degradation that will affect the system's stability. This paper proposes a Data-Ddriven Optimal Controller (DDOC) based on the Q-learning theory in reinforcement learning in response to this problem. The controller does not need to know the model information of the controlled object, only calculates iteratively based on the system's real-time input, output data, which has the advantages of fewer tuning parameters and fast convergence speed. For the problem that system model change during operation, the method proposed in this paper makes the system accurately track the given reference signal by dynamically and rapidly changing the parameters of feedback gain matrix through the real-time data of the system, thus ensuring the stability and reliability of the control system.
引用
收藏
页码:1289 / 1294
页数:6
相关论文
共 50 条
  • [1] A Combined Policy Gradient and Q-learning Method for Data-driven Optimal Control Problems
    Lin, Mingduo
    Liu, Derong
    Zhao, Bo
    Dai, Qionghai
    Dong, Yi
    2019 9TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST2019), 2019, : 6 - 10
  • [2] Safe Q-Learning for Data-Driven Nonlinear Optimal Control with Asymmetric State Constraints
    Zhao, Mingming
    Wang, Ding
    Song, Shijie
    Qiao, Junfei
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (12) : 2408 - 2422
  • [3] Safe Q-Learning for Data-Driven Nonlinear Optimal Control With Asymmetric State Constraints
    Mingming Zhao
    Ding Wang
    Shijie Song
    Junfei Qiao
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (12) : 2408 - 2422
  • [4] Design method of fuzzy controller for MAGLEV train
    Li, H
    Sun, ZY
    Weng, XQ
    PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON ELECTROMAGNETIC FIELD PROBLEMS AND APPLICATIONS, 2000, : 273 - 275
  • [5] Design and Applications of Q-Learning Adaptive PID Algorithm for Maglev Train Levitation Control System
    Shou, Baineng
    Zhang, Hehong
    Long, Zhiqiang
    Xie, Yunde
    Zhang, Ke
    Gu, Qiuming
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1947 - 1953
  • [6] Data-Driven Self-Learning Controller Design Approach for Power-Aware IoT Devices based on Double Q-Learning Strategy
    Paterova, Tereza
    Prauzek, Michal
    Konecny, Jaromir
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [7] Data-driven-based Predictive Optimal for a class of Iterative Learning Control by Q-learning method
    Li, Jinze
    Tian, Senping
    Peng, Yunjian
    Gu, Panpan
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1214 - 1220
  • [8] Data-driven parameter identification for levitation system of maglev train
    Song, Yifeng
    Tong, Laisheng
    Ni, Fei
    Lin, Guobin
    Liang, Tao
    Journal of Railway Science and Engineering, 2022, 19 (04): : 857 - 863
  • [9] Data-Driven Control Method Based on Koopman Operator for Suspension System of Maglev Train
    Han, Peichen
    Xu, Junqi
    Rong, Lijun
    Wang, Wen
    Sun, Yougang
    Lin, Guobin
    ACTUATORS, 2024, 13 (10)
  • [10] Data-driven approximate Q-learning stabilization with optimality error bound analysis
    Li, Yongqiang
    Yang, Chengzan
    Hou, Zhongsheng
    Feng, Yuanjing
    Yin, Chenkun
    AUTOMATICA, 2019, 103 (435-442) : 435 - 442