Data-Driven Optimal Controller Design for Maglev Train: Q-Learning Method

被引:1
|
作者
Xin, Liang [1 ]
Jiang, Hongwei [2 ]
Wen, Tao [1 ]
Long, Zhiqiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Intelligence Sci & Technol, Changsha 410073, Peoples R China
[2] CRRC Zhuzhou Locomot Co Ltd, Zhuzhou 412001, Hunan, Peoples R China
基金
国家重点研发计划;
关键词
Maglev train; Data-Ddriven Optimal Controller; Q-learning; TRACKING CONTROL; REINFORCEMENT; SYSTEMS;
D O I
10.1109/CCDC55256.2022.10033516
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The maglev train is an open-loop and unstable complex nonlinear system. Generally, design of offline controllers based on a single operating state. However, the system of maglev train will influence by various complex factors in actual operation. When the system model changes, the controller is designed and tuned offline will suffer severe performance degradation that will affect the system's stability. This paper proposes a Data-Ddriven Optimal Controller (DDOC) based on the Q-learning theory in reinforcement learning in response to this problem. The controller does not need to know the model information of the controlled object, only calculates iteratively based on the system's real-time input, output data, which has the advantages of fewer tuning parameters and fast convergence speed. For the problem that system model change during operation, the method proposed in this paper makes the system accurately track the given reference signal by dynamically and rapidly changing the parameters of feedback gain matrix through the real-time data of the system, thus ensuring the stability and reliability of the control system.
引用
收藏
页码:1289 / 1294
页数:6
相关论文
共 50 条
  • [21] Event-Triggered Data-Driven Control of Nonlinear Systems via Q-Learning
    Shen, Mouquan
    Wang, Xianming
    Zhu, Song
    Huang, Tingwen
    Wang, Qing-Guo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025, 55 (02): : 1069 - 1077
  • [22] Design of a Data-Driven Controller with Evaluating Controller Performance
    Kinoshita, Takuya
    Yamamoto, Toru
    ICAROB 2019: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS, 2019, : 467 - 470
  • [23] Design of a Data-Driven Controller with Evaluating Controller Performance
    Kinoshita, Takuya
    Yamamoto, Toru
    JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2019, 5 (04): : 257 - 260
  • [24] A data-driven fault diagnosis of high speed maglev train levitation system
    Wang, Zhiqiang
    Long, Zhiqiang
    Luo, Jie
    He, Zhangming
    Li, Xiaolong
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2023, 37 (10) : 2671 - 2689
  • [25] OPTIMAL DESIGN OF RUDDER STRUCTURES BASED ON DATA-DRIVEN METHOD
    Shi, Guanghui
    Jia, Yibo
    Hao, Wenyu
    Wu, Wenhua
    Li, Qiang
    Lin, Ye
    Du, Zongliang
    Lixue Xuebao/Chinese Journal of Theoretical and Applied Mechanics, 2023, 55 (11): : 2577 - 2587
  • [26] Convolution-Based Data-Driven Simulation and Controller Design Method
    Kameya, Naoki
    Fujimoto, Yasutaka
    Hosoyamada, Yu
    Suenaga, Toyoaki
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (08) : 9541 - 9550
  • [27] A data-driven bilinear predictive controller design based on subspace method
    Yang, Hua
    Li, Shaoyuan
    PROCEEDINGS OF THE 2007 IEEE CONFERENCE ON CONTROL APPLICATIONS, VOLS 1-3, 2007, : 524 - 529
  • [28] A DATA-DRIVEN BILINEAR PREDICTIVE CONTROLLER DESIGN BASED ON SUBSPACE METHOD
    Yang, Hua
    Li, Ning
    Li, Shaoyuan
    ASIAN JOURNAL OF CONTROL, 2011, 13 (02) : 345 - 349
  • [29] Data-driven adaptive dynamic programming for partially observable nonzero-sum games via Q-learning method
    Wang, Wei
    Chen, Xin
    Fu, Hao
    Wu, Min
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2019, 50 (07) : 1338 - 1352
  • [30] Data Driven Q-Learning for Commercial HVAC Control
    Faddel, Samy
    Tian, Guanyu
    Zhou, Qun
    Aburub, Haneen
    IEEE SOUTHEASTCON 2020, 2020,