MODEL PREDICTIVE CONTROL AND MODEL PREDICTIVE Q-LEARNING FOR STRUCTURAL VIBRATION CONTROL

被引:0
|
作者
Phan, Minh Q. [1 ]
Azad, Seyed Mandi B. [1 ]
机构
[1] Dartmouth Coll, Thayer Sch Engn, Hanover, NH 03755 USA
来源
关键词
HORIZON OPTIMAL-CONTROL; SYSTEMS; DESIGN;
D O I
暂无
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper describes the relationship between Model Predictive Control (MPC) and Q-Learning, and formulates an algorithm called Model Predictive Q-Learning that integrates the two concepts. As a unifying theme, the paper explains how the Linear Quadratic Regulator (LQR), MPC, Q-Learning, and Model Predictive Q-Learning solve the same structural vibration control problem, and how the Q-Learning approach naturally handles both continuous and discrete-action inputs. The relationship between Model Predictive Q-Learning and standard Q-Learning is analogous to the relationship between MPC and LQR.
引用
收藏
页码:17 / 36
页数:20
相关论文
共 50 条
  • [1] Q-learning of the storage function in Economic Nonlinear Model Predictive Control
    Kordabad, Arash Bahari
    Gros, Sebastien
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [2] Improving Nonlinear Model Predictive Control Laws via Implicit Q-Learning
    Alhazmi, Khalid
    Sarathy, S. Mani
    IFAC PAPERSONLINE, 2023, 56 (02): : 10027 - 10032
  • [3] Information Theoretic Model Predictive Q-Learning
    Bhardwaj, Mohak
    Handa, Ankur
    Fox, Dieter
    Boots, Byron
    LEARNING FOR DYNAMICS AND CONTROL, VOL 120, 2020, 120 : 840 - 850
  • [4] IQL-TD-MPC: Implicit Q-Learning for Hierarchical Model Predictive Control
    Chitnis, Rolian
    Xu, Yingchen
    Hashemi, Bobak
    Lehnert, Lucas
    Dogan, Crun
    Zhu, Zheqing
    Delalleau, Olivier
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 9154 - 9160
  • [5] A Q-learning predictive control scheme with guaranteed stability
    Beckenbach, Lukas
    Osinenko, Pavel
    Streif, Stefan
    EUROPEAN JOURNAL OF CONTROL, 2020, 56 (56) : 167 - 178
  • [6] Hierarchical model predictive control strategy based on Q-Learning algorithm for hybrid electric vehicle platoon
    Yin, Yanli
    Huang, Xuejiang
    Zhan, Sen
    Zhang, Xinxin
    Wang, Fuzhen
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (2-3) : 385 - 402
  • [7] Model Predictive Control and Structural Sparsity
    Javier Florez, Alvaro
    Felipe Giraldo, Luis
    2019 IEEE 4TH COLOMBIAN CONFERENCE ON AUTOMATIC CONTROL (CCAC): AUTOMATIC CONTROL AS KEY SUPPORT OF INDUSTRIAL PRODUCTIVITY, 2019,
  • [8] Embedded explicit model predictive vibration control
    Takacs, Gergely
    Batista, Gabriel
    Gulan, Martin
    Rohal'-Ilkiv, Boris
    MECHATRONICS, 2016, 36 : 54 - 62
  • [9] Learning Model Predictive Control for Quadrotors
    Li, Guanrui
    Tunchez, Alex
    Loianno, Giuseppe
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 5872 - 5878
  • [10] Learning to Optimize in Model Predictive Control
    Sacks, Jacob
    Boots, Byron
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 10549 - 10556