Inverse optimal control for discrete-time finite-horizon Linear Quadratic Regulators

被引:29
|
作者
Zhang, Han [1 ]
Umenberger, Jack [2 ]
Hu, Xiaoming [1 ]
机构
[1] KTH Royal Inst Technol, Dept Math, SE-10044 Stockholm, Sweden
[2] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
关键词
Inverse optimal control; Linear Quadratic Regulator;
D O I
10.1016/j.automatica.2019.108593
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the inverse optimal control problem for discrete-time Linear Quadratic Regulators (LQR), over finite-time horizons. Given observations of the optimal trajectories, or optimal control inputs, to a linear time-invariant system, the goal is to infer the parameters that define the quadratic cost function. The well-posedness of the inverse optimal control problem is first justified. In the noiseless case, when these observations are exact, we analyze the identifiability of the problem and provide sufficient conditions for uniqueness of the solution. In the noisy case, when the observations are corrupted by additive zero-mean noise, we formulate the problem as an optimization problem and prove that the solution to this problem is statistically consistent. The performance of the proposed method is illustrated through numerical examples. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] FINITE-HORIZON ε-OPTIMAL TRACKING CONTROL OF DISCRETE-TIME LINEAR SYSTEMS USING ITERATIVE APPROXIMATE DYNAMIC PROGRAMMING
    Tan, Fuxiao
    Luo, Bin
    Guan, Xinping
    ASIAN JOURNAL OF CONTROL, 2015, 17 (01) : 176 - 189
  • [22] INFINITE HORIZON LINEAR QUADRATIC OPTIMAL CONTROL FOR DISCRETE-TIME STOCHASTIC SYSTEMS
    Huang, Yulin
    Zhang, Weihai
    Zhang, Huanshui
    ASIAN JOURNAL OF CONTROL, 2008, 10 (05) : 608 - 615
  • [23] A unified approach to the finite-horizon linear quadratic optimal control problem
    Dipartimento di Ingegneria dell' Informazione, Università di Padova, via Gradenigo, 6/B, 35131 Padova, Italy
    不详
    Eur J Control, 2007, 5 (473-488):
  • [24] A Finite-Horizon Inverse Linear Quadratic Optimal Control Method for Human-in-the-Loop Behavior Learning
    Wu, Huai-Ning
    Li, Wen-Hua
    Wang, Mi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (06): : 3461 - 3470
  • [25] A Recursive Elimination Method for Finite-Horizon Optimal Control Problems of Discrete-Time Rational Systems
    Ohtsuka, Toshiyuki
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (11) : 3081 - 3086
  • [26] FINITE-HORIZON OPTIMAL CONTROL OF DISCRETE-TIME LINEAR SYSTEMS WITH COMPLETELY UNKNOWN DYNAMICS USING Q-LEARNING
    Zhao, Jingang
    Zhang, Chi
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2021, 17 (03) : 1471 - 1483
  • [27] Finite-Horizon Optimal Adaptive Neural Network Control of Uncertain Nonlinear Discrete-time Systems
    Zhao, Qiming
    Xu, Hao
    Jagannathan, S.
    2013 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL (ISIC), 2013, : 41 - 46
  • [28] Finite-horizon LQ control for unknown discrete-time linear systems via extremum seeking
    Frihauf, Paul
    Krstic, Miroslav
    Basar, Tamer
    EUROPEAN JOURNAL OF CONTROL, 2013, 19 (05) : 399 - 407
  • [29] Finite-Horizon LQ Control for Unknown Discrete-Time Linear Systems via Extremum Seeking
    Frihauf, Paul
    Krstic, Miroslav
    Basar, Tamer
    2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5717 - 5722
  • [30] Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems
    Li, Yichun
    Ma, Shuping
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2021, 358 (17): : 8993 - 9022