Time-inconsistent stochastic linear quadratic control for discrete-time systems

被引:18
|
作者
Qi, Qingyuan [1 ]
Zhang, Huanshui [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
time-inconsistency; open-loop equilibrium control; maximum principle; FBSDE; nonsymmetric Riccati equations; UTILITY MAXIMIZATION; PORTFOLIO SELECTION; CONSUMPTION;
D O I
10.1007/s11432-017-9167-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is mainly concerned with the time-inconsistent stochastic linear quadratic (LQ) control problem in a more general formulation for discrete-time systems. The time-inconsistency arises from three aspects: the coefficient matrices depending on the initial pair, the terminal of the cost function involving the initial pair together with the nonlinear terms of the conditional expectation. The main contributions are: firstly, the maximum principle is derived by using variational methods, which forms a flow of forward and backward stochastic difference equations (FBSDE); secondly, in the case of the system state being one-dimensional, the equilibrium control is obtained by solving the FBSDE with feedback gain based on several nonsymmetric Riccati equations; finally, the necessary and sufficient solvability condition for the time-inconsistent LQ control problem is presented explicitly. The key techniques adopted are the maximum principle and the solution to the FBSDE developed in this paper.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] QUADRATICITY AND NEUTRALITY IN DISCRETE-TIME STOCHASTIC LINEAR QUADRATIC CONTROL
    ALDRICH, C
    PETERSON, DW
    [J]. AUTOMATICA, 1977, 13 (03) : 307 - 312
  • [32] On discrete-time linear quadratic control
    Czornik, A
    [J]. SYSTEMS & CONTROL LETTERS, 1999, 36 (02) : 101 - 107
  • [33] MIXED EQUILIBRIUM SOLUTION OF TIME-INCONSISTENT STOCHASTIC LINEAR-QUADRATIC PROBLEM
    Ni, Yuan-Hua
    Li, Xun
    Zhang, Ji-Feng
    Krstic, Miroslav
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2019, 57 (01) : 533 - 569
  • [34] Time-inconsistent Stochastic Linear-quadratic Problem with Markov Jump parameter
    Ni, Yuan-Hua
    [J]. 2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 7204 - 7207
  • [35] Covariance control of linear discrete-time stochastic systems
    Baromand, Salman
    Khaloozadeh, Hamid
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION, VOLS 1-7, 2007, : 778 - 782
  • [36] Stochastic Linear Quadratic Optimal Control with Indefinite Control Weights and Constraint for Discrete-Time Systems
    Liu, Xikui
    Li, Guiling
    Li, Yan
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
  • [37] The linear quadratic optimization problem for a class of discrete-time stochastic linear systems
    Dragan, Vasile
    Morozan, Toadfr
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2008, 4 (09): : 2127 - 2137
  • [38] LINEAR QUADRATIC OPTIMIZATION PROBLEMS FOR SOME DISCRETE-TIME STOCHASTIC LINEAR SYSTEMS
    Dragan, Vasile
    Morozan, Toader
    [J]. MATHEMATICAL REPORTS, 2009, 11 (04): : 307 - 319
  • [39] Stochastic linear quadratic regulation for discrete-time linear systems with input delay
    Song, Xinmin
    Zhang, Huanshui
    Xie, Lihua
    [J]. AUTOMATICA, 2009, 45 (09) : 2067 - 2073
  • [40] Linear–Quadratic Time-Inconsistent Mean Field Games
    A. Bensoussan
    K. C. J. Sung
    S. C. P. Yam
    [J]. Dynamic Games and Applications, 2013, 3 : 537 - 552