Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control: From Finite Horizon to Infinite Horizon

被引:34
|
作者
Ni, Yuan-Hua [1 ,2 ]
Li, Xun [3 ]
Zhang, Ji-Feng [2 ]
机构
[1] Tianjin Polytech Univ, Sch Sci, Dept Math, Tianjin 300387, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Inst Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[3] Hong Kong Polytech Univ, Dept Appl Math, Kowloon, Hong Kong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Indefinite linear-quadratic optimal control; mean-field theory; stochastic system; PORTFOLIO SELECTION; MAXIMUM PRINCIPLE; RICCATI-EQUATIONS; GAMES; BEHAVIOR;
D O I
10.1109/TAC.2015.2509958
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, the finite-horizon and the infinite-horizon indefinite mean-field stochastic linear-quadratic optimal control problems are studied. Firstly, the open-loop optimal control and the closed-loop optimal strategy for the finite-horizon problem are introduced, and their characterizations, difference and relationship are thoroughly investigated. The open-loop optimal control can be defined for a fixed initial state, whose existence is characterized via the solvability of a linear mean-field forward-backward stochastic difference equation with stationary conditions and a convexity condition. On the other hand, the existence of a closed-loop optimal strategy is shown to be equivalent to any one of the following conditions: the solvability of a couple of generalized difference Riccati equations, the finiteness of the value function for all the initial pairs, and the existence of the open-loop optimal control for all the initial pairs. It is then proved that the solution of the generalized difference Riccati equations converges to a solution of a couple of generalized algebraic Riccati equations. By studying another generalized algebraic Riccati equation, the existence of the maximal solution of the original ones is obtained together with the fact that the stabilizing solution is the maximal solution. Finally, we show that the maximal solution is employed to express the optimal value of the infinite-horizon indefinite mean-field linear-quadratic optimal control. Furthermore, for the question whether the maximal solution is the stabilizing solution, the necessary and the sufficient conditions are presented for several cases.
引用
收藏
页码:3269 / 3284
页数:16
相关论文
共 50 条
  • [1] Finite-Horizon Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni, Yuan-Hua
    Li, Xun
    Zhang, Ji-Feng
    [J]. IFAC PAPERSONLINE, 2015, 48 (28): : 211 - 216
  • [2] A LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEM FOR MEAN-FIELD STOCHASTIC DIFFERENTIAL EQUATIONS IN INFINITE HORIZON
    Huang, Jianhui
    Li, Xun
    Yong, Jiongmin
    [J]. MATHEMATICAL CONTROL AND RELATED FIELDS, 2015, 5 (01) : 97 - 139
  • [3] Mean-field linear-quadratic stochastic differential games in an infinite horizon
    Li, Xun
    Shi, Jingtao
    Yong, Jiongmin
    [J]. ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2021, 27
  • [4] Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni, Yuan-Hua
    Zhang, Ji-Feng
    Li, Xun
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (07) : 1786 - 1800
  • [5] Discrete-time mean-field stochastic linear-quadratic optimal control problem with finite horizon
    Song, Teng
    Liu, Bin
    [J]. ASIAN JOURNAL OF CONTROL, 2021, 23 (02) : 979 - 989
  • [6] Discrete-time mean-field Stochastic linear-quadratic optimal control problems, II: Infinite horizon case
    Ni, Yuan-Hua
    Elliott, Robert
    Li, Xun
    [J]. AUTOMATICA, 2015, 57 : 65 - 77
  • [7] Indefinite mean-field type linear-quadratic stochastic optimal control problems
    Li, Na
    Li, Xun
    Yu, Zhiyong
    [J]. AUTOMATICA, 2020, 122 (122)
  • [8] Pareto Optimality in Infinite Horizon Mean-Field Stochastic Cooperative Linear-Quadratic Difference Games
    Peng, Chenchen
    Zhang, Weihai
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (07) : 4113 - 4126
  • [9] A stochastic linear-quadratic optimal control problem with jumps in an infinite horizon
    Wu, Jiali
    Tang, Maoning
    Meng, Qingxin
    [J]. AIMS MATHEMATICS, 2023, 8 (02): : 4042 - 4078
  • [10] Indefinite stochastic linear quadratic control in infinite time horizon
    Tang Huaibin
    Wu Zhen
    Zhang Weihai
    [J]. PROCEEDINGS OF THE 26TH CHINESE CONTROL CONFERENCE, VOL 3, 2007, : 502 - +