Discrete time mean-field stochastic linear-quadratic optimal control problems

被引:147
|
作者
Elliott, Robert [1 ,2 ]
Li, Xun [3 ]
Ni, Yuan-Hua [4 ,5 ]
机构
[1] Univ Adelaide, Sch Math Sci, Adelaide, SA 5005, Australia
[2] Univ Calgary, Haskayne Sch Business, Calgary, AB, Canada
[3] Hong Kong Polytech Univ, Dept Appl Math, Kowloon, Hong Kong, Peoples R China
[4] Tianjin Polytech Univ, Sch Sci, Dept Math, Tianjin 300160, Peoples R China
[5] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Stochastic linear-quadratic optimal control problem; Mean-field theory; Riccati difference equation; MCKEAN-VLASOV EQUATION; MULTIAGENT SYSTEMS; DIFFERENTIAL-EQUATIONS; H-2/H-INFINITY CONTROL; NASH EQUILIBRIA; HILBERT-SPACE; GAMES; DYNAMICS; BEHAVIOR; STATE;
D O I
10.1016/j.automatica.2013.08.017
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper firstly presents necessary and sufficient conditions for the solvability of discrete time, mean-field, stochastic linear-quadratic optimal control problems. Secondly, the optimal control within a class of linear feedback controls is investigated using a matrix dynamical optimization method. Thirdly, by introducing several sequences of bounded linear operators, the problem is formulated as an operator stochastic linear-quadratic optimal control problem. By the kernel-range decomposition representation of the expectation operator and its pseudo-inverse, the optimal control is derived using solutions to two algebraic Riccati difference equations. Finally, by completing the square, the two Riccati equations and the optimal control are also obtained. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:3222 / 3233
页数:12
相关论文
共 50 条
  • [1] LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS FOR MEAN-FIELD STOCHASTIC DIFFERENTIAL EQUATIONS
    Yong, Jiongmin
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (04) : 2809 - 2838
  • [2] Indefinite mean-field type linear-quadratic stochastic optimal control problems
    Li, Na
    Li, Xun
    Yu, Zhiyong
    [J]. AUTOMATICA, 2020, 122
  • [3] Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni, Yuan-Hua
    Zhang, Ji-Feng
    Li, Xun
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (07) : 1786 - 1800
  • [4] Time-Inconsistent Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni Yuan-Hua
    [J]. PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 2577 - 2582
  • [5] Discrete-time mean-field Stochastic linear-quadratic optimal control problems, II: Infinite horizon case
    Ni, Yuan-Hua
    Elliott, Robert
    Li, Xun
    [J]. AUTOMATICA, 2015, 57 : 65 - 77
  • [6] A discrete-time mean-field stochastic linear-quadratic optimal control problem with financial application
    Li, Xun
    Tai, Allen H.
    Tian, Fei
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 2021, 94 (01) : 175 - 189
  • [7] Discrete-time mean-field stochastic linear-quadratic optimal control problem with finite horizon
    Song, Teng
    Liu, Bin
    [J]. ASIAN JOURNAL OF CONTROL, 2021, 23 (02) : 979 - 989
  • [8] Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equations with Jumps
    Tang, Maoning
    Meng, Qingxin
    [J]. ASIAN JOURNAL OF CONTROL, 2019, 21 (02) : 809 - 823
  • [9] TURNPIKE PROPERTIES FOR MEAN-FIELD LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS
    Sun, Jingrui
    Yong, Jiongmin
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2024, 62 (01) : 752 - 775
  • [10] Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equation with Levy Process
    Xiong, Hong
    Tang, Maoning
    Meng, Qingxin
    [J]. COMMUNICATIONS ON APPLIED MATHEMATICS AND COMPUTATION, 2022, 4 (04) : 1386 - 1415