Robust mean field games for coupled Markov jump linear systems

被引:24
|
作者
Moon, Jun [1 ,2 ]
Basar, Tamer
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL USA
[2] Ulsan Natl Inst Sci & Technol, Sch Elect & Comp Engn, Ulsan, South Korea
关键词
Mean field games; Markov jump linear systems; stochastic zero-sum differential games; LQG control; MULTIAGENT SYSTEMS; DYNAMIC-GAMES; POPULATION;
D O I
10.1080/00207179.2015.1129560
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider robust stochastic large population games for coupled Markov jump linear systems (MJLSs). The N agents' individual MJLSs are governed by different infinitesimal generators, and are affected not only by the control input but also by an individual disturbance (or adversarial) input. The mean field term, representing the average behaviour of N agents, is included in the individual worst-case cost function to capture coupling effects among agents. To circumvent the computational complexity and analyse the worst-case effect of the disturbance, we use robust mean field game theory to design low-complexity robust decentralised controllers and to characterise the associated worst-case disturbance. We show that with the individual robust decentralised controller and the corresponding worst-case disturbance, which constitute a saddle-point solution to a generic stochastic differential game for MJLSs, the actual mean field behaviour can be approximated by a deterministic function which is a fixed-point solution to the constructed mean field system. We further show that the closed-loop system is uniformly stable independent of N, and an approximate optimality can be obtained in the sense of epsilon-Nash equilibrium, where epsilon can be taken to be arbitrarily close to zero as N becomes sufficiently large. A numerical example is included to illustrate the results.
引用
收藏
页码:1367 / 1381
页数:15
相关论文
共 50 条
  • [41] Lyapunov coupled equations for continuous-time infinite Markov jump linear systems
    Fragoso, MD
    Baczynski, J
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2002, 274 (01) : 319 - 335
  • [42] On the control of jump linear Markov systems with Markov state estimation
    Gupta, V
    Murray, RM
    Hassibi, B
    PROCEEDINGS OF THE 2003 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2003, : 2893 - 2898
  • [43] Minimax control of Markov jump linear systems
    Geromel, Jose C.
    Deaecto, Grace S.
    Colaneri, Patrizio
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2016, 30 (8-10) : 1152 - 1162
  • [44] Adaptive control of linear Markov jump systems
    Cheng, Daizhan
    Zhang, Lijun
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2006, 37 (07) : 477 - 483
  • [45] State estimation of jump Markov linear systems
    Carlemalm, C
    Logothetis, A
    Krishnamurthy, V
    PROCEEDINGS OF THE 37TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1998, : 263 - 268
  • [46] Filtering for Nonlinear and Linear Markov Jump Systems
    Costa, Oswaldo L. V.
    de Oliveira, Andre M.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (05) : 3309 - 3316
  • [47] Parameter estimation for Jump Markov Linear Systems
    Balenzuela, Mark P.
    Wills, Adrian G.
    Renton, Christopher
    Ninness, Brett
    AUTOMATICA, 2022, 135
  • [48] Active Estimation for Jump Markov Linear Systems
    Blackmore, Lars
    Rajamanoharan, Senthooran
    Williams, Brian C.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2008, 53 (10) : 2223 - 2236
  • [49] AVERAGE REACHABILITY OF CONTINUOUS-TIME MARKOV JUMP LINEAR SYSTEMS AND THE LINEAR MINIMUM MEAN SQUARE ESTIMATOR
    Narvaez, Alfredo R. R.
    Costa, Eduardo F.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2016, 54 (04) : 2063 - 2089
  • [50] Mean square stability analysis of hybrid jump linear systems using a Markov kernel approach
    Tejada, Arturo
    Herencia-Zapana, Heber
    Gonzalez, Oscar R.
    Gray, W. Steven
    2007 AMERICAN CONTROL CONFERENCE, VOLS 1-13, 2007, : 508 - 513