Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games

被引:46
|
作者
Lin, Alex Tong [1 ]
Fung, Samy Wu [1 ,2 ]
Li, Wuchen [3 ]
Nurbekyan, Levon [1 ]
Osher, Stanley J. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[2] Colorado Sch Mines, Dept Appl Math & Stat, Golden, CO 80401 USA
[3] Univ South Carolina, Dept Math, Columbia, SC 29208 USA
关键词
mean-field games; generative adversarial networks; Hamilton-Jacobi-Bellman; optimal control; optimal transport; HAMILTON-JACOBI EQUATIONS; DIFFERENTIAL-GAMES; ALGORITHM; CURSE; LOADS;
D O I
10.1073/pnas.2024713118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present APAC-Net, an alternating population and agent control neural network for solving stochastic mean-field games (MFGs). Our algorithm is geared toward high-dimensional instances of MFGs that are not approachable with existing solution methods. We achieve this in two steps. First, we take advantage of the underlying variational primal-dual structure that MFGs exhibit and phrase it as a convex-concave saddle-point problem. Second, we parameterize the value and density functions by two neural networks, respectively. By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN). We show the potential of our method on up to 100-dimensional MFG problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Model uncertainty stochastic mean-field control
    Agram, Nacira
    Oksendal, Bernt
    STOCHASTIC ANALYSIS AND APPLICATIONS, 2019, 37 (01) : 36 - 56
  • [22] Nonzero-Sum Stochastic Games and Mean-Field Games with Impulse Controls
    Basei, Matteo
    Cao, Haoyang
    Guo, Xin
    MATHEMATICS OF OPERATIONS RESEARCH, 2022, 47 (01) : 341 - 366
  • [23] Stochastic Control of Memory Mean-Field Processes
    Agram, Nacira
    Oksendal, Bernt
    APPLIED MATHEMATICS AND OPTIMIZATION, 2019, 79 (01): : 181 - 204
  • [24] On the relaxed mean-field stochastic control problem
    Bahlali, Khaled
    Mezerdi, Meriem
    Mezerdi, Brahim
    STOCHASTICS AND DYNAMICS, 2018, 18 (03)
  • [25] Mean-field inference methods for neural networks
    Gabrie, Marylou
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2020, 53 (22)
  • [26] Mean-field theory of fluid neural networks
    Delgado, J
    Sole, RV
    PHYSICAL REVIEW E, 1998, 57 (02) : 2204 - 2211
  • [27] Mean-field dynamics of a population of stochastic map neurons
    Franovic, Igor
    Maslennikov, Oleg V.
    Bacic, Iva
    Nekorkin, Vladimir I.
    PHYSICAL REVIEW E, 2017, 96 (01)
  • [28] Separable Gaussian neural networks for high-dimensional nonlinear stochastic systems
    Wang, Xi
    Xing, Siyuan
    Jiang, Jun
    Hong, Ling
    Sun, Jian-Qiao
    PROBABILISTIC ENGINEERING MECHANICS, 2024, 76
  • [29] One-Dimensional Forward–Forward Mean-Field Games
    Diogo A. Gomes
    Levon Nurbekyan
    Marc Sedjro
    Applied Mathematics & Optimization, 2016, 74 : 619 - 642
  • [30] OPINION DYNAMICS IN SOCIAL NETWORKS THROUGH MEAN-FIELD GAMES
    Bauso, D.
    Tembine, H.
    Basar, T.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2016, 54 (06) : 3225 - 3257