Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games

被引:46
|
作者
Lin, Alex Tong [1 ]
Fung, Samy Wu [1 ,2 ]
Li, Wuchen [3 ]
Nurbekyan, Levon [1 ]
Osher, Stanley J. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[2] Colorado Sch Mines, Dept Appl Math & Stat, Golden, CO 80401 USA
[3] Univ South Carolina, Dept Math, Columbia, SC 29208 USA
关键词
mean-field games; generative adversarial networks; Hamilton-Jacobi-Bellman; optimal control; optimal transport; HAMILTON-JACOBI EQUATIONS; DIFFERENTIAL-GAMES; ALGORITHM; CURSE; LOADS;
D O I
10.1073/pnas.2024713118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present APAC-Net, an alternating population and agent control neural network for solving stochastic mean-field games (MFGs). Our algorithm is geared toward high-dimensional instances of MFGs that are not approachable with existing solution methods. We achieve this in two steps. First, we take advantage of the underlying variational primal-dual structure that MFGs exhibit and phrase it as a convex-concave saddle-point problem. Second, we parameterize the value and density functions by two neural networks, respectively. By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN). We show the potential of our method on up to 100-dimensional MFG problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Coupled Alternating Neural Networks for Solving Multi-Population High-Dimensional Mean-Field Games
    Wang, Guofang
    Fang, Jing
    Jiang, Lulu
    Yao, Wang
    Li, Ning
    MATHEMATICS, 2024, 12 (23)
  • [2] Random features for high-dimensional nonlocal mean-field games
    Agrawal, Sudhanshu
    Lee, Wonjun
    Fung, Samy Wu
    Nurbekyan, Levon
    JOURNAL OF COMPUTATIONAL PHYSICS, 2022, 459
  • [3] Stochastic mean-field formulation of the dynamics of diluted neural networks
    David Angulo-Garcia
    Alessandro Torcini
    BMC Neuroscience, 16 (Suppl 1)
  • [4] Stochastic mean-field formulation of the dynamics of diluted neural networks
    Angulo-Garcia, D.
    Torcini, A.
    PHYSICAL REVIEW E, 2015, 91 (02):
  • [5] Deep Learning and Mean-Field Games: A Stochastic Optimal Control Perspective
    Di Persio, Luca
    Garbelli, Matteo
    SYMMETRY-BASEL, 2021, 13 (01): : 1 - 20
  • [6] Singular mean-field control games
    Hu, Yaozhong
    Oksendal, Bernt
    Sulem, Agnes
    STOCHASTIC ANALYSIS AND APPLICATIONS, 2017, 35 (05) : 823 - 851
  • [7] Deep Policy Iteration for high-dimensional mean field games
    Assouli, Mouhcine
    Missaoui, Badr
    APPLIED MATHEMATICS AND COMPUTATION, 2024, 481
  • [8] Robust Incentive Stackelberg Games With a Large Population for Stochastic Mean-Field Systems
    Mukaidani, Hiroaki
    Irie, Shunpei
    Xu, Hua
    Zhuang, Weihua
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 1934 - 1939
  • [9] Dynamic Population Games: A Tractable Intersection of Mean-Field Games and Population Games
    Elokda, Ezzat
    Bolognani, Saverio
    Censi, Andrea
    Dorfler, Florian
    Frazzoli, Emilio
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 1072 - 1077
  • [10] Mean-field games with logistic population dynamics
    Gomes, Diogo Aguiar
    Ribeiro, Ricardo de Lima
    2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 2513 - 2518