Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games

被引:46
|
作者
Lin, Alex Tong [1 ]
Fung, Samy Wu [1 ,2 ]
Li, Wuchen [3 ]
Nurbekyan, Levon [1 ]
Osher, Stanley J. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
[2] Colorado Sch Mines, Dept Appl Math & Stat, Golden, CO 80401 USA
[3] Univ South Carolina, Dept Math, Columbia, SC 29208 USA
关键词
mean-field games; generative adversarial networks; Hamilton-Jacobi-Bellman; optimal control; optimal transport; HAMILTON-JACOBI EQUATIONS; DIFFERENTIAL-GAMES; ALGORITHM; CURSE; LOADS;
D O I
10.1073/pnas.2024713118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present APAC-Net, an alternating population and agent control neural network for solving stochastic mean-field games (MFGs). Our algorithm is geared toward high-dimensional instances of MFGs that are not approachable with existing solution methods. We achieve this in two steps. First, we take advantage of the underlying variational primal-dual structure that MFGs exhibit and phrase it as a convex-concave saddle-point problem. Second, we parameterize the value and density functions by two neural networks, respectively. By phrasing the problem in this manner, solving the MFG can be interpreted as a special case of training a generative adversarial network (GAN). We show the potential of our method on up to 100-dimensional MFG problems.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A machine learning framework for solving high-dimensional mean field game and mean field control problems
    Ruthotto, Lars
    Osher, Stanley J.
    Li, Wuchen
    Nurbekyan, Levon
    Fung, Samy Wu
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2020, 117 (17) : 9183 - 9193
  • [42] Self-Consistent Chaotic Transport in a High-Dimensional Mean-Field Hamiltonian Map Model
    Martinez-del-Rio, D.
    del-Castillo-Negrete, D.
    Olvera, A.
    Calleja, R.
    QUALITATIVE THEORY OF DYNAMICAL SYSTEMS, 2015, 14 (02) : 313 - 335
  • [43] Self-Consistent Chaotic Transport in a High-Dimensional Mean-Field Hamiltonian Map Model
    D. Martínez-del-Río
    D. del-Castillo-Negrete
    A. Olvera
    R. Calleja
    Qualitative Theory of Dynamical Systems, 2015, 14 : 313 - 335
  • [44] One-Dimensional Stationary Mean-Field Games with Local Coupling
    Diogo A. Gomes
    Levon Nurbekyan
    Mariana Prazeres
    Dynamic Games and Applications, 2018, 8 : 315 - 351
  • [45] One-Dimensional Stationary Mean-Field Games with Local Coupling
    Gomes, Diogo A.
    Nurbekyan, Levon
    Prazeres, Mariana
    DYNAMIC GAMES AND APPLICATIONS, 2018, 8 (02) : 315 - 351
  • [46] One-Dimensional Forward-Forward Mean-Field Games
    Gomes, Diogo A.
    Nurbekyan, Levon
    Sedjro, Marc
    APPLIED MATHEMATICS AND OPTIMIZATION, 2016, 74 (03): : 619 - 642
  • [47] Consensus via multi-population robust mean-field games
    Bauso, D.
    SYSTEMS & CONTROL LETTERS, 2017, 107 : 76 - 83
  • [48] Actor-Critic Learning Algorithms for Mean-Field Control with Moment Neural Networks
    Pham, Huyen
    Warin, Xavier
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2025, 27 (01)
  • [49] Mean-Field Games for Resource Sharing in Cloud-Based Networks
    Hanif, Ahmed Farhan
    Tembine, Hamidou
    Assaad, Mohamad
    Zeghlache, Djamal
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (01) : 624 - 637
  • [50] Incentive Feedback Stackelberg Strategy in Mean-Field Type Stochastic Difference Games
    GAO Wenhui
    LIN Yaning
    ZHANG Weihai
    JournalofSystemsScience&Complexity, 2024, 37 (04) : 1425 - 1445