Disordered high-dimensional optimal control

被引:3
|
作者
Urbani, Pierfrancesco [1 ]
机构
[1] Univ Paris Saclay, CNRS, CEA, Inst Phys Theor, F-91191 Gif Sur Yvette, France
关键词
optimal control; disordered systems; stochastic processes; MEAN-FIELD GAMES; SYSTEMS;
D O I
10.1088/1751-8121/ac0645
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Mean field optimal control problems are a class of optimization problems that arise from optimal control when applied to the many body setting. In the noisy case one has a set of controllable stochastic processes and a cost function that is a functional of their trajectories. The goal of the optimization is to minimize this cost over the control variables. Here we consider the case in which we have N stochastic processes, or agents, with the associated control variables, which interact in a disordered way so that the resulting cost function is random. The goal is to find the average minimal cost for N -> infinity, when a typical realization of the quenched random interactions is considered. We introduce a simple model and show how to perform a dimensional reduction from the infinite dimensional case to a set of one dimensional stochastic partial differential equations of the Hamilton-Jacobi-Bellman and Fokker-Planck type. The statistical properties of the corresponding stochastic terms must be computed self-consistently, as we show explicitly.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] An optimal ADP algorithm for a high-dimensional stochastic control problem
    Nascimento, Juliana
    Powell, Warren
    2007 IEEE INTERNATIONAL SYMPOSIUM ON APPROXIMATE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING, 2007, : 52 - +
  • [2] Distributionally Robust Surrogate Optimal Control for High-Dimensional Systems
    Kandel, Aaron
    Park, Saehong
    Moura, Scott J.
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2023, 31 (03) : 1196 - 1207
  • [3] High-dimensional Optimal Density Control with Wasserstein Metric Matching
    Ma, Shaojun
    Hou, Mengxue
    Ye, Xiaojing
    Zhou, Haomin
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 6813 - 6818
  • [4] Interface growth in high-dimensional disordered systems
    Gat, O
    Olami, Z
    EUROPHYSICS LETTERS, 1996, 36 (01): : 49 - 54
  • [5] Efficient Algorithms for High-Dimensional Quantum Optimal Control of a Transmon Qubit
    Leng, Zhaoqi
    Mundada, Pranav
    Ghadimi, Saeed
    Houck, Andrew
    PHYSICAL REVIEW APPLIED, 2023, 19 (04)
  • [6] High-dimensional stochastic optimal control using continuous tensor decompositions
    Gorodetsky, Alex
    Karaman, Sertac
    Marzouk, Youssef
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2018, 37 (2-3): : 340 - 377
  • [7] Hallucinating optimal high-dimensional subspaces
    Arandjelovic, Ognjen
    PATTERN RECOGNITION, 2014, 47 (08) : 2662 - 2672
  • [8] Creation of high-dimensional entanglement of polar molecules via optimal control fields
    Zhang, Zuo-Yuan
    Liu, Jin-Ming
    PHYSICAL REVIEW A, 2022, 105 (02)
  • [9] Practical Deployment of Spectral Submanifold Reduction for Optimal Control of High-Dimensional Systems
    Alora, John Irvin
    Cenedese, Mattia
    Schmerling, Edward
    Haller, George
    Pavone, Marco
    IFAC PAPERSONLINE, 2023, 56 (02): : 4074 - 4081
  • [10] Optimal Sets of Projections of High-Dimensional Data
    Lehmann, Dirk J.
    Theisel, Holger
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (01) : 609 - 618