Approximate dynamic programming for stochastic reachability

被引:0
|
作者
Kariotoglou, Nikolaos [1 ]
Summers, Sean [1 ]
Summers, Tyler [1 ]
Kamgarpour, Maryam [1 ]
Lygeros, John [1 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
关键词
HYBRID SYSTEMS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work we illustrate how approximate dynamic programing can be utilized to address problems of stochastic reachability in infinite state and control spaces. In particular we focus on the reach-avoid problem and approximate the value function on a linear combination of radial basis functions. In this way we get significant computational advantages with which we obtain tractable solutions to problems that cannot be solved via generic space gridding due to the curse of dimensionality. Numerical simulations indicate that control policies coming as a result of approximating the value function of stochastic reachability problems achieve close to optimal performance.
引用
收藏
页码:584 / 589
页数:6
相关论文
共 50 条
  • [1] An approximate dynamic programming approach to probabilistic reachability for stochastic hybrid systems
    Abate, Alessandro
    Prandini, Maria
    Lygeros, John
    Sastry, Shankar
    [J]. 47TH IEEE CONFERENCE ON DECISION AND CONTROL, 2008 (CDC 2008), 2008, : 4018 - 4023
  • [2] An Approximate Dynamic Programming Approach to Dynamic Stochastic Matching
    You, Fan
    Vossen, Thomas
    [J]. INFORMS JOURNAL ON COMPUTING, 2024, 36 (04) : 1006 - 1022
  • [3] MULTISTAGE STOCHASTIC DECOMPOSITION: A BRIDGE BETWEEN STOCHASTIC PROGRAMMING AND APPROXIMATE DYNAMIC PROGRAMMING
    Sen, Suvrajeet
    Zhou, Zhihong
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) : 127 - 153
  • [4] Approximate Dynamic Programming for Stochastic Resource Allocation Problems
    Ali Forootani
    Raffaele Iervolino
    Massimo Tipaldi
    Joshua Neilson
    [J]. IEEE/CAA Journal of Automatica Sinica, 2020, 7 (04) : 975 - 990
  • [5] Approximate stochastic dynamic programming for hydroelectric production planning
    Zephyr, Luckny
    Lang, Pascal
    Lamond, Bernard F.
    Cote, Pascal
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2017, 262 (02) : 586 - 601
  • [6] Approximate dynamic programming for stochastic resource allocation problems
    Forootani, Ali
    Iervolino, Raffaele
    Tipaldi, Massimo
    Neilson, Joshua
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (04) : 975 - 990
  • [7] Performance comparison of approximate dynamic programming techniques for dynamic stochastic scheduling
    Gocgun, Yasin
    [J]. INTERNATIONAL JOURNAL OF OPTIMIZATION AND CONTROL-THEORIES & APPLICATIONS-IJOCTA, 2021, 11 (02): : 178 - 185
  • [8] Approximate Stochastic Reachability for High Dimensional Systems
    Thorpe, Adam J.
    Sivaramakrishnan, Vignesh
    Oishi, Meeko M. K.
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1287 - 1293
  • [9] Stochastic Generation Capacity Expansion Planning with Approximate Dynamic Programming
    Bukenberger, Jesse
    Palmintier, Bryan
    [J]. 2018 IEEE/PES TRANSMISSION AND DISTRIBUTION CONFERENCE AND EXPOSITION (T&D), 2018,
  • [10] Approximate Dynamic Programming for Stochastic Systems with Additive and Multiplicative Noise
    Jiang, Yu
    Jiang, Zhong-Ping
    [J]. 2011 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL (ISIC), 2011, : 185 - 190