Decomposition methods for monotone two-time-scale stochastic optimization problems

被引:0
|
作者
Rigaut, Tristan [1 ]
Carpentier, Pierre [2 ]
Chancelier, Jean-Philippe [3 ]
De Lara, Michel [3 ]
机构
[1] Schneider Elect, Grenoble, France
[2] ENSTA Paris, UMA, Palaiseau, France
[3] Ecole Ponts ParisTech, CERMICS, Champs Sur Marne, France
关键词
Dynamic programming; Decomposition methods; Long-term battery management; Multi-horizon; Two-time-scale;
D O I
10.1007/s10287-024-00510-5
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
It is common that strategic investment decisions are made at a slow time-scale, whereas operational decisions are made at a fast time-scale. Hence, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a time block decomposition scheme to address them numerically. More precisely, (i) we write recursive Bellman-like equations at the slow time-scale and (ii), under a suitable monotonicity assumption, we propose computable upper and lower bounds-relying respectively on primal and dual decomposition-for the corresponding slow time-scale Bellman functions. With these functions, we are able to design policies. We assess the methods tractability and validate their efficiency by solving a battery management problem where the fast time-scale operational decisions have an impact on the storage current capacity, hence on the strategic decisions to renew the battery at the slow time-scale.
引用
收藏
页数:37
相关论文
共 50 条
  • [1] A TWO-TIME-SCALE STOCHASTIC OPTIMIZATION FRAMEWORK WITH APPLICATIONS IN CONTROL AND REINFORCEMENT LEARNING
    Zeng, Sihan
    Doan, Thinh T.
    Romberg, Justin
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2024, 34 (01) : 946 - 976
  • [2] Distributed Local Two-Time-Scale Stochastic Approximation
    Thinh T Doan
    [J]. 2021 SEVENTH INDIAN CONTROL CONFERENCE (ICC), 2021, : 1 - 6
  • [3] Two-time-scale inverse problems: formulation and solution
    Puel, G.
    Aubry, D.
    [J]. 5TH INTERNATIONAL WORKSHOP ON NEW COMPUTATIONAL METHODS FOR INVERSE PROBLEMS (NCMIP2015), 2015, 657
  • [4] Large deviation for two-time-scale stochastic burgers equation
    Sun, Xiaobin
    Wang, Ran
    Xu, Lihu
    Yang, Xue
    [J]. STOCHASTICS AND DYNAMICS, 2021, 21 (05)
  • [5] Convergence rate of linear two-time-scale stochastic approximation
    Konda, VR
    Tsitsiklis, JN
    [J]. ANNALS OF APPLIED PROBABILITY, 2004, 14 (02): : 796 - 819
  • [6] Linear Two-Time-Scale Stochastic Approximation A Finite-Time Analysis
    Doan, Thinh T.
    Romberg, Justin
    [J]. 2019 57TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2019, : 399 - 406
  • [7] Two-Time-Scale Stochastic Optimization Dispatch of PV-Microgrid Considering Demand Side Management
    Liu Shilin
    Yu Weiwei
    [J]. PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 10604 - 10610
  • [9] Distributed two-time-scale methods over clustered networks
    Pham, Thiem, V
    Doan, Thinh T.
    Dinh Hoa Nguyen
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 4625 - 4630
  • [10] A TWO-TIME-SCALE ADAPTIVE SEARCH ALGORITHM FOR GLOBAL OPTIMIZATION
    Zhang, Qi
    Hu, Jiaqiao
    [J]. 2017 WINTER SIMULATION CONFERENCE (WSC), 2017, : 2069 - 2079