Singularly Perturbed Forward-Backward Stochastic Differential Equations: Application to the Optimal Control of Bilinear Systems

被引:3
|
作者
Kebiri, Omar [1 ,2 ]
Neureither, Lara [2 ]
Hartmann, Carsten [2 ]
机构
[1] Univ Abou Bekr Belkaid Tlemcen, Lab Stat & Random Modeling, Tilimsen 13000, Algeria
[2] Brandenburg Tech Univ Cottbus Senftenberg, Inst Math, D-03046 Cottbus, Germany
来源
COMPUTATION | 2018年 / 6卷 / 03期
关键词
linear quadratic stochastic control; bilinear systems; slow-fast dynamics; model reduction; forward-backward stochastic differential equations; least squares Monte Carlo;
D O I
10.3390/computation6030041
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We study linear-quadratic stochastic optimal control problems with bilinear state dependence where the underlying stochastic differential equation (SDE) has multiscale features. We show that, in the same way in which the underlying dynamics can be well approximated by a reduced-order dynamics in the scale separation limit (using classical homogenization results), the associated optimal expected cost converges to an effective optimal cost in the scale separation limit. This entails that we can approximate the stochastic optimal control for the whole system by a reduced-order stochastic optimal control, which is easier to compute because of the lower dimensionality of the problem. The approach uses an equivalent formulation of the Hamilton-Jacobi-Bellman (HJB) equation, in terms of forward-backward SDEs (FBSDEs). We exploit the efficient solvability of FBSDEs via a least squares Monte Carlo algorithm and show its applicability by a suitable numerical example.
引用
收藏
页数:18
相关论文
共 50 条