SINGULAR PERTURBATIONS IN RISK-SENSITIVE STOCHASTIC CONTROL

被引:5
|
作者
Borkar, V. S. [1 ]
Kumar, K. Suresh [2 ]
机构
[1] Tata Inst Fundamental Res, Sch Technol & Comp Sci, Bombay 400005, Maharashtra, India
[2] Indian Inst Technol, Dept Math, Bombay 400076, Maharashtra, India
关键词
risk-sensitive control; singular perturbations; two time scales; averaging; Hamilton-Jacobi-Isaacs equation; ERGODIC CONTROL;
D O I
10.1137/090750081
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Control of nondegenerate diffusions with infinite horizon risk-sensitive criterion is studied when the dynamics exhibits two distinct time scales. If the time scales are separated by a factor epsilon > 0, then it is shown that under suitable hypotheses, as epsilon down arrow 0, the optimal cost converges to the optimal risk-sensitive cost for a reduced order controlled diffusion. The dynamics of this diffusion corresponds to the dynamics of the slower variables of the original process, with the dependence on the fast variables averaged out as per the asymptotic behavior of the latter. The arguments use a logarithmic transformation to convert the risk-sensitive control problem into a two-person zero-sum ergodic game, followed by the small parameter asymptotics of the associated Hamilton-Jacobi-Isaacs equation.
引用
收藏
页码:3675 / 3697
页数:23
相关论文
共 50 条
  • [21] Risk-sensitive mean field stochastic games
    Tembine, Hamidou
    [J]. 2011 50TH IEEE CONFERENCE ON DECISION AND CONTROL AND EUROPEAN CONTROL CONFERENCE (CDC-ECC), 2011, : 4264 - 4269
  • [22] A Stochastic Interpretation of Stochastic Mirror Descent: Risk-Sensitive Optimality
    Azizan, Navid
    Hassibi, Babak
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 3960 - 3965
  • [23] Data-Driven Direct Adaptive Risk-Sensitive Control of Stochastic Systems
    QIAO Nan
    LI Tao
    [J]. Journal of Systems Science & Complexity, 2024, 37 (04) : 1446 - 1469
  • [24] A risk-sensitive stochastic control approach to an optimal investment problem with partial information
    Hata, Hiroaki
    Iida, Yasunari
    [J]. FINANCE AND STOCHASTICS, 2006, 10 (03) : 395 - 426
  • [25] ASYMPTOTIC ANALYSIS OF NONLINEAR STOCHASTIC RISK-SENSITIVE CONTROL AND DIFFERENTIAL-GAMES
    JAMES, MR
    [J]. MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 1992, 5 (04) : 401 - 417
  • [26] The optimal control for the output feedback stochastic system under the risk-sensitive cost
    Dai, LY
    Pan, ZG
    Shi, SJ
    [J]. PROCEEDINGS OF THE 4TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-4, 2002, : 273 - 277
  • [27] A risk-sensitive stochastic control approach to an optimal investment problem with partial information
    Hiroaki Hata
    Yasunari Iida
    [J]. Finance and Stochastics, 2006, 10 : 395 - 426
  • [28] Maximum Principle for Risk-Sensitive Stochastic Optimal Control Problem and Applications to Finance
    Shi, Jingtao
    Wu, Zhen
    [J]. STOCHASTIC ANALYSIS AND APPLICATIONS, 2012, 30 (06) : 997 - 1018
  • [29] Risk-sensitive Dissipativity of Linear Quantum Stochastic Systems under Lur'e Type Perturbations of Hamiltonians
    Vladimirov, Igor G.
    Petersen, Ian R.
    [J]. 2012 2ND AUSTRALIAN CONTROL CONFERENCE (AUCC), 2012, : 247 - 252
  • [30] A Stochastic Maximum Principle for Risk-Sensitive Mean-Field-Type Control
    Djehiche, Boualem
    Tembine, Hamidou
    Tempone, Raul
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 3481 - 3486