Risk sensitive control of Markov processes in countable state space

被引：91

作者：

HernandezHernandez, D ^{[1
]}

Marcus, SI ^{[1
]}

机构：

[1] UNIV MARYLAND,DEPT ELECT ENGN,COLLEGE PK,MD 20742

来源：

SYSTEMS & CONTROL LETTERS | 1996年 / 29卷 / 03期

基金：

美国国家科学基金会;

关键词：

risk-sensitive control; stochastic dynamic games; Isaacs equation; stochastic control; average cost;

D O I：

10.1016/S0167-6911(96)00051-5

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper we consider infinite horizon risk-sensitive control of Markov processes with discrete time and denumerable state space. This problem is solved by proving, under suitable conditions, that there exists a bounded solution to the dynamic programming equation. The dynamic programming equation is transformed into an Isaacs equation for a stochastic game, and the vanishing discount method is used to study its solution. In addition, we prove that the existence conditions are also necessary.

引用

页码：147 / 155

页数：9

共 50 条

[1] Ergodic risk-sensitive control of Markov processes on countable state space revisited
Biswas, Anup
Pradhan, Somnath
[J]. ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2022, 28
[2] Risk sensitive control of Markov processes in countable state space (vol 29, pg 147, 1996)
Hernandez-Hernandez, D
Marcus, SI
[J]. SYSTEMS & CONTROL LETTERS, 1998, 34 (1-2) : 105 - 106
[3] SEMI-MARKOV PROCESSES - COUNTABLE STATE-SPACE
PYKE, R
[J]. ANNALS OF MATHEMATICAL STATISTICS, 1960, 31 (01): : 245 - 246
[4] Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space
Kumar, K. Suresh
Pal, Chandan
[J]. STOCHASTIC ANALYSIS AND APPLICATIONS, 2015, 33 (05) : 863 - 881
[5] RISK-SENSITIVE MARKOV CONTROL PROCESSES
Shen, Yun
Stannat, Wilhelm
Obermayer, Klaus
[J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (05) : 3652 - 3672
[6] Risk sensitive control of pure jump processes on a general state space
Pal, Chandan
Pradhan, Somnath
[J]. STOCHASTICS-AN INTERNATIONAL JOURNAL OF PROBABILITY AND STOCHASTIC PROCESSES, 2019, 91 (02) : 155 - 174
[7] Remarks on risk sensitive adaptive control of Markov processes
Duncan, T. E.
Pasik-Duncan, B.
Stettner, L.
[J]. PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 2865 - 2865
[8] Correlation decay for Markov maps on a countable state space
Maume-Deschamps, V
[J]. ERGODIC THEORY AND DYNAMICAL SYSTEMS, 2001, 21 : 165 - 196
[9] FELLER PROPERTY FOR MARKOV SEMIGROUPS ON A COUNTABLE STATE SPACE
REUTER, GEH
RILEY, PW
[J]. JOURNAL OF THE LONDON MATHEMATICAL SOCIETY-SECOND SERIES, 1972, 5 (AUG): : 267 - &
[10] Large deviations for the empirical measure and empirical flow of Markov renewal processes with a countable state space
Jia, Chen
Jiang, Da-Quan
Wu, Bingjie
[J]. ELECTRONIC JOURNAL OF PROBABILITY, 2024, 29

← 1 2 3 4 5 →