Optimal Control of Markov Processes with Age-Dependent Transition Rates

被引:0
|
作者
Mrinal K. Ghosh
Subhamay Saha
机构
[1] Indian Institute of Science,Department of Mathematics
来源
关键词
Age-dependent transition rates; Semi-Markov decision process; Infinite horizon discounted cost; Infinite horizon average cost;
D O I
暂无
中图分类号
学科分类号
摘要
We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.
引用
收藏
页码:257 / 271
页数:14
相关论文
共 50 条
  • [1] Optimal Control of Markov Processes with Age-Dependent Transition Rates
    Ghosh, Mrinal K.
    Saha, Subhamay
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2012, 66 (02): : 257 - 271
  • [2] Stochastic Processes with Age-Dependent Transition Rates
    Ghosh, Mrinal K.
    Saha, Subhamay
    [J]. STOCHASTIC ANALYSIS AND APPLICATIONS, 2011, 29 (03) : 511 - 522
  • [3] RELAXATION PROCESSES WITH AGE-DEPENDENT TRANSITION RATES
    HALPERN, V
    [J]. JOURNAL OF NON-CRYSTALLINE SOLIDS, 1991, 131 : 210 - 212
  • [4] Optimal control of an influenza model with seasonal forcing and age-dependent transmission rates
    Lee, Jeehyun
    Kim, Jungeun
    Kwon, Hee-Dae
    [J]. JOURNAL OF THEORETICAL BIOLOGY, 2013, 317 : 310 - 320
  • [5] Supercritical age-dependent branching Markov processes and their scaling limits
    Athreya, Krishna B.
    Athreya, Siva R.
    Iyer, Srikanth K.
    [J]. BERNOULLI, 2011, 17 (01) : 138 - 154
  • [6] Critical age-dependent branching Markov processes and their scaling limits
    Krishna B. Athreya
    Siva R. Athreya
    Srikanth K. Iyer
    [J]. Proceedings - Mathematical Sciences, 2010, 120 : 363 - 385
  • [7] Critical age-dependent branching Markov processes and their scaling limits
    Athreya, Krishna B.
    Athreya, Siva R.
    Iyer, Srikanth K.
    [J]. PROCEEDINGS OF THE INDIAN ACADEMY OF SCIENCES-MATHEMATICAL SCIENCES, 2010, 120 (03): : 363 - 385
  • [8] OPTIMAL-CONTROL OF AGE-DEPENDENT POPULATIONS
    GOPALSAMY, K
    [J]. MATHEMATICAL BIOSCIENCES, 1976, 32 (1-2) : 155 - 163
  • [9] MODELING OF SELECTION PROCESSES WITH AGE-DEPENDENT BIRTH AND DEATH RATES
    EBELING, W
    ENGEL, A
    MAZENKO, VG
    [J]. BIOSYSTEMS, 1986, 19 (03) : 213 - 221
  • [10] Optimal birth control of age-dependent competitive species
    He, ZR
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2004, 296 (01) : 286 - 301