Non-randomized policies for constrained Markov decision processes

被引：18
|
作者：
Chen, Richard C.
Feinberg, Eugene A.
机构：
[1] USN, Res Lab, Div Radar, Washington, DC 20375 USA
[2] SUNY Stony Brook, Dept Appl Math & Stat, Stony Brook, NY 11794 USA
来源：
MATHEMATICAL METHODS OF OPERATIONS RESEARCH | 2007年 / 66卷 / 01期
关键词：
constrained Markov; decision processes; dynamic programming; non-randomized policies;
D O I：
10.1007/s00186-006-0133-x
中图分类号：
C93 [管理学]; O22 [运筹学];
学科分类号：
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要：
This paper addresses constrained Markov decision processes, with expected discounted total cost criteria, which are controlled by non-randomized policies. A dynamic programming approach is used to construct optimal policies. The convergence of the series of finite horizon value functions to the infinite horizon value function is also shown. A simple example illustrating an application is presented.
引用
收藏
页码：165 / 179
页数：15
相关论文
共 50 条
  • [41] Constrained discounted Markov decision processes and Hamiltonian Cycles
    Feinberg, EA
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2000, 25 (01) : 130 - 140
  • [42] Stochastic approximations of constrained discounted Markov decision processes
    Dufour, Francois
    Prieto-Rumeau, Tomas
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2014, 413 (02) : 856 - 879
  • [43] Constrained Markov decision processes with first passage criteria
    Huang, Yonghui
    Wei, Qingda
    Guo, Xianping
    [J]. ANNALS OF OPERATIONS RESEARCH, 2013, 206 (01) : 197 - 219
  • [44] Constrained discounted semi-Markov decision processes
    Feinberg, EA
    [J]. MARKOV PROCESSES AND CONTROLLED MARKOV CHAINS, 2002, : 233 - 244
  • [45] STOCHASTIC DOMINANCE-CONSTRAINED MARKOV DECISION PROCESSES
    Haskell, William B.
    Jain, Rahul
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (01) : 273 - 303
  • [46] Joint chance-constrained Markov decision processes
    V Varagapriya
    Vikas Vikram Singh
    Abdel Lisser
    [J]. Annals of Operations Research, 2023, 322 : 1013 - 1035
  • [47] Planning using hierarchical constrained Markov decision processes
    Feyzabadi, Seyedshams
    Carpin, Stefano
    [J]. AUTONOMOUS ROBOTS, 2017, 41 (08) : 1589 - 1607
  • [48] Constrained Risk-Averse Markov Decision Processes
    Ahmadi, Mohamadreza
    Rosolia, Ugo
    Ingham, Michel D.
    Murray, Richard M.
    Ames, Aaron D.
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11718 - 11725
  • [49] Joint chance-constrained Markov decision processes
    Varagapriya, V.
    Singh, Vikas Vikram
    Lisser, Abdel
    [J]. ANNALS OF OPERATIONS RESEARCH, 2023, 322 (02) : 1013 - 1035
  • [50] Strict-sense constrained Markov decision processes
    Hsu, SP
    Arapostathis, A
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 194 - 199
12345