AN UNBOUNDED BERGE'S MINIMUM THEOREM WITH APPLICATIONS TO DISCOUNTED MARKOV DECISION PROCESSES

被引:0
|
作者
Montes-de-Oca, Raul [1 ]
Lemus-Rodriguez, Enrique [2 ]
机构
[1] Univ Autonoma Metropolitana Iztapalapa, Dept Matemat, Mexico City 09340, DF, Mexico
[2] Univ Anahuac Mexico Norte, Escuela Actuaria, Huixquilucan 52786, Edo De Mexico, Mexico
关键词
Berge's minimum theorem; moment function; discounted Markov decision process; uniqueness of the optimal policy; continuous optimal policy; MAXIMUM THEOREMS; OPTIMAL POLICIES; CONTINUITY; GROWTH;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper deals with a certain class of unbounded optimization problems. The optimization problems taken into account depend on a parameter. Firstly, there are established conditions which permit to guarantee the continuity with respect to the parameter of the minimum of the optimization problems under consideration, and the upper semicontinuity of the multifunction which applies each parameter into its set of minimizers. Besides, with the additional condition of uniqueness of the minimizer, its continuity is given. Some examples of nonconvex optimization problems that satisfy the conditions of the article are supplied. Secondly, the theory developed is applied to discounted Markov decision processes with unbounded cost functions and with possibly noncompact actions sets in order to obtain continuous optimal policies. This part of the paper is illustrated with two examples of the controlled Lindley's random walk. One of these examples has nonconstant action sets.
引用
收藏
页码:268 / 286
页数:19
相关论文
共 50 条