On the Average-Cost Optimality Equations and Convergence of Discounted-Cost Relative Value Functions for Inventory Control Problems with Quasiconvex Cost Functions

被引:0
|
作者
Feinberg, Eugene A. [1 ]
Liang, Yan [1 ]
机构
[1] SUNY Stony Brook, Dept Appl Math & Stat, Stony Brook, NY 11794 USA
关键词
Markov processes; Stochastic systems; Optimal control; MARKOV DECISION-PROCESSES; FELLER TRANSITION-PROBABILITIES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Average-cost optimality inequalities imply the existence of stationary optimal policies for Markov Decision Processes with average costs per unit time, and these inequalities hold under broad natural conditions. Additional conditions are required for the validity of the average-cost optimality equations. Recently Feinberg and Liang [10, Theorem 3.2] showed that the equicontinuity of value functions for discounted costs is sufficient additional condition for the validity of average-cost optimality equations for problems with weakly continuous transition probabilities and with possibly unbounded one-step costs, and this condition holds for setup-cost inventory control problems with backorders and convex holding/backlog costs. This paper studies periodic-review setup-cost inventory control problem with backorders and with quasiconvex cost functions and general demands. It is shown that such problems satisfy the equicontinuity condition. Therefore, optimality inequalities hold in the form of equalities with a continuous average-cost relative value function for this problem. In addition, this implies that average-cost optimal (s, S) policies for the inventory control problem can be derived from the average-cost optimality equation. With the additional assumption on the monotonicity of the cost function, we establish the convergence of discounted-cost optimal ordering threshold s(alpha) and convergence of discounted-cost relative value functions, when the discount factor converges to 1, to the corresponding optimal threshold and optimal relative value function for the average-cost problem.
引用
收藏
页数:6
相关论文
共 20 条