Efficient solutions for a class of optimal stopping problems

被引:1
|
作者
Shechter, Steven M. [1 ]
机构
[1] Univ British Columbia, Operat & Logist Div, Sauder Sch Business, Vancouver, BC V6T 1Z2, Canada
关键词
Optimal stopping problems; Markov decision processes; Solution algorithms;
D O I
10.1016/j.orl.2012.05.005
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We show that a practical class of optimal stopping problems can be solved in at most N iterations of policy iteration. Under a lower triangularity assumption, one iteration of Gauss-Seidel value iteration yields the solution, while a subadditivity assumption implies an optimal control limit policy and an O(log N) algorithm. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:409 / 410
页数:2
相关论文
共 50 条
  • [1] ON A CLASS OF OPTIMAL STOPPING PROBLEMS
    CHOW, YS
    ROBBINS, H
    ANNALS OF MATHEMATICAL STATISTICS, 1965, 36 (03): : 1082 - &
  • [2] Numerical solutions of optimal stopping problems for a class of hybrid stochastic systems
    Ernst P.A.
    Ma X.
    Nazari M.H.
    Qian H.
    Wang L.Y.
    Yin G.
    Nonlinear Analysis: Hybrid Systems, 2024, 53
  • [3] ON APPROXIMATIVE SOLUTIONS OF OPTIMAL STOPPING PROBLEMS
    Faller, Andreas
    Rueschendorf, Ludger
    ADVANCES IN APPLIED PROBABILITY, 2011, 43 (04) : 1086 - 1108
  • [4] Approximate solutions to optimal stopping problems
    Tsitsiklis, JN
    VanRoy, B
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 1082 - 1088
  • [5] On a Class of Optimal Stopping Problems with Mixed Constraints
    Bruss, F. Thomas
    DISCRETE MATHEMATICS AND THEORETICAL COMPUTER SCIENCE, 2010, 12 (02): : 363 - 380
  • [6] EXPLICIT SOLUTIONS TO SOME PROBLEMS OF OPTIMAL STOPPING
    SHEPP, LA
    ANNALS OF MATHEMATICAL STATISTICS, 1969, 40 (03): : 993 - &
  • [7] On the existence of solutions of unbounded optimal stopping problems
    Zhitlukhin, M. V.
    Shiryaev, A. N.
    PROCEEDINGS OF THE STEKLOV INSTITUTE OF MATHEMATICS, 2014, 287 (01) : 299 - 307
  • [8] On the existence of solutions of unbounded optimal stopping problems
    M. V. Zhitlukhin
    A. N. Shiryaev
    Proceedings of the Steklov Institute of Mathematics, 2014, 287 : 299 - 307
  • [9] CLASS OF OPTIMAL STOPPING PROBLEMS FOR SAMPLING WITHOUT REPLACEMENT
    BERRY, DA
    BIOMETRIKA, 1974, 61 (02) : 361 - 368
  • [10] On a class of optimal stopping problems for diffusions with discontinuous coefficients
    Rueschendorf, Ludger
    Urusov, Mikhail A.
    ANNALS OF APPLIED PROBABILITY, 2008, 18 (03): : 847 - 878