ON OPTIMAL STOPPING OF RANDOM SEQUENCES MODULATED BY MARKOV CHAIN

被引：0

作者：

Presman, E. L. ^{[1
]}

Sonin, I. M. ^{[1
,2
]}

机构：

[1] CEMI RAS, Moscow 117428, Russia

[2] Univ N Carolina, Dept Math, Charlotte, NC 28223 USA

来源：

THEORY OF PROBABILITY AND ITS APPLICATIONS | 2010年 / 54卷 / 03期

关键词：

Markov chain; optimal stopping; state elimination algorithm; seasonal observations;

D O I：

10.1137/S0040585X97984395

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

This paper has two main goals: first, to describe a new class of optimal stopping (OS) problems for which the solutions can be found either in an explicit form, or in a finite number of steps, and second, to demonstrate the potential of the state elimination algorithm developed by one of the authors earlier, for the problem of OS of a finite or countable Markov chain.

引用

页码：534 / 542

页数：9

共 50 条

[1] Optimal multiple stopping of Markov sequences
Nikolaev, ML
THEORY OF PROBABILITY AND ITS APPLICATIONS, 1999, 43 (02) : 298 - 306
[2] Sequences of random matrices modulated by a discrete-time Markov chain*
Yin, George
Nguyen, Huy
STOCHASTIC MODELS, 2023, 39 (04) : 797 - 822
[3] Weak convergence of Markov-modulated random sequences
Nguyen, Son Luu
Yin, G.
STOCHASTICS-AN INTERNATIONAL JOURNAL OF PROBABILITY AND STOCHASTIC PROCESSES, 2010, 82 (06) : 521 - 552
[4] OPTIMAL STOPPING AND ALMOST SURE CONVERGENCE OF RANDOM SEQUENCES
ENGELBERT, A
ENGELBERT, HJ
ZEITSCHRIFT FUR WAHRSCHEINLICHKEITSTHEORIE UND VERWANDTE GEBIETE, 1979, 48 (03): : 309 - 325
[5] THE PROBLEM OF OPTIMAL STOPPING IN A PARTIALLY OBSERVABLE MARKOV-CHAIN
NAKAI, T
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1985, 45 (03) : 425 - 442
[6] POWER SPECTRA OF RANDOM PULSE PROCESSES IN WHICH PULSE PARAMETERS ARE MODULATED BY SEQUENCES OF SIMPLE MARKOV CHAIN TYPES
DYAKOV, VS
KONOVALO.GV
TARASENK.YN
RADIO ENGINEERING AND ELECTRONIC PHYSICS-USSR, 1968, 13 (02): : 307 - &
[7] The optimal stopping of a Markov chain and recursive solution of Poisson and Bellman equations
Sonin, IM
From Stochastic Calculus to Mathematical Finance: The Shiryaev Festschrift, 2006, : 609 - 621
[8] OPTIMAL STOPPING IN A MARKOV PROCESS
TAYLOR, HM
ANNALS OF MATHEMATICAL STATISTICS, 1967, 38 (06): : 1938 - &
[9] OPTIMAL STOPPING IN A MARKOV PROCESS
TAYLOR, HM
ANNALS OF MATHEMATICAL STATISTICS, 1968, 39 (04): : 1333 - &
[10] OPTIMAL STOPPING OF A MARKOV PROCESS
FAKEEV, AG
THEORY OF PROBILITY AND ITS APPLICATIONS,USSR, 1971, 16 (04): : 694 - 696

← 1 2 3 4 5 →