Cutoff for Markov chains: Some examples and applications

被引:0
|
作者
Ycart, B [1 ]
机构
[1] Univ Paris 05, UFR Math Info, F-75270 Paris 06, France
来源
COMPLEX SYSTEMS-BOOK | 2001年 / 6卷
关键词
D O I
暂无
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Some Markov chains converge very abruptly to their equilibrium: the total variation distance between the distribution of the chain at time t and its equilibrium measure is close to 1 until some deterministic 'cutoff time', and close to 0 shortly after. Many examples have been studied by Diaconis and his followers. Our goal is to introduce two families of examples of this phenomenon, focusing mainly on their possible applications. We present firstly samples of Markov chains for which the cutoff depends on the size of the sample. As an application, a new way of implementing Markov chain Monte-Carlo algorithms is proposed, using an explicit stopping rule based on the empirical measure of the sample. Then, we shall study Markov chains on countably many states, where the cutoff phenomenon depends on the starting point of the chain. As a particular case, a criterion of cutoff for birth and death chains on trees will be obtained. Jackson networks will show other applications of both cutoff situations.
引用
收藏
页码:261 / 300
页数:40
相关论文
共 50 条
  • [31] Limit theorems for some Markov chains
    Hille, Sander
    Horbacz, Katarzyna
    Szarek, Tomasz
    Wojewodka, Hanna
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2016, 443 (01) : 385 - 408
  • [32] STRONG STATIONARY DUALITY FOR MOBIUS MONOTONE MARKOV CHAINS: EXAMPLES
    Lorek, Pawel
    Szekli, Ryszard
    [J]. PROBABILITY AND MATHEMATICAL STATISTICS-POLAND, 2016, 36 (01): : 75 - 97
  • [33] Spectrum of large random reversible Markov chains: two examples
    Bordenave, Charles
    Caputo, Pietro
    Chafai, Djalil
    [J]. ALEA-LATIN AMERICAN JOURNAL OF PROBABILITY AND MATHEMATICAL STATISTICS, 2010, 7 : 41 - 64
  • [34] A Learning Scheme for Stationary Probabilities of Large Markov Chains With Examples
    Borkar, V. S.
    Das, D. J.
    Banik, A. Datta
    Manjunath, D.
    [J]. 2008 46TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1-3, 2008, : 1097 - +
  • [35] Simple examples of the use of Nash inequalities for finite Markov chains
    Saloff-Coste, L
    [J]. STOCHASTIC GEOMETRY: LIKELIHOOD AND COMPUTATION, 1999, 80 : 365 - 400
  • [36] SOME EXAMPLES CONCERNING THE GLOBAL MARKOV PROPERTY
    ISRAEL, RB
    [J]. COMMUNICATIONS IN MATHEMATICAL PHYSICS, 1986, 105 (04) : 669 - 673
  • [37] Monotonicity and convexity of some functions associated with denumerable Markov chains and their applications to queuing systems
    Yu, HB
    He, QM
    Zhang, HQ
    [J]. PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES, 2006, 20 (01) : 67 - 86
  • [38] A LAW OF LARGE NUMBERS FOR SOME MARKOV-CHAINS WITH ASYMPTOTICALLY STABLE DRIFT AND APPLICATIONS
    GALLARDO, L
    [J]. COMPTES RENDUS DE L ACADEMIE DES SCIENCES SERIE I-MATHEMATIQUE, 1994, 318 (06): : 567 - 572
  • [39] ON THE STABILITY OF SOME CONTROLLED MARKOV CHAINS AND ITS APPLICATIONS TO STOCHASTIC APPROXIMATION WITH MARKOVIAN DYNAMIC
    Andrieu, Christophe
    Tadic, Vladislav B.
    Vihola, Matti
    [J]. ANNALS OF APPLIED PROBABILITY, 2015, 25 (01): : 1 - 45
  • [40] Mixing times with applications to perturbed Markov chains
    Hunter, Jeffrey J.
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2006, 417 (01) : 108 - 123