Coefficients of ergodicity for Markov chains with uncertain parameters

被引:20
|
作者
Skulj, D. [1 ]
Hable, R. [2 ]
机构
[1] Fac Social Sci, Ljubljana 1000, Slovenia
[2] Dept Math, D-95440 Bayreuth, Germany
关键词
Markov chain; Imprecise Markov chain; Coefficient of ergodicity; Weak coefficient of ergodicity; Uniform coefficient of ergodicity; Lower expectation; Upper expectation; Hausdorff metric; Convergence of Markov chains; DECISION-PROCESSES;
D O I
10.1007/s00184-011-0378-0
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
One of the central considerations in the theory of Markov chains is their convergence to an equilibrium. Coefficients of ergodicity provide an efficient method for such an analysis. Besides giving sufficient and sometimes necessary conditions for convergence, they additionally measure its rate. In this paper we explore coefficients of ergodicity for the case of imprecise Markov chains. The latter provide a convenient way of modelling dynamical systems where parameters are not determined precisely. In such cases a tool for measuring the rate of convergence is even more important than in the case of precisely determined Markov chains, since most of the existing methods of estimating the limit distributions are iterative. We define a new coefficient of ergodicity that provides necessary and sufficient conditions for convergence of the most commonly used class of imprecise Markov chains. This so-called weak coefficient of ergodicity is defined through an endowment of the structure of a metric space to the class of imprecise probabilities. Therefore we first make a detailed analysis of the metric properties of imprecise probabilities.
引用
收藏
页码:107 / 133
页数:27
相关论文
共 50 条
  • [31] Geometric ergodicity for classes of homogeneous Markov chains
    Galtchouk, L.
    Pergamenshchikov, S.
    [J]. STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2014, 124 (10) : 3362 - 3391
  • [32] On the ergodicity of slow-varying nonstationary Markov chains
    Wu, Jinn-Wen
    Chen, Kuo-Chih
    [J]. STOCHASTIC ANALYSIS AND APPLICATIONS, 2008, 26 (04) : 724 - 737
  • [33] Extremal indices, geometric ergodicity of Markov chains, and MCMC
    Roberts G.O.
    Rosenthal J.S.
    Segers J.
    Sousa B.
    [J]. Extremes, 2006, 9 (3-4) : 213 - 229
  • [34] On Ergodicity and Stability Estimates for Some Nonhomogeneous Markov Chains
    D. B. Andreev
    M. A. Elesin
    E. A. Krylov
    A. V. Kuznetsov
    A. I. Zeifman
    [J]. Journal of Mathematical Sciences, 2002, 112 (2) : 4111 - 4118
  • [35] Markov chains: Ergodicity in time-discrete cases
    Katilova, N.
    [J]. ROCKY MOUNTAIN JOURNAL OF MATHEMATICS, 2008, 38 (03) : 941 - 954
  • [36] ERGODICITY AND STABILITY OF THE CONDITIONAL DISTRIBUTIONS OF NONDEGENERATE MARKOV CHAINS
    Tong, Xin Thomson
    van Handel, Ramon
    [J]. ANNALS OF APPLIED PROBABILITY, 2012, 22 (04): : 1495 - 1540
  • [37] Characterization and sufficient conditions for normed ergodicity of Markov chains
    Borovkov, AA
    Hordijk, A
    [J]. ADVANCES IN APPLIED PROBABILITY, 2004, 36 (01) : 227 - 242
  • [39] 2 RECENT PAPERS ON ERGODICITY IN NONHOMOGENEOUS MARKOV CHAINS
    IOSIFESCU, M
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1972, 43 (05): : 1732 - +
  • [40] Subgeometric ergodicity for continuous-time Markov chains
    Liu, Yuanyuan
    Zhang, Hanjun
    Zhao, Yiqiang
    [J]. JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2010, 368 (01) : 178 - 189