Criteria for Geometric and Algebraic Transience for Discrete-Time Markov Chains

被引:1
|
作者
Mao, Yong-Hua [1 ]
Song, Yan-Hong [2 ]
机构
[1] Beijing Normal Univ, Sch Math Sci, Lab Math & Complex Syst, Minist Educ, Beijing 100875, Peoples R China
[2] Zhongnan Univ Econ & Law, Sch Stat & Math, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Markov chain; Geometric transience; Algebraic transience; First return time; Last exit time; Drift condition; SUBGEOMETRIC RATES; CONVERGENCE; ERGODICITY; PROPERTY;
D O I
10.1007/s10959-021-01105-5
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present new criteria for geometric and algebraic transience for discrete-time transient Markov chains on general state spaces, based on the moment of the last exit time, the modified moment of the first return time and the drift condition for the transition kernel. These criteria turn out to be more convenient to use, supplementing and extending conditions introduced by Mao and Song [Stochastic Process. Appl. 124 (2014) 1648-1678]. Several applications are presented including discrete queueing Markov chains, Galton-Watson branching processes, downwardly skip-free chains, unrestricted random walks and autoregressive models of order one.
引用
收藏
页码:1974 / 2008
页数:35
相关论文
共 50 条
  • [41] Nested Reachability Approximation for Discrete-Time Markov Chains with Univariate Parameters
    Su, Guoxin
    Rosenblum, David S.
    AUTOMATED TECHNOLOGY FOR VERIFICATION AND ANALYSIS, ATVA 2014, 2014, 8837 : 364 - 379
  • [42] Quasi-stationary distributions for a class of discrete-time Markov chains
    Coolen-Schrijner, Pauline
    van Doorn, Erik A.
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2006, 8 (04) : 449 - 465
  • [43] Quasi-stationary Distributions for a Class of Discrete-time Markov Chains
    Pauline Coolen-Schrijner
    Erik A. van Doorn
    Methodology and Computing in Applied Probability, 2006, 8 : 449 - 465
  • [44] Quasi-Stationarity of Discrete-Time Markov Chains with Drift to Infinity
    Pauline Coolen-Schrijner
    Phil Pollett
    Methodology And Computing In Applied Probability, 1999, 1 (1) : 81 - 96
  • [45] On transience conditions for Markov chains
    Foss, SG
    Denisov, DÉ
    SIBERIAN MATHEMATICAL JOURNAL, 2001, 42 (02) : 364 - 371
  • [46] ERROR BOUNDS FOR AUGMENTED TRUNCATIONS OF DISCRETE-TIME BLOCK-MONOTONE MARKOV CHAINS UNDER GEOMETRIC DRIFT CONDITIONS
    Masuyama, Hiroyuki
    ADVANCES IN APPLIED PROBABILITY, 2015, 47 (01) : 83 - 105
  • [47] CYCLE SYMMETRIES AND CIRCULATION FLUCTUATIONS FOR DISCRETE-TIME AND CONTINUOUS-TIME MARKOV CHAINS
    Jia, Chen
    Jiang, Da-Quan
    Qian, Min-Ping
    ANNALS OF APPLIED PROBABILITY, 2016, 26 (04): : 2454 - 2493
  • [48] STABILITY OF MARKOVIAN PROCESSES .1. CRITERIA FOR DISCRETE-TIME CHAINS
    MEYN, SP
    TWEEDIE, RL
    ADVANCES IN APPLIED PROBABILITY, 1992, 24 (03) : 542 - 574
  • [49] GEOMETRIC AND ALGEBRAIC STRUCTURE AT INFINITY OF DISCRETE-TIME LINEAR PERIODIC-SYSTEMS
    LONGHI, S
    PERDON, A
    CONTE, G
    LINEAR ALGEBRA AND ITS APPLICATIONS, 1989, 122 : 245 - 271
  • [50] Construction of Flat Outputs of Nonlinear Discrete-Time Systems in a Geometric and an Algebraic Framework
    Kolar, Bernd
    Kaldmae, Arvo
    Schoeberl, Markus
    Kotta, Ulle
    Schlacher, Kurt
    IFAC PAPERSONLINE, 2016, 49 (18): : 796 - 801