Exact asymptotics for the stationary distribution of a Markov chain: a production model

被引:19
|
作者
Adan, Ivo [1 ]
Foley, Robert D. [2 ]
McDonald, David R. [3 ]
机构
[1] Eindhoven Univ Technol, Dept Math & Comp Sci, NL-5600 MB Eindhoven, Netherlands
[2] Georgia Inst Technol, Dept Ind & Syst Engn, Atlanta, GA 30332 USA
[3] Univ Ottawa, Dept Math & Stat, Ottawa, ON K1N 6N5, Canada
基金
加拿大自然科学与工程研究理事会; 美国国家科学基金会;
关键词
Rare events; Large deviations; Exact asymptotics; Change of measure; h transform; Time reversal; Markov additive process; Markov chain; R-transient; LARGE DEVIATIONS; SHORTEST-QUEUE; RANDOM-WALK; STABILITY; SPACE; JOIN;
D O I
10.1007/s11134-009-9140-y
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We derive rough and exact asymptotic expressions for the stationary distribution pi of a Markov chain arising in a queueing/production context. The approach we develop can also handle "cascades," which are situations where the fluid limit of the large deviation path from the origin to the increasingly rare event is nonlinear. Our approach considers a process that starts at the rare event. In our production example, we can have two sequences of states that asymptotically lie on the same line, yet pi has different asymptotics on the two sequences.
引用
收藏
页码:311 / 344
页数:34
相关论文
共 50 条
  • [1] Exact asymptotics for the stationary distribution of a Markov chain: a production model
    Ivo Adan
    Robert D. Foley
    David R. McDonald
    [J]. Queueing Systems, 2009, 62 : 311 - 344
  • [2] Estimating the stationary distribution of a Markov chain
    Athreya, KB
    Majumdar, M
    [J]. ECONOMIC THEORY, 2003, 21 (2-3) : 729 - 742
  • [3] STATIONARY DISTRIBUTION OF AN INTERESTING MARKOV CHAIN
    HENDRICKS, WJ
    [J]. JOURNAL OF APPLIED PROBABILITY, 1972, 9 (01) : 231 - +
  • [4] Estimating the stationary distribution of a Markov chain
    Krishna B. Athreya
    Mukul Majumdar
    [J]. Economic Theory, 2003, 21 : 729 - 742
  • [5] Markov Chain Model of Schema Evolution and Its Application to Stationary Distribution
    Zhang, Yu-an
    Ma, Qinglian
    Furutani, Hiroshi
    [J]. 2014 10TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION (ICNC), 2014, : 225 - 229
  • [6] Perturbation analysis for the stationary distribution of a Markov chain
    Perez-Lechuga, G.
    Rivera-Gomez, H.
    Gonzalez, P. J. Garcia
    [J]. PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON MATHEMATICAL AND COMPUTATIONAL METHODS IN SCIENCE AND ENGINEERING (MACMESE '07)/ DNCOCO '07, 2007, : 103 - 108
  • [8] MARKOV-CHAIN WITH A GIVEN STATIONARY DISTRIBUTION
    COHEN, JE
    [J]. AMERICAN STATISTICIAN, 1978, 32 (01): : 39 - 39
  • [9] Perturbation analysis for the stationary distribution of a Markov chain
    Perez-Lechuga, G.
    Rivera-Gomez, H.
    Gonzalez, P. J. Garcia
    [J]. PROCEEDINGS OF THE WSEAS INTERNATIONAL CONFERENCE ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING: SELECTED TOPICS ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING, 2007, : 103 - 108
  • [10] Markov modulated fluid network process: Tail asymptotics of the stationary distribution
    Miyazawa, Masakiyo
    [J]. STOCHASTIC MODELS, 2020, 37 (01) : 127 - 167