Perturbation analysis for the stationary distribution of a Markov chain

被引：0
|
作者：
Perez-Lechuga, G. [1 ]
Rivera-Gomez, H. [1 ]
Gonzalez, P. J. Garcia [1 ]
机构：
[1] Hidalgo State Univ, Adv Res Ctr Ind Engn, Caretera Pachuca Tulancingo Km 4-5, Pachuca Hgo, Mexico
来源：
PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON MATHEMATICAL AND COMPUTATIONAL METHODS IN SCIENCE AND ENGINEERING (MACMESE '07)/ DNCOCO '07 | 2007年
基金：
高等学校博士学科点专项科研基金;
关键词：
Markov chains; deviation matrix; linear pogramming; perturbation matrix analysis;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We consider a stationary distribution of a finite, irreducible, homogeneous Markov chain. Our aim is to perturb the transition probabilities matrix using approximations to find regions of feasibility and optimality for a given basis when the chain is optimized using linear programming. We also explore the application of perturbations bonds and analyze the effects of these on the construction of optimal policies.
引用
收藏
页码：103 / 108
页数：6
相关论文
共 50 条
  • [1] Perturbation analysis for the stationary distribution of a Markov chain
    Perez-Lechuga, G.
    Rivera-Gomez, H.
    Gonzalez, P. J. Garcia
    [J]. PROCEEDINGS OF THE WSEAS INTERNATIONAL CONFERENCE ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING: SELECTED TOPICS ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING, 2007, : 103 - 108
  • [2] Comparison of perturbation bounds for the stationary distribution of a Markov chain
    Cho, GE
    Meyer, CD
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2001, 335 : 137 - 150
  • [3] On Perturbation Bounds for the Joint Stationary Distribution of Multivariate Markov Chain Models
    Li, Wen
    Jiang, Lin
    Ching, Wai-Ki
    Cui, Lu-Bin
    [J]. EAST ASIAN JOURNAL ON APPLIED MATHEMATICS, 2013, 3 (01) : 1 - 17
  • [4] Estimating the stationary distribution of a Markov chain
    Athreya, KB
    Majumdar, M
    [J]. ECONOMIC THEORY, 2003, 21 (2-3) : 729 - 742
  • [5] STATIONARY DISTRIBUTION OF AN INTERESTING MARKOV CHAIN
    HENDRICKS, WJ
    [J]. JOURNAL OF APPLIED PROBABILITY, 1972, 9 (01) : 231 - +
  • [6] Estimating the stationary distribution of a Markov chain
    Krishna B. Athreya
    Mukul Majumdar
    [J]. Economic Theory, 2003, 21 : 729 - 742
  • [7] PERTURBATION BOUNDS FOR THE STATIONARY PROBABILITIES OF A FINITE MARKOV-CHAIN
    HAVIV, M
    VANDERHEYDEN, L
    [J]. ADVANCES IN APPLIED PROBABILITY, 1984, 16 (04) : 804 - 818
  • [8] MARKOV-CHAIN WITH A GIVEN STATIONARY DISTRIBUTION
    COHEN, JE
    [J]. AMERICAN STATISTICIAN, 1978, 32 (01): : 39 - 39
  • [9] SENSITIVITY OF THE STATIONARY DISTRIBUTION OF A MARKOV-CHAIN
    MEYER, CD
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1994, 15 (03) : 715 - 728
  • [10] ESTIMATION OF THE STATIONARY DISTRIBUTION OF A SEMI-MARKOV CHAIN
    Barbu, Vlad Stefan
    Bulla, Jan
    Maruotti, Antonello
    [J]. JOURNAL OF RELIABILITY AND STATISTICAL STUDIES, 2012, 5 : 15 - 26
12345