Perturbation analysis for the stationary distribution of a Markov chain

被引：0

作者：

Perez-Lechuga, G. ^{[1
]}

Rivera-Gomez, H. ^{[1
]}

Gonzalez, P. J. Garcia ^{[1
]}

机构：

[1] Hidalgo State Univ, Adv Res Ctr Ind Engn, Caretera Pachuca Tulancingo Km 4-5, Pachuca Hgo, Mexico

来源：

PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON MATHEMATICAL AND COMPUTATIONAL METHODS IN SCIENCE AND ENGINEERING (MACMESE '07)/ DNCOCO '07 | 2007年

基金：

高等学校博士学科点专项科研基金;

关键词：

Markov chains; deviation matrix; linear pogramming; perturbation matrix analysis;

D O I：

暂无

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We consider a stationary distribution of a finite, irreducible, homogeneous Markov chain. Our aim is to perturb the transition probabilities matrix using approximations to find regions of feasibility and optimality for a given basis when the chain is optimized using linear programming. We also explore the application of perturbations bonds and analyze the effects of these on the construction of optimal policies.

引用

页码：103 / 108

页数：6

共 50 条

[31] Exploiting quotients of Markov chains to derive properties of the stationary distribution of the Markov chain associated to an evolutionary algorithm
Mitavskiy, Boris
Rowe, Jonathan E.
Wright, Alden
Schmitt, Lothar M.
[J]. SIMULATED EVOLUTION AND LEARNING, PROCEEDINGS, 2006, 4247 : 726 - 733
[32] Stationary distribution of two-dimensional quasi-Toeplitz Markov chain
Dudin, AN
Klimenok, VI
[J]. AUTOMATIC CONTROL AND COMPUTER SCIENCES, 1998, 32 (01) : 11 - 17
[33] ESTIMATION OF A STATIONARY MARKOV-CHAIN
BILLARD, L
MESHKANI, MR
[J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (429) : 307 - 315
[34] Containment analysis of Markov jump swarm systems with stationary distribution
Ji, Huihui
Zhang, He
Cui, Baotong
[J]. IET CONTROL THEORY AND APPLICATIONS, 2017, 11 (07): : 901 - 907
[35] Optimized Markov Chain Monte Carlo for Signal Detection in MIMO Systems: An Analysis of the Stationary Distribution and Mixing Time
Hassibi, Babak
Hansen, Morten
Dimakis, Alexandros G.
Alshamary, Haider Ali Jasim
Xu, Weiyu
[J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (17) : 4436 - 4450
[36] A Numerical Algorithm on the Computation of the Stationary Distribution of a Discrete Time Homogenous Finite Markov Chain
Zhao, Di
Li, Hongyi
Su, Donglin
[J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2012, 2012
[37] Maximum Entropy for Determining the Transition Probability Matrix of a Markov Chain with a Specified Stationary Distribution
Nikooravesh, Zohre
[J]. THAILAND STATISTICIAN, 2020, 18 (02): : 235 - 242
[38] On fatigue cycle distribution in non-stationary switching loadings with Markov chain structure
Benasciutti, D.
Tovo, R.
[J]. PROBABILISTIC ENGINEERING MECHANICS, 2010, 25 (04) : 406 - 418
[39] CORRELATION EQUATIONS FOR STATIONARY MEASURE OF A MARKOV CHAIN
VASILEV, NB
[J]. THEORY OF PROBILITY AND ITS APPLICATIONS,USSR, 1970, 15 (03): : 521 - &
[40] Non-stationary fuzzy Markov chain
Salzenstein, F.
Collet, C.
Lecam, S.
Hatt, M.
[J]. PATTERN RECOGNITION LETTERS, 2007, 28 (16) : 2201 - 2208

← 1 2 3 4 5 →