Some Algebraic Methods in Semi-Markov Chains

被引：0

作者：

Barbu, Vlad Stefan ^{[1
]}

Limnios, Nikolaos ^{[2
]}

机构：

[1] Univ Rouen, Lab Math Raphael Salem, UMR 6085, Ave Univ,BP 12, F-76801 St Etienne, France

[2] Univ Technol Compiegne, Lab Math Appl Compiegne, F-60205 Compiegne, France

来源：

ALGEBRAIC METHODS IN STATISTICS AND PROBABILITY II | 2010年 / 516卷

关键词：

Semi-Markov chains; countable state space; algebraic methods; Markov renewal theory; reliability; hitting times;

D O I：

暂无

中图分类号：

O1 [数学];

学科分类号：

0701 ; 070101 ;

摘要：

This article is concerned with algebraic methods developed for discrete-time semi-Markov processes with countable state space. After a short presentation of infinite matrices and associated operations, we describe the discrete-time semi-Markov setting. Then, we present some elements of Markov renewal theory and we obtain the mean hitting time of a subset of the state space for this type of process. A specialization of these results to the finite state space case is also presented. We end with several concluding remarks.

引用

页码：19 / +

页数：2

共 50 条

[31] CONVERGENCE OF SEMI-MARKOV WALKS TO A CONTINUOUS SEMI-MARKOV PROCESS
KHARLAMOV, BP
THEORY OF PROBABILITY AND ITS APPLICATIONS, 1976, 21 (03) : 482 - 498
[32] CONVERGENCE OF SEMI-MARKOV WANDERINGS TO SEMI-MARKOV CONTINUOUS PROCESS
KHARLAMOV, BP
TEORIYA VEROYATNOSTEI I YEYE PRIMENIYA, 1975, 20 (03): : 679 - 680
[33] Maximum spacing estimation for continuous time Markov chains and semi-Markov processes
Kristi Kuljus
Bo Ranneby
Statistical Inference for Stochastic Processes, 2021, 24 : 421 - 443
[34] REGULARITY CONDITIONS FOR SEMI-MARKOV AND MARKOV-CHAINS IN CONTINUOUS-TIME
GERRARD, R
JOURNAL OF APPLIED PROBABILITY, 1983, 20 (03) : 505 - 512
[35] Maximum spacing estimation for continuous time Markov chains and semi-Markov processes
Kuljus, Kristi
Ranneby, Bo
STATISTICAL INFERENCE FOR STOCHASTIC PROCESSES, 2021, 24 (02) : 421 - 443
[36] On discrete time semi-Markov chains and applications in words occurrences
Chryssaphinou, Ourania
Karaliopoulou, Margarita
Limnios, Nikolaos
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2008, 37 (08) : 1306 - 1322
[37] Unsupervised segmentation of hidden semi-Markov non stationary chains
Lapuyade-Lahorgue, Jerome
Pieczynski, Wojciech
BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2006, 872 : 347 - +
[38] Local theorems for (multidimensional) additive functionals of semi-Markov chains
Logachov, Artem
Mogulskii, Anatolii
Prokopenko, Evgeny
Yambartsev, Anatoly
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2021, 137 : 149 - 166
[39] Nonparametric estimation of the expected accumulated reward for semi-Markov chains
D'Amico, Guglielmo
SORT-STATISTICS AND OPERATIONS RESEARCH TRANSACTIONS, 2009, 33 (02) : 159 - 170
[40] COMPUTATION OF OPTIMAL POLICIES IN DISCOUNTED SEMI-MARKOV DECISION CHAINS
CANTALUPPI, L
OR SPEKTRUM, 1984, 6 (03) : 147 - 160

← 1 2 3 4 5 →