Some Remarks on the Variance in Markov Reward Processes

被引：0
|
作者：
Sladky, Karel [1 ]
机构：
[1] Acad Sci Czech Republic, Inst Informat Theory & Automat, Dept Econometr, CR-18208 Prague 8, Czech Republic
来源：
PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON MATHEMATICAL METHODS IN ECONOMICS 2004 | 2004年
关键词：
Markov reward processes with finite state space; expectation and variance of cumulative rewards;
D O I：
暂无
中图分类号：
F [经济];
学科分类号：
02 ;
摘要：
We consider Markov reward processes with finite state space both in discrete- and continuous-time setting. Explicit formulas for the second moment and variance of the cumulative (random) reward up to a given time point are obtained.
引用
收藏
页码：292 / 297
页数：6
相关论文
共 50 条
  • [41] On the Conservativeness of Some Markov Processes
    Oshima, Yoichi
    Uemura, Toshihiro
    POTENTIAL ANALYSIS, 2017, 46 (04) : 609 - 645
  • [42] On the Conservativeness of Some Markov Processes
    Yoichi Oshima
    Toshihiro Uemura
    Potential Analysis, 2017, 46 : 609 - 645
  • [43] Optimization of Markov decision processes under the variance criterion
    Xia, Li
    AUTOMATICA, 2016, 73 : 269 - 278
  • [44] Variational Principles for Asymptotic Variance of General Markov Processes
    Huang, Lu Jing
    Mao, Yong Hua
    Wang, Tao
    ACTA MATHEMATICA SINICA-ENGLISH SERIES, 2023, 39 (01) : 107 - 118
  • [45] ON ERGODICITY OF SOME MARKOV PROCESSES
    Komorowski, Tomasz
    Peszat, Szymon
    Szarek, Tomasz
    ANNALS OF PROBABILITY, 2010, 38 (04): : 1401 - 1443
  • [46] Variational Principles for Asymptotic Variance of General Markov Processes
    Lu Jing Huang
    Yong Hua Mao
    Tao Wang
    Acta Mathematica Sinica, English Series, 2023, 39 : 107 - 118
  • [47] Variational Principles for Asymptotic Variance of General Markov Processes
    Lu Jing HUANG
    Yong Hua MAO
    Tao WANG
    Acta Mathematica Sinica,English Series, 2023, (01) : 107 - 118
  • [48] VARIANCE-PENALIZED MARKOV DECISION-PROCESSES
    FILAR, JA
    KALLENBERG, LCM
    LEE, HM
    MATHEMATICS OF OPERATIONS RESEARCH, 1989, 14 (01) : 147 - 161
  • [49] Asymptotic variance of stationary reversible and normal Markov processes
    Deligiannidis, George
    Peligrad, Magda
    Utev, Sergey
    ELECTRONIC JOURNAL OF PROBABILITY, 2015, 20 : 1 - 26
  • [50] Remarks on risk sensitive adaptive control of Markov processes
    Duncan, T. E.
    Pasik-Duncan, B.
    Stettner, L.
    PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 2865 - 2865
12345