A poisson equation for the risk-sensitive average cost in semi-markov chains

被引:3
|
作者
Cavazos-Cadena, Rolando [1 ]
机构
[1] Univ Autonoma Agr Antonio Narro, Dept Estadisitca & Calculo, Blvd Antonio Narro 1923, Saltillo 25315, Coahuila, Mexico
关键词
Exponential utility; Stopping time; Non-linear certainty-equivalent; Communicating underlying chain; INFINITE-HORIZON RISK; OPTIMALITY; SYSTEM;
D O I
10.1007/s10626-015-0224-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work concerns semi-Markov chains evolving on a finite state space. The system development generates a cost when a transition is announced, as well as a holding cost which is incurred continuously during each sojourn time. It is assumed that these costs are paid by an observer with positive and constant risk-sensitivity, and the overall performance of the system is measured by the corresponding (long-run) risk-sensitive average cost criterion. In this framework, conditions are provided under which the average index does not depend on the initial state and is characterized in terms of a single Poisson equation.
引用
收藏
页码:633 / 656
页数:24
相关论文
共 50 条
  • [1] A poisson equation for the risk-sensitive average cost in semi-markov chains
    Rolando Cavazos-Cadena
    Discrete Event Dynamic Systems, 2016, 26 : 633 - 656
  • [2] Controlled Semi-Markov Chains with Risk-Sensitive Average Cost Criterion
    Chavez-Rodriguez, Selene
    Cavazos-Cadena, Rolando
    Cruz-Suarez, Hugo
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 170 (02) : 670 - 686
  • [3] Controlled Semi-Markov Chains with Risk-Sensitive Average Cost Criterion
    Selene Chávez-Rodríguez
    Rolando Cavazos-Cadena
    Hugo Cruz-Suárez
    Journal of Optimization Theory and Applications, 2016, 170 : 670 - 686
  • [4] Contractive Approximations in Risk-Sensitive Average Semi-Markov Decision Chains on a Finite State Space
    Carlos Camilo-Garay
    Rolando Cavazos-Cadena
    Hugo Cruz-Suárez
    Journal of Optimization Theory and Applications, 2022, 192 : 271 - 291
  • [5] Contractive Approximations in Risk-Sensitive Average Semi-Markov Decision Chains on a Finite State Space
    Camilo-Garay, Carlos
    Cavazos-Cadena, Rolando
    Cruz-Suarez, Hugo
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 192 (01) : 271 - 291
  • [6] Discounted approximations to the risk-sensitive average cost in finite Markov chains
    Cavazos-Cadena, Rolando
    Cruz-Suarez, Daniel
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2017, 450 (02) : 1345 - 1362
  • [7] Controlled Markov chains with risk-sensitive exponential average cost criterion
    Brau, A
    Fernandez-Gaucherand, E
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 2260 - 2264
  • [8] Risk-sensitive semi-Markov decision problems with discounted cost and general utilities
    Bhabak, Arnab
    Saha, Subhamay
    STATISTICS & PROBABILITY LETTERS, 2022, 184
  • [9] Zero-Sum Semi-Markov Games with the Risk-Sensitive Average Reward Criterion
    Chen, Fang
    Guo, Xin
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2025, 204 (03)
  • [10] A characterization of the optimal risk-sensitive average cost in finite controlled Markov chains
    Cavazos-Cadena, R
    Hernández-Hernández, D
    ANNALS OF APPLIED PROBABILITY, 2005, 15 (1A): : 175 - 212