Bisimulation and logical preservation for continuous-time Markov decision processes

被引：0
|
作者：
Neuhaeusser, Martin R. [1 ,2 ]
Katoen, Joost-Pieter [1 ,2 ]
机构：
[1] Univ Aachen, Rhein Westfal TH Aachen, Software Modeling & Verificat Grp, Aachen, Germany
[2] Univ Twente, Formal Methods & Tools Grp, NL-7500 AE Enschede, Netherlands
来源：
CONCUR 2007 - CONCURRENCY THEORY, PROCEEDINGS | 2007年 / 4703卷
关键词：
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL-a stochastic variant of CTL for continuous-time Markov chains-on CTMDPs and show its measure-theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.
引用
收藏
页码：412 / +
页数：4
相关论文
共 50 条
  • [21] Constrained Continuous-Time Markov Decision Processes on the Finite Horizon
    Guo, Xianping
    Huang, Yonghui
    Zhang, Yi
    APPLIED MATHEMATICS AND OPTIMIZATION, 2017, 75 (02): : 317 - 341
  • [22] A survey of recent results on continuous-time Markov decision processes
    Xianping Guo
    Onésimo Hernández-Lerma
    Tomás Prieto-Rumeau
    Xi-Ren Cao
    Junyu Zhang
    Qiying Hu
    Mark E. Lewis
    Ricardo Vélez
    TOP, 2006, 14 : 177 - 261
  • [23] A characterization of meaningful schedulers for continuous-time Markov decision processes
    Wolovick, Nicolas
    Johr, Sven
    FORMAL MODELING AND ANALYSIS OF TIMED SYSTEMS, 2006, 4202 : 352 - 367
  • [24] Policy learning in continuous-time Markov decision processes using Gaussian Processes
    Bartocci, Ezio
    Bortolussi, Luca
    Brazdil, Tomas
    Milios, Dimitrios
    Sanguinetti, Guido
    PERFORMANCE EVALUATION, 2017, 116 : 84 - 100
  • [25] A logical characterization of bisimulation for labeled Markov processes
    Desharnais, J
    Edalat, A
    Panangaden, P
    THIRTEENTH ANNUAL IEEE SYMPOSIUM ON LOGIC IN COMPUTER SCIENCE, PROCEEDINGS, 1998, : 478 - 487
  • [26] Discounted optimality for continuous-time Markov decision processes in Polish spaces
    Guo, Xianping
    2006 CHINESE CONTROL CONFERENCE, VOLS 1-5, 2006, : 1785 - 1787
  • [27] Average optimality for continuous-time Markov decision processes in Polish spaces
    Guo, Xianping
    Rieder, Ulrich
    ANNALS OF APPLIED PROBABILITY, 2006, 16 (02): : 730 - 756
  • [28] On continuous-time Markov processes in bargaining
    Houba, Harold
    ECONOMICS LETTERS, 2008, 100 (02) : 280 - 283
  • [29] ABSORBING CONTINUOUS-TIME MARKOV DECISION PROCESSES WITH TOTAL COST CRITERIA
    Guo, Xianping
    Vykertas, Mantas
    Zhang, Yi
    ADVANCES IN APPLIED PROBABILITY, 2013, 45 (02) : 490 - 519
  • [30] Denumerable continuous-time Markov decision processes with multiconstraints on average costs
    Liu, Qiuli
    Tan, Hangsheng
    Guo, Xianping
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2012, 43 (03) : 576 - 585
12345