Controller synthesis and verification for Markov decision processes with qualitative branching time objectives

被引:0
|
作者
Brazdil, Tomas [1 ]
Forejt, Vojtech [1 ]
Kucera, Antonin [1 ]
机构
[1] Masaryk Univ, Fac Informat, Brno 60200, Czech Republic
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given Markov decision process and doubly exponential in the size of a given qualitative PECTL* formula. Moreover, we show that if a given qualitative PECTL* objective is achievable by some strategy, then it is also achievable by an effectively constructible one-counter strategy, where the associated complexity bounds are essentially the same as above. For the fragment of qualitative PCTL objectives, we obtain EXPTIME completeness and the algorithms are only singly exponential in the size of the formula.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 50 条
  • [1] Qualitative Controller Synthesis for Consumption Markov Decision Processes
    Blahoudek, Frantisek
    Brazdil, Tomas
    Novotny, Petr
    Ornik, Melkior
    Thangeda, Pranay
    Topcu, Ufuk
    COMPUTER AIDED VERIFICATION, PT II, 2020, 12225 : 421 - 447
  • [2] Strategy synthesis for Markov decision processes and branching-time logics
    Brazdil, Tomas
    Forejt, Vojtech
    CONCUR 2007 - CONCURRENCY THEORY, PROCEEDINGS, 2007, 4703 : 428 - +
  • [3] Symbolic algorithms for qualitative analysis of Markov decision processes with Buchi objectives
    Chatterjee, Krishnendu
    Henzinger, Monika
    Joglekar, Manas
    Shah, Nisarg
    FORMAL METHODS IN SYSTEM DESIGN, 2013, 42 (03) : 301 - 327
  • [4] LIFE IS RANDOM, TIME IS NOT: MARKOV DECISION PROCESSES WITH WINDOW OBJECTIVES
    Brihaye, Thomas
    Delgrange, Florent
    Randour, Mickael
    Oualhadj, Youssouf
    LOGICAL METHODS IN COMPUTER SCIENCE, 2020, 16 (04) : 1 - 13
  • [5] Quantitative controller synthesis for consumption Markov decision processes
    Fu, Jianling
    Huang, Cheng-Chao
    Li, Yong
    Mei, Jingyi
    Xu, Ming
    Zhang, Lijun
    INFORMATION PROCESSING LETTERS, 2023, 180
  • [6] Synchronizing Objectives for Markov Decision Processes
    Doyen, Laurent
    Massart, Thierry
    Shirmohammadi, Mahsa
    ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE, 2011, (50): : 61 - 75
  • [7] Markov decision processes with multiple objectives
    Chatterjee, K
    Majumdar, R
    Henzinger, TA
    STACS 2006, PROCEEDINGS, 2006, 3884 : 325 - 336
  • [8] Symbolic algorithms for qualitative analysis of Markov decision processes with Büchi objectives
    Krishnendu Chatterjee
    Monika Henzinger
    Manas Joglekar
    Nisarg Shah
    Formal Methods in System Design, 2013, 42 : 301 - 327
  • [9] On the controller synthesis for finite-state Markov decision processes
    Kucera, A
    Strazovsky, O
    FSTTCS 2005: FOUNDATIONS OF SOFTWARE TECHNOLOGY AND THEORETICAL COMPUTER SCIENCE, PROCEEDINGS, 2005, 3821 : 541 - 552
  • [10] On the controller synthesis for finite-state Markov decision processes
    Kucera, Antonin
    Strazovsky, Oldrich
    FUNDAMENTA INFORMATICAE, 2008, 82 (1-2) : 141 - 153