Controller synthesis and verification for Markov decision processes with qualitative branching time objectives

被引:0
|
作者
Brazdil, Tomas [1 ]
Forejt, Vojtech [1 ]
Kucera, Antonin [1 ]
机构
[1] Masaryk Univ, Fac Informat, Brno 60200, Czech Republic
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given Markov decision process and doubly exponential in the size of a given qualitative PECTL* formula. Moreover, we show that if a given qualitative PECTL* objective is achievable by some strategy, then it is also achievable by an effectively constructible one-counter strategy, where the associated complexity bounds are essentially the same as above. For the fragment of qualitative PCTL objectives, we obtain EXPTIME completeness and the algorithms are only singly exponential in the size of the formula.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 50 条
  • [21] On the Markovian randomized strategy of controller for Markov decision processes
    Chen, Taolue
    Han, Tingting
    Lu, Jian
    FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, PROCEEDINGS, 2006, 4223 : 149 - 158
  • [22] Approximate planning and verification for large Markov decision processes
    Richard Lassaigne
    Sylvain Peyronnet
    International Journal on Software Tools for Technology Transfer, 2015, 17 : 457 - 467
  • [23] Smart sampling for lightweight verification of Markov decision processes
    D'Argenio, Pedro
    Legay, Axel
    Sedwards, Sean
    Traonouez, Louis-Marie
    INTERNATIONAL JOURNAL ON SOFTWARE TOOLS FOR TECHNOLOGY TRANSFER, 2015, 17 (04) : 469 - 484
  • [24] Verification of Markov Decision Processes Using Learning Algorithms
    Brazdil, Tomas
    Chatterjee, Krishnendu
    Chmelik, Martin
    Forejt, Vojtech
    Kretinsky, Jan
    Kwiatkowska, Marta
    Parker, David
    Ujma, Mateusz
    AUTOMATED TECHNOLOGY FOR VERIFICATION AND ANALYSIS, ATVA 2014, 2014, 8837 : 98 - 114
  • [25] Risk-Averse Control of Markov Decision Processes with ω-regular Objectives
    Ehlers, Ruediger
    Moarref, Salar
    Topcu, Ufuk
    2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 426 - 433
  • [26] Markov decision processes with multiple long-run average objectives
    Chatterjee, Krishnendu
    FSTTCS 2007: FOUNDATIONS OF SOFTWARE TECHNOLOGY AND THEORETICAL COMPUTER SCIENCE, PROCEEDINGS, 2007, 4855 : 473 - 484
  • [27] Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons
    Galit Ashkenazi-Golan
    János Flesch
    Arkadi Predtetchinski
    Eilon Solan
    Journal of Optimization Theory and Applications, 2020, 185 : 945 - 965
  • [28] MARKOV DECISION PROCESSES WITH MULTIPLE LONG-RUN AVERAGE OBJECTIVES
    Brazdil, Tomas
    Brozek, Vaclav
    Chatterjee, Krishnendu
    Forejt, Vojtech
    Kucera, Antonin
    LOGICAL METHODS IN COMPUTER SCIENCE, 2014, 10 (01)
  • [29] Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons
    Ashkenazi-Golan, Galit
    Flesch, Janos
    Predtetchinski, Arkadi
    Solan, Eilon
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2020, 185 (03) : 945 - 965
  • [30] Mixing Probabilistic and non-Probabilistic Objectives in Markov Decision Processes
    Berthon, Raphael
    Guha, Shibashis
    Raskin, Jean-Francois
    PROCEEDINGS OF THE 35TH ANNUAL ACM/IEEE SYMPOSIUM ON LOGIC IN COMPUTER SCIENCE (LICS 2020), 2020, : 195 - 208