Toward Implicit Learning for the Compositional Verification of Markov Decision Processes

被引:1
|
作者
Bouchekir, Redouane [1 ]
Boukala, Mohand Cherif [1 ]
机构
[1] Univ Sci & Technol Houari Boumediene, Dept Comp Sci, MOVEP, BP 32 El Alia, Algiers, Algeria
关键词
Probabilistic model checking; Compositional verification; Symbolic model checking; Assume-guarantee paradigm; Machine learning; CDNF Learning; MODEL-CHECKING; TIME;
D O I
10.1007/978-3-030-00359-3_13
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we propose an automated compositional verification using implicit learning to verify Markov Decision Process (MDP) against probabilistic safety properties. Our approach, denoted ACV uIL (Automatic Compositional Verification using Implicit Learning), starts by encoding implicitly the MDP components by using compact data structures. Then, we use a sound and complete symbolic assumeguarantee reasoning rule to establish the compositional verification process. This rule uses the CDNF learning algorithm to generate automatically the symbolic probabilistic assumptions. Experimental results suggest promising outlooks for our approach.
引用
收藏
页码:200 / 217
页数:18
相关论文
共 50 条
  • [1] Learning Weighted Assumptions for Compositional Verification of Markov Decision Processes
    He, Fei
    Gao, Xiaowei
    Wang, Miaofei
    Wang, Bow-Yaw
    Zhang, Lijun
    [J]. ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2016, 25 (03)
  • [2] Active Learning of Markov Decision Processes for System Verification
    Chen, Yingke
    Nielsen, Thomas Dyhre
    [J]. 2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 2, 2012, : 289 - 294
  • [3] Verification of Markov Decision Processes Using Learning Algorithms
    Brazdil, Tomas
    Chatterjee, Krishnendu
    Chmelik, Martin
    Forejt, Vojtech
    Kretinsky, Jan
    Kwiatkowska, Marta
    Parker, David
    Ujma, Mateusz
    [J]. AUTOMATED TECHNOLOGY FOR VERIFICATION AND ANALYSIS, ATVA 2014, 2014, 8837 : 98 - 114
  • [4] Online Learning with Implicit Exploration in Episodic Markov Decision Processes
    Ghasemi, Mahsa
    Hashemi, Abolfazl
    Vikalo, Haris
    Topcu, Ufuk
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1953 - 1958
  • [5] Scalable Verification of Markov Decision Processes
    Legay, Axel
    Sedwards, Sean
    Traonouez, Louis-Marie
    [J]. SOFTWARE ENGINEERING AND FORMAL METHODS, SEFM 2014, 2015, 8938 : 350 - 362
  • [6] Compositional reasoning for weighted Markov decision processes
    Deng, Yuxin
    Hennessy, Matthew
    [J]. SCIENCE OF COMPUTER PROGRAMMING, 2013, 78 (12) : 2537 - 2579
  • [7] Incremental Quantitative Verification for Markov Decision Processes
    Kwiatkowska, Marta
    Parker, David
    Qu, Hongyang
    [J]. 2011 IEEE/IFIP 41ST INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS (DSN), 2011, : 359 - 370
  • [8] Compositional Bisimulation Minimization for Interval Markov Decision Processes
    Hashemi, Vahid
    Hermanns, Holger
    Song, Lei
    Subramani, K.
    Turrini, Andrea
    Wojciechowski, Piotr
    [J]. LANGUAGE AND AUTOMATA THEORY AND APPLICATIONS, LATA 2016, 2016, 9618 : 114 - 126
  • [9] Learning to Collaborate in Markov Decision Processes
    Radanovic, Goran
    Devidze, Rati
    Parkes, David C.
    Singla, Adish
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [10] Smart sampling for lightweight verification of Markov decision processes
    Pedro D’Argenio
    Axel Legay
    Sean Sedwards
    Louis-Marie Traonouez
    [J]. International Journal on Software Tools for Technology Transfer, 2015, 17 : 469 - 484