Toward Implicit Learning for the Compositional Verification of Markov Decision Processes

被引:1
|
作者
Bouchekir, Redouane [1 ]
Boukala, Mohand Cherif [1 ]
机构
[1] Univ Sci & Technol Houari Boumediene, Dept Comp Sci, MOVEP, BP 32 El Alia, Algiers, Algeria
关键词
Probabilistic model checking; Compositional verification; Symbolic model checking; Assume-guarantee paradigm; Machine learning; CDNF Learning; MODEL-CHECKING; TIME;
D O I
10.1007/978-3-030-00359-3_13
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we propose an automated compositional verification using implicit learning to verify Markov Decision Process (MDP) against probabilistic safety properties. Our approach, denoted ACV uIL (Automatic Compositional Verification using Implicit Learning), starts by encoding implicitly the MDP components by using compact data structures. Then, we use a sound and complete symbolic assumeguarantee reasoning rule to establish the compositional verification process. This rule uses the CDNF learning algorithm to generate automatically the symbolic probabilistic assumptions. Experimental results suggest promising outlooks for our approach.
引用
收藏
页码:200 / 217
页数:18
相关论文
共 50 条
  • [41] Concurrent Markov decision processes for robot team learning
    Girard, Justin
    Emami, M. Reza
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2015, 39 : 223 - 234
  • [42] A reinforcement learning based algorithm for Markov decision processes
    Bhatnagar, S
    Kumar, S
    [J]. 2005 International Conference on Intelligent Sensing and Information Processing, Proceedings, 2005, : 199 - 204
  • [43] Learning and Planning with Timing Information in Markov Decision Processes
    Bacon, Pierre-Luc
    Balle, Borja
    Precup, Doina
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2015, : 111 - 120
  • [44] Learning Adversarial Markov Decision Processes with Delayed Feedback
    Lancewicki, Tal
    Rosenberg, Aviv
    Mansour, Yishay
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7281 - 7289
  • [45] Recursive learning automata approach to Markov decision processes
    Chang, Hyeong Soo
    Fu, Michael C.
    Hu, Jiaqiao
    Marcus, Steven I.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2007, 52 (07) : 1349 - 1355
  • [46] Learning algorithms or Markov decision processes with average cost
    Abounadi, J
    Bertsekas, D
    Borkar, VS
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2001, 40 (03) : 681 - 698
  • [47] Combining Learning Algorithms: An Approach to Markov Decision Processes
    Ribeiro, Richardson
    Favarim, Fabio
    Barbosa, Marco A. C.
    Koerich, Alessandro L.
    Enembreck, Fabricio
    [J]. ENTERPRISE INFORMATION SYSTEMS, ICEIS 2012, 2013, 141 : 172 - 188
  • [48] A sensitivity view of Markov decision processes and reinforcement learning
    Cao, XR
    [J]. MODELING, CONTROL AND OPTIMIZATION OF COMPLEX SYSTEMS: IN HONOR OF PROFESSOR YU-CHI HO, 2003, 14 : 261 - 283
  • [49] Online Learning in Markov Decision Processes with Continuous Actions
    Hong, Yi-Te
    Lu, Chi-Jen
    [J]. ALGORITHMIC LEARNING THEORY, ALT 2015, 2015, 9355 : 302 - 316
  • [50] THE COMPOSITIONAL CONSTRUCTION OF MARKOV PROCESSES II
    Albasini, L. de Francesco
    Sabadini, N.
    Walters, R. F. C.
    [J]. RAIRO-THEORETICAL INFORMATICS AND APPLICATIONS, 2011, 45 (01): : 117 - 142