Optimizing honeypot strategies against dynamic lateral movement using partially observable stochastic games

被引:22
|
作者
Horak, Karel [1 ]
Bosansky, Branislav [1 ]
Tomasek, Petr [1 ]
Kiekintveld, Christopher [2 ]
Kamhoua, Charles [3 ]
机构
[1] Czech Tech Univ, Fac Elect Engn, Dept Comp Sci, Tech 2, Prague 16627 6, Czech Republic
[2] Univ Texas El Paso, Dept Comp Sci, 500 W Univ Ave, El Paso, TX 79968 USA
[3] US Army Res Lab, 2800 Powder Mill Rd, Adelphi, MD 20783 USA
关键词
Dynamic honeypot allocation; Lateral movement; Partially observable stochastic games; Compact representation; Incremental strategy generation;
D O I
10.1016/j.cose.2019.101579
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Partially observable stochastic games (POSGs) are a general game-theoretic model for capturing dynamic interactions where players have partial information. The existing algorithms for solving subclasses of POSGs have theoretical guarantees for converging to approximate optimal strategies, however, their scat ability is limited and they cannot be directly used to solve games of realistic sizes. In our problem, the attacker uses lateral movement through the network in order to reach a specific host, while the defender wants to discover the attacker by dynamically reallocating honeypots. We demonstrate that restricting to a specific domain allows us to substantially improve existing algorithms: (1) we formulate a compact representation of uncertainty the defender faces, (2) we exploit the incremental strategy-generation method that over iterations expands the possible actions for players. The experimental evaluation shows that our novel algorithms scale several orders of magnitude better compared to the existing state of the art. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Optimal Honeypot Allocation Using Core Attack Graph in Partially Observable Stochastic Games
    Nguemkam, Achile Leonel
    Anwar, Ahmed Hemida
    Tchendji, Vianney Kengne
    Tosh, Deepak K.
    Kamhoua, Charles
    [J]. IEEE Access, 2024, 12 : 187444 - 187455
  • [2] Dynamic programming for partially observable stochastic games
    Hansen, EA
    Bernstein, DS
    Zilberstein, S
    [J]. PROCEEDING OF THE NINETEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND THE SIXTEENTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2004, : 709 - 715
  • [3] Surprising strategies obtained by stochastic optimization in partially observable games
    Cauwet, Marie-Liesse
    Teytaud, Olivier
    [J]. 2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 31 - 38
  • [4] Solving Partially Observable Stochastic Games with Public Observations
    Horak, Karel
    Bosansky, Branislav
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 2029 - 2036
  • [5] Safe Policies for Factored Partially Observable Stochastic Games
    Carr, Steven
    Jansen, Nils
    Bharadwaj, Suda
    Spaan, Matthijs T. J.
    Topcu, Ufuk
    [J]. ROBOTICS: SCIENCE AND SYSTEM XVII, 2021,
  • [6] MPOGames: Efficient Multimodal Partially Observable Dynamic Games
    So, Oswin
    Drews, Paul
    Balch, Thomas
    Dimitrov, Vein
    Rosman, Guy
    Theodorou, Evangelos A.
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3189 - 3196
  • [7] Solving Partially Observable Stochastic Shortest-Path Games
    Tomasek, Petr
    Horak, Karel
    Aradhye, Aditya
    Bosansky, Branislav
    Chatterjee, Krishnendu
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4182 - 4189
  • [8] Planning for Weakly-Coupled Partially Observable Stochastic Games
    Guo, AnYuan
    Lesser, Victor
    [J]. 19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05), 2005, : 1715 - 1716
  • [9] PALO bounds for reinforcement learning in partially observable stochastic games
    Ceren, Roi
    He, Keyang
    Doshi, Prashant
    Banerjee, Bikramjit
    [J]. NEUROCOMPUTING, 2021, 420 : 36 - 56
  • [10] Compact Representation of Value Function in Partially Observable Stochastic Games
    Horak, Karel
    Bosansky, Branislav
    Kiekintveld, Christopher
    Kamhoua, Charles
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 350 - 356