Real-Time Defensive Strategy Selection via Deep Reinforcement Learning

被引:0
|
作者
Charpentier, Axel [1 ,2 ]
Neal, Christopher [1 ,2 ]
Boulahia-Cuppens, Nora [1 ]
Cuppens, Frederic [1 ]
Yaich, Reda [2 ]
机构
[1] Polytech Montreal, Montreal, PQ, Canada
[2] IRT SystemX, Palaiseau, France
关键词
Moving Target Defense; Deception; Deep Reinforcement Learning; Network Security; MOVING TARGET DEFENSE;
D O I
10.1145/3600160.3600176
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As computer networks face increasingly sophisticated attacks there is a need to create adaptive defensive systems that can select appropriate countermeasures to thwart attacks. The use of Deep Reinforcement Learning to train defensive agents is an avenue to study to meet this demand. In this paper we describe a simulated computer network environment wherein we conduct attacks and train defensive agents that employ Moving Target Defense and Deception strategies. We train an attacking agent, using Proximal Policy Optimization, to learn a policy to extract sensitive network data as quickly as possible from the environment. We then train a defending agent to prevent the attacker from reaching its objective. Our results demonstrate how the defender is able to learn a policy to inhibit the attacker.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Real-time Guidance Strategy for Active Defense Aircraft via Deep Reinforcement Learning
    Li, Zhi
    Wu, Jinze
    Wu, Yuanpei
    Zheng, Yu
    Li, Meng
    Liang, Haizhao
    [J]. PROCEEDINGS OF THE 2021 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2021, : 177 - 183
  • [2] Tabular Reinforcement Learning in Real-Time Strategy Games via Options
    Tavares, Anderson R.
    Chaimowicz, Luiz
    [J]. PROCEEDINGS OF THE 2018 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND GAMES (CIG'18), 2018, : 229 - 236
  • [3] Deep RTS: A Game Environment for Deep Reinforcement Learning in Real-Time Strategy Games
    Andersen, Per-Arne
    Goodwin, Morten
    Granmo, Ole-Christoffer
    [J]. PROCEEDINGS OF THE 2018 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND GAMES (CIG'18), 2018, : 149 - 156
  • [4] Improved Reinforcement Learning in Asymmetric Real-time Strategy Games via Strategy Diversity
    Dasgupta, Prithviraj
    Kliem, John
    [J]. INTERNATIONAL JOURNAL OF SERIOUS GAMES, 2023, 10 (01): : 19 - 38
  • [6] Real-time Dispatch Strategy for Electric Vehicles Based on Deep Reinforcement Learning
    Li, Hang
    Li, Guojie
    Wang, Keyou
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2020, 44 (22): : 161 - 167
  • [7] Enhancing deep reinforcement learning for scale flexibility in real-time strategy games
    Lemos, Marcelo Luiz Harry Diniz
    Vieira, Ronaldo Silva
    Tavares, Anderson Rocha
    Marcolino, Leandro Soriano
    Chaimowicz, Luiz
    [J]. ENTERTAINMENT COMPUTING, 2025, 52
  • [8] Real-time local path planning strategy based on deep distributional reinforcement learning
    Du, Shengli
    Zhu, Zexing
    Wang, Xuefang
    Han, Honggui
    Qiao, Junfei
    [J]. NEUROCOMPUTING, 2024, 599
  • [9] Real-time model calibration with deep reinforcement learning
    Tian, Yuan
    Chao, Manuel Arias
    Kulkarni, Chetan
    Goebel, Kai
    Fink, Olga
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 165
  • [10] TTDeep: Time-Triggered Scheduling for Real-Time Ethernet via Deep Reinforcement Learning
    Jia, Hongyu
    Jiang, Yu
    Zhong, Chunmeng
    Wan, Hai
    Zhao, Xibin
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,