Allocating defense resources for spatial cyber-physical power systems based on deep reinforcement learning

被引：1

作者：

Dong, Zhengcheng ^{[1
]}

Tang, Mian ^{[2
]}

Tian, Meng ^{[3
]}

机构：

[1] Wuhan Univ Technol, Sch Automat, Wuhan, Peoples R China

[2] Army Engn Univ PLA, Ordnance NCO Acad, Wuhan, Peoples R China

[3] Wuhan Univ, Elect Informat Sch, Wuhan, Peoples R China

来源：

2023 IEEE 6TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS | 2023年

基金：

中国国家自然科学基金;

关键词：

cyber-physical power systems; defense resource allocation; length constraint; deep Q-network algorithm; OPTIMIZATION; BLACKOUT;

D O I：

10.1109/ICPS58381.2023.10128014

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

Allocating defense resources to specific lines can enhance the resilience of power systems against external damages. Considering the impact of information systems, a defense resource allocation model for cyber-physical power systems (CPPS) is developed with the length of power lines as the defense cost. It is assumed that defense resources can reduce the probability of successful attacks. For this nonlinear programming (NLP) problem, an optimization-seeking method based on the deep Q-network (DQN) algorithm is proposed. The model and algorithm are evaluated based on the IEEE-39 bus system. The results show that for small action sets, the method is in general agreement with the results obtained by the optimization solver BONMIN. In addition, the allocation strategies with different scales of resources and action sets are analyzed. These studies can provide ideas for the application of deep reinforcement learning (DRL) in resource allocation for power systems.

引用

页数：6

共 50 条

[1] Modeling Deep Reinforcement Learning based Architectures for Cyber-Physical Systems
Gatto, Nicola
Kusmenko, Evgeny
Rumpe, Bernhard
2019 ACM/IEEE 22ND INTERNATIONAL CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS COMPANION (MODELS-C 2019), 2019, : 196 - 202
[2] Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning
Akazaki, Takumi
Liu, Shuang
Yamagata, Yoriyuki
Duan, Yihai
Hao, Jianye
FORMAL METHODS, 2018, 10951 : 456 - 465
[3] Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning
Yamagata, Yoriyuki
Liu, Shuang
Akazaki, Takumi
Duan, Yihai
Hao, Jianye
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2021, 47 (12) : 2823 - 2840
[4] Reinforcement Learning for Cyber-Physical Security Assessment of Power Systems
Liu, Xiaorui
Konstantinou, Charalambos
2019 IEEE MILAN POWERTECH, 2019,
[5] Privacy-Enhanced Intrusion Detection and Defense for Cyber-Physical Systems: A Deep Reinforcement Learning Approach
Lin, Qingyuan
Ming, Rui
Zhang, Kailing
Luo, Haibo
SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
[6] Deep reinforcement learning for wireless sensor scheduling in cyber-physical systems
Leong, Alex S.
Ramaswamy, Arunselvan
Quevedo, Daniel E.
Karl, Holger
Shi, Ling
AUTOMATICA, 2020, 113
[7] Falsification of Cyber-Physical Systems with Reinforcement Learning
Kato, Koki
Ishikawa, Fuyuki
Honiden, Shinichi
2018 IEEE 3RD WORKSHOP ON MONITORING AND TESTING OF CYBER-PHYSICAL SYSTEMS (MT-CPS 2018), 2018, : 5 - 6
[8] Resource Offload Consolidation Based on Deep-Reinforcement Learning Approach in Cyber-Physical Systems
Mekala, M. S.
Jolfaei, Alireza
Srivastava, Gautam
Zheng, Xi
Anvari-Moghaddam, Amjad
Viswanathan, P.
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (02): : 245 - 254
[9] Vertical handover policy for cyber-physical systems aided by SAGIN based on deep reinforcement learning
Wu, Yan
Pan, Guangchuan
Yao, Mingwu
Yang, Qinghai
Leung, Victor C.M.
Tongxin Xuebao/Journal on Communications, 2024, 45 (08): : 180 - 191
[10] Adaptive workload adjustment for cyber-physical systems using deep reinforcement learning
Xu, Shikang
Koren, Israel
Krishna, C. Mani
SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2021, 30

← 1 2 3 4 5 →