Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

被引:0
|
作者
Liao, Xiao [1 ]
Bao, Beifang [1 ]
Cui, Wei [1 ]
Liu, Di [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing, Peoples R China
关键词
power information systems; load balancing; flood attack; Markov decision process; deep reinforcement learning;
D O I
10.3389/fenrg.2023.1342854
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
As power information systems play an increasingly critical role in modern society, higher requirements are placed on the performance and reliability of their network infrastructure. In order to cope with the growing data traffic and network attack threats in the power information system, we select the power information system data center network as the research object and design an overall system solution based on software defined network, including the application layer, control layer and infrastructure layer. A typical fat tree network topology is simulated and analyzed. We define the load balancing and network topology dynamic adjustment problem as a Markov decision process, and design a data flow path acquisition method based on breadth-first search to construct the action space of each host. Then, a deep reinforcement learning algorithm based on deep Q-network, priority experience replay and target network is introduced to provide solutions for optimizing the performance of power information systems and responding to network attacks. Simulation results show that the proposed method is better than the traditional equal-cost multi-path algorithm in terms of average bandwidth utilization, average jitter and average packet loss, and can reduce the probability of network nodes being attacked by more than 11%.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deep Reinforcement Learning-Based Active Network Management and Emergency Load-Shedding Control for Power Systems
    Zhang, Haotian
    Sun, Xinfeng
    Lee, Myoung Hoon
    Moon, Jun
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1423 - 1437
  • [22] Deep Reinforcement Learning Based Approach for Dynamic Optimal Power Flow in Active Distribution Network
    Liu, Xinghua
    Fan, Bangji
    Tian, Jiaqiang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 1951 - 1956
  • [23] Deep Reinforcement Learning-Based Defense Strategy Selection
    Charpentier, Axel
    Boulahia-Cuppens, Nora
    Cuppens, Frederic
    Yaich, Reda
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY, ARES 2022, 2022,
  • [24] Reinforcement learning-based load balancing for heavy traffic Internet of Things
    Lei, Jianjun
    Liu, Jie
    PERVASIVE AND MOBILE COMPUTING, 2024, 99
  • [25] Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy
    Liang, Tao
    Chai, Lulu
    Tan, Jianxin
    Jing, Yanwei
    Lv, Liangnian
    APPLIED ENERGY, 2024, 367
  • [26] Intelligent adjustment for power system operation mode based on deep reinforcement learning
    Hu, Wei
    Mi, Ning
    Wu, Shuang
    Zhang, Huiling
    Hu, Zhewen
    Zhang, Lei
    iEnergy, 2024, 3 (04): : 252 - 260
  • [27] Power System Flow Adjustment and Sample Generation Based on Deep Reinforcement Learning
    Shuang Wu
    Wei Hu
    Zongxiang Lu
    Yujia Gu
    Bei Tian
    Hongqiang Li
    Journal of Modern Power Systems and Clean Energy, 2020, 8 (06) : 1115 - 1127
  • [28] Power System Flow Adjustment and Sample Generation Based on Deep Reinforcement Learning
    Wu, Shuang
    Hu, Wei
    Lu, Zongxiang
    Gu, Yujia
    Tian, Bei
    Li, Hongqiang
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) : 1115 - 1127
  • [29] Deep Reinforcement Learning-Based Trading Strategy for Load Aggregators on Price-Responsive Demand
    Yang, Guang
    Du, Songhuai
    Duan, Qingling
    Su, Juan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [30] Deep Reinforcement Learning Based Load Control Strategy for Combined Heat and Power Units
    Xie, Ge
    Cui, Chenggang
    Zhao, Huirong
    Yang, Jiguang
    Shi, Yunfei
    2021 11TH INTERNATIONAL CONFERENCE ON POWER AND ENERGY SYSTEMS (ICPES 2021), 2021, : 280 - 284