Load balancing and topology dynamic adjustment strategy for power information system network: a deep reinforcement learning-based approach

被引:0
|
作者
Liao, Xiao [1 ]
Bao, Beifang [1 ]
Cui, Wei [1 ]
Liu, Di [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing, Peoples R China
来源
关键词
power information systems; load balancing; flood attack; Markov decision process; deep reinforcement learning;
D O I
10.3389/fenrg.2023.1342854
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
As power information systems play an increasingly critical role in modern society, higher requirements are placed on the performance and reliability of their network infrastructure. In order to cope with the growing data traffic and network attack threats in the power information system, we select the power information system data center network as the research object and design an overall system solution based on software defined network, including the application layer, control layer and infrastructure layer. A typical fat tree network topology is simulated and analyzed. We define the load balancing and network topology dynamic adjustment problem as a Markov decision process, and design a data flow path acquisition method based on breadth-first search to construct the action space of each host. Then, a deep reinforcement learning algorithm based on deep Q-network, priority experience replay and target network is introduced to provide solutions for optimizing the performance of power information systems and responding to network attacks. Simulation results show that the proposed method is better than the traditional equal-cost multi-path algorithm in terms of average bandwidth utilization, average jitter and average packet loss, and can reduce the probability of network nodes being attacked by more than 11%.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Load Balancing for Ultradense Networks: A Deep Reinforcement Learning-Based Approach
    Xu, Yue
    Xu, Wenjun
    Wang, Zhi
    Lin, Jiaru
    Cui, Shuguang
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06): : 9399 - 9412
  • [2] Load Frequency Control Strategy of Hybrid Power Generation System: a Deep Reinforcement Learning-Based Approach
    Liang, Yudong
    Chen, Luan
    Zhang, Guozhou
    Ren, Manman
    Hu, Weihao
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (07): : 1768 - 1779
  • [3] Reinforcement learning-based dynamic load balancing in edge computing networks
    Esmaeili, Mohammad Esmaeil
    Khonsari, Ahmad
    Sohrabi, Vahid
    Dadlani, Aresh
    [J]. COMPUTER COMMUNICATIONS, 2024, 222 : 188 - 197
  • [4] Joint Topology Construction and Power Adjustment for UAV Networks: A Deep Reinforcement Learning Based Approach
    Xu, Wenjun
    Lei, Huangchun
    Shang, Jin
    [J]. CHINA COMMUNICATIONS, 2021, 18 (07) : 265 - 283
  • [5] Joint Topology Construction and Power Adjustment for UAV Networks: A Deep Reinforcement Learning Based Approach
    Wenjun
    Huangchun Lei
    Jin Shang
    [J]. China Communications, 2021, 18 (07) : 265 - 283
  • [6] DeepRLB: A deep reinforcement learning-based load balancing in data center networks
    Rikhtegar, Negar
    Bushehrian, Omid
    Keshtgari, Manijeh
    [J]. INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2021, 34 (15)
  • [7] Deep Reinforcement Learning Based Autonomous Control Approach for Power System Topology Optimization
    Han, Xiaoyun
    Hao, Yi
    Chong, Zhiqiang
    Ma, Shiqiang
    Mu, Chaoxu
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6041 - 6046
  • [8] Network Load Balancing Strategy Based on Supervised Reinforcement Learning with Shaping Rewards
    Hu, Zhaohui
    Chen, Hao
    [J]. PROCEEDINGS OF THE 2013 FOURTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2013, : 393 - 397
  • [9] Deep Reinforcement Learning Based Load Balancing Routing for LEO Satellite Network
    Zuo, Peiliang
    Wang, Chen
    Wei, Zhanzhen
    Li, Zhaobin
    Zhao, Hong
    Jiang, Hua
    [J]. 2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [10] Teleport: Load balancing with dynamic adjustment strategy based on OSD storage system
    Yan, Bin
    Wang, Hongyi
    Zhang, Youhui
    Liu, Chuanyi
    Wang, Dongsheng
    [J]. SNAPI 2007: FOURTH INTERNATIONAL WORKSHOP ON STORAGE NETWORK ARCHITECTURE AND PARALLEL I/OS, PROCEEDINGS, 2007, : 122 - 128