A Distributed Deep Reinforcement Learning Approach for Reactive Power Optimization of Distribution Networks

被引:0
|
作者
Liao, Jinlin [1 ,2 ,3 ]
Lin, Jia [4 ]
机构
[1] State Grid Fujian Elect Power Co Ltd, Econ Technol Res Inst, Fuzhou 350013, Peoples R China
[2] Distribut Network Planning & Operat Control Techno, Fuzhou 350013, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] State Grid Fujian Elect Power Co Ltd, Fuzhou 350001, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Reactive power; Optimization; Distribution networks; Deep reinforcement learning; Real-time systems; Trajectory; Fluctuations; Distributed power generation; Actor-critic; distributed power generation; distribution network; reactive power optimization; distributed deep reinforcement learning; SYSTEM;
D O I
10.1109/ACCESS.2024.3445143
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An actor-critic based distributed deep reinforcement learning approach is proposed to optimize the reactive power of the distribution network under the access of distributed photovoltaics, wind turbines and other power sources. This approach can optimize and dispatch the resources of the distribution network in real time under the change of power output such as distributed photovoltaics and wind turbines, so as to optimize the reactive power of the distribution network. First, this paper builds an optimization model with the objective function of minimizing the reactive power of the distribution network, and considers the operating constraints. Then, the agents of the proposed approach are trained, and the well-trained agents can schedule and optimize the resources of the distribution network in real time. Finally, based on the actual source-load output data in a certain place, reactive power optimization simulation experiments are carried out on the IEEE 33-bus, IEEE 123-bus simulation systems and the actual power distribution system in a region of China. Simulation results show that the proposed distributed deep reinforcement learning approach (DDRLA) can optimize distribution network reactive power online in real time.
引用
收藏
页码:113898 / 113909
页数:12
相关论文
共 50 条
  • [1] Distributed Reactive Power Optimization for Energy Internet via Multiagent Deep Reinforcement Learning With Graph Attention Networks
    Xu, Shaolong
    Guo, Sheng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (06) : 8696 - 8706
  • [2] Continuous Reactive Power Optimization of Distribution Network Using Deep Reinforcement Learning
    Li, Qi
    Qiao, Ying
    Zhang, Yujing
    [J]. Dianwang Jishu/Power System Technology, 2020, 44 (04): : 1473 - 1480
  • [3] Multi-timescale Deep Reinforcement Learning for Reactive Power Optimization of Distribution Network
    Hu, Daner
    Peng, Yonggang
    Wei, Wei
    Xiao, Tingting
    Cai, Tiantian
    Xi, Wei
    [J]. Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (14): : 5034 - 5044
  • [4] Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach
    Xiong, Jian
    Fang, Yuzhe
    Cheng, Peng
    Shi, Zhiping
    Zhang, Wei
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (01) : 201 - 211
  • [5] Reactive Power Optimization Based on Proximal Policy Optimization of Deep Reinforcement Learning
    Zahng, Pei
    Zhu, Zhujun
    Xie, Hua
    [J]. Dianwang Jishu/Power System Technology, 2023, 47 (02): : 562 - 570
  • [6] A Distributed Reinforcement Learning approach for Power Control in Wireless Networks
    Ornatelli, Antonio
    Tortorelli, Andrea
    Liberati, Francesco
    [J]. 2021 IEEE WORLD AI IOT CONGRESS (AIIOT), 2021, : 275 - 281
  • [7] A coordinated active and reactive power optimization approach for multi-microgrids connected to distribution networks with multi-actor-attention-critic deep reinforcement learning
    Dong, Lei
    Lin, Hao
    Qiao, Ji
    Zhang, Tao
    Zhang, Shiming
    Pu, Tianjiao
    [J]. APPLIED ENERGY, 2024, 373
  • [8] Reactive power optimization in active distribution systems with soft open points based on deep reinforcement learning
    Xiong, Meisong
    Yang, Xiaodong
    Zhang, Youbing
    Wu, Hongbin
    Lin, Yihang
    Wang, Guofeng
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2024, 155
  • [9] Joint Optimization of Spectrum and Power for Vehicular Networks: A MAPPO Based Deep Reinforcement Learning Approach
    Cai, Weiteng
    Huang, Xiujie
    Chen, Yuhao
    Guan, Quanlong
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [10] Deep reinforcement learning based reactive power regulation and its optimization in power grids
    Zhou, Yi
    Zhou, Liangcai
    Sheng, Xu
    Gu, Dongjian
    Shen, Weijian
    Chen, Qing
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)