A Distributed Deep Reinforcement Learning Approach for Reactive Power Optimization of Distribution Networks

被引:0
|
作者
Liao, Jinlin [1 ,2 ,3 ]
Lin, Jia [4 ]
机构
[1] State Grid Fujian Elect Power Co Ltd, Econ Technol Res Inst, Fuzhou 350013, Peoples R China
[2] Distribut Network Planning & Operat Control Techno, Fuzhou 350013, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] State Grid Fujian Elect Power Co Ltd, Fuzhou 350001, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Reactive power; Optimization; Distribution networks; Deep reinforcement learning; Real-time systems; Trajectory; Fluctuations; Distributed power generation; Actor-critic; distributed power generation; distribution network; reactive power optimization; distributed deep reinforcement learning; SYSTEM;
D O I
10.1109/ACCESS.2024.3445143
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An actor-critic based distributed deep reinforcement learning approach is proposed to optimize the reactive power of the distribution network under the access of distributed photovoltaics, wind turbines and other power sources. This approach can optimize and dispatch the resources of the distribution network in real time under the change of power output such as distributed photovoltaics and wind turbines, so as to optimize the reactive power of the distribution network. First, this paper builds an optimization model with the objective function of minimizing the reactive power of the distribution network, and considers the operating constraints. Then, the agents of the proposed approach are trained, and the well-trained agents can schedule and optimize the resources of the distribution network in real time. Finally, based on the actual source-load output data in a certain place, reactive power optimization simulation experiments are carried out on the IEEE 33-bus, IEEE 123-bus simulation systems and the actual power distribution system in a region of China. Simulation results show that the proposed distributed deep reinforcement learning approach (DDRLA) can optimize distribution network reactive power online in real time.
引用
收藏
页码:113898 / 113909
页数:12
相关论文
共 50 条
  • [31] Cooperative Beamforming With Nonlinear Power Amplifiers: A Deep Learning Approach for Distributed Networks
    Jee, Jeongju
    Kwon, Girim
    Park, Hyuncheol
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 5973 - 5988
  • [32] Deceiving Reactive Jamming in Dynamic Wireless Sensor Networks: A Deep Reinforcement Learning Based Approach
    Zhang, Chen
    Mao, Tianqi
    Xiao, Zhenyu
    Liu, Ruiqi
    Xia, Xiang-Gen
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4455 - 4460
  • [33] Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices
    Cao, Di
    Hu, Weihao
    Xu, Xiao
    Wu, Qiuwei
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    [J]. JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (05) : 1101 - 1110
  • [34] Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices
    Di Cao
    Weihao Hu
    Xiao Xu
    Qiuwei Wu
    Qi Huang
    Zhe Chen
    Frede Blaabjerg
    [J]. Journal of Modern Power Systems and Clean Energy, 2021, 9 (05) : 1101 - 1110
  • [35] Active and Reactive Power Coordinated Control of Active Distribution Networks Based on Prioritized Reinforcement Learning
    Wang, Xinming
    Liu, Haotian
    Cao, Xin
    Wu, Wenchuan
    Li, Shihui
    Jia, Xiaobu
    [J]. 2021 POWER SYSTEM AND GREEN ENERGY CONFERENCE (PSGEC), 2021, : 91 - 96
  • [36] Dynamic Offloading Loading Optimization in Distributed Fault Diagnosis System with Deep Reinforcement Learning Approach
    Yu, Liang
    Guo, Qixin
    Wang, Rui
    Shi, Minyan
    Yan, Fucheng
    Wang, Ran
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [37] An Approach to Combine the Power of Deep Reinforcement Learning with a Graph Neural Network for Routing Optimization
    Chen, Bo
    Zhu, Di
    Wang, Yuwei
    Zhang, Peng
    [J]. ELECTRONICS, 2022, 11 (03)
  • [38] Deep Reinforcement Learning Based Autonomous Control Approach for Power System Topology Optimization
    Han, Xiaoyun
    Hao, Yi
    Chong, Zhiqiang
    Ma, Shiqiang
    Mu, Chaoxu
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6041 - 6046
  • [39] A Deep Reinforcement Learning Approach For LoRaWAN Energy Optimization
    Yazid, Yassine
    Ez-Zazi, Imad
    Arioua, Mounir
    El Oualkadi, Ahmed
    [J]. 2021 IEEE WORKSHOP ON MICROWAVE THEORY AND TECHNIQUES IN WIRELESS COMMUNICATIONS, MTTW'21, 2021, : 199 - 204
  • [40] Multi-Agent Deep Reinforcement Learning for Voltage Control With Coordinated Active and Reactive Power Optimization
    Hu, Daner
    Ye, Zhenhui
    Gao, Yuanqi
    Ye, Zuzhao
    Peng, Yonggang
    Yu, Nanpeng
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (06) : 4873 - 4886