A Distributed Deep Reinforcement Learning Approach for Reactive Power Optimization of Distribution Networks

被引:0
|
作者
Liao, Jinlin [1 ,2 ,3 ]
Lin, Jia [4 ]
机构
[1] State Grid Fujian Elect Power Co Ltd, Econ Technol Res Inst, Fuzhou 350013, Peoples R China
[2] Distribut Network Planning & Operat Control Techno, Fuzhou 350013, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] State Grid Fujian Elect Power Co Ltd, Fuzhou 350001, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Reactive power; Optimization; Distribution networks; Deep reinforcement learning; Real-time systems; Trajectory; Fluctuations; Distributed power generation; Actor-critic; distributed power generation; distribution network; reactive power optimization; distributed deep reinforcement learning; SYSTEM;
D O I
10.1109/ACCESS.2024.3445143
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An actor-critic based distributed deep reinforcement learning approach is proposed to optimize the reactive power of the distribution network under the access of distributed photovoltaics, wind turbines and other power sources. This approach can optimize and dispatch the resources of the distribution network in real time under the change of power output such as distributed photovoltaics and wind turbines, so as to optimize the reactive power of the distribution network. First, this paper builds an optimization model with the objective function of minimizing the reactive power of the distribution network, and considers the operating constraints. Then, the agents of the proposed approach are trained, and the well-trained agents can schedule and optimize the resources of the distribution network in real time. Finally, based on the actual source-load output data in a certain place, reactive power optimization simulation experiments are carried out on the IEEE 33-bus, IEEE 123-bus simulation systems and the actual power distribution system in a region of China. Simulation results show that the proposed distributed deep reinforcement learning approach (DDRLA) can optimize distribution network reactive power online in real time.
引用
收藏
页码:113898 / 113909
页数:12
相关论文
共 50 条
  • [21] Optimization of reactive power compensation in distribution networks
    Volkanovski, Andrija
    Cepin, Marko
    Mavko, Borut
    [J]. Elektrotehniski Vestnik/Electrotechnical Review, 2009, 76 (1-2): : 57 - 62
  • [22] Learning to Operate Distribution Networks With Safe Deep Reinforcement Learning
    Li, Hepeng
    He, Haibo
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (03) : 1860 - 1872
  • [23] Reactive Power Optimization of Distribution Network with Distributed Generators
    Chen, Dongxin
    Dai, Shuangyin
    Shi, Huitan
    Wei, Chaofeng
    [J]. PROCEEDINGS OF THE 2016 5TH INTERNATIONAL CONFERENCE ON ADVANCED MATERIALS AND COMPUTER SCIENCE, 2016, 80 : 339 - 344
  • [24] Active and Reactive Power Coordinated Optimal Dispatch of Networked Microgrids Based on Distributed Deep Reinforcement Learning
    Ju, Yuntao
    Chen, Xi
    Li, Jiawei
    Wang, Jie
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (01): : 115 - 125
  • [25] Distributed Deep Reinforcement Learning With Prioritized Replay for Power Allocation in Underwater Acoustic Communication Networks
    Huang, Yao
    Wang, Hui
    Chen, Yingpin
    Wu, Hongrun
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) : 9915 - 9928
  • [26] Distributed Power Controller of Massive Wireless Body Area Networks based on Deep Reinforcement Learning
    He, Peng
    Liu, Ming
    Lan, Chunhui
    Su, Mengnan
    Wang, Linhai
    Li, Zhidu
    Tang, Tong
    [J]. Mobile Networks and Applications, 2021, 26 (03): : 1347 - 1358
  • [27] Distributed Power Controller of Massive Wireless Body Area Networks based on Deep Reinforcement Learning
    He, Peng
    Liu, Ming
    Lan, Chunhui
    Su, Mengnan
    Wang, Linhai
    Li, Zhidu
    Tang, Tong
    [J]. MOBILE NETWORKS & APPLICATIONS, 2021, 26 (03): : 1347 - 1358
  • [28] Distributed Power Controller of Massive Wireless Body Area Networks based on Deep Reinforcement Learning
    Peng He
    Ming Liu
    Chunhui Lan
    Mengnan Su
    Linhai Wang
    Zhidu Li
    Tong Tang
    [J]. Mobile Networks and Applications, 2021, 26 : 1347 - 1358
  • [29] Route optimization for autonomous bulldozer by distributed deep reinforcement learning
    Osaka, Yasuhiro
    Odajima, Naoya
    Uchimura, Yutaka
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS (ICM), 2021,
  • [30] Deep Reinforcement Learning for Demand Response in Distribution Networks
    Bahrami, Shahab
    Chen, Yu Christine
    Wong, Vincent W. S.
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (02) : 1496 - 1506