Intelligent generation method of power system stability control strategy based on safe reinforcement learning

被引:0
|
作者
Qiu J. [1 ]
Zhu Y. [2 ,3 ]
Zhang J. [1 ]
Zhu Y. [2 ,3 ]
Xu G. [1 ]
Tu L. [2 ,3 ]
机构
[1] China Southern Power Grid Company Limited, Guangzhou
[2] State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou
[3] Guangdong Provincial Key Laboratory of Intelligent Operation and Control for New Energy Power System, Guangzhou
关键词
domain knowledge; safety reinforcement learning; stability control strategy; temporal and spatial characteristics;
D O I
10.19783/j.cnki.pspc.231360
中图分类号
学科分类号
摘要
The trend of a “higher proportion of renewable energy and power electronics” in the new power system has changed the classical stability characteristics of the system. The stability mechanism is more complex, and the system stability modes are more diverse. Online stability control strategies based on typical operating modes face a challenge. Considering the rotor angle stability problem of the new power system, an intelligent generation stability control strategy based on safe reinforcement learning is proposed. First, a constrained Markov model for power system stability control problems is established, and the safety constraints involved in rotor angle stability control are summarized and proposed. Secondly, to improve the ability to extract spatial and temporal features of the power grid’s transient response, a feature perception network based on graph convolutional layers and long short-term memory units is constructed. Then, to improve the training efficiency of the stability control agent, a training framework of stability control strategies using proximal policy optimization algorithm based on embedded domain knowledge constraints is proposed. Finally, a case study is performed on the IEEE 39-bus system and a practical power grid. The results show that the proposed method can adaptively generate unit tripping strategies based on the system operating state and fault response, and its decision-making effectiveness and efficiency are superior to existing stability control strategies. © 2024 Power System Protection and Control Press. All rights reserved.
引用
收藏
页码:147 / 155
页数:8
相关论文
共 29 条
  • [1] QI Jinshan, YAO Liangzhong, LIAO Siyang, Et al., Online probabilistic assessment of static voltage stability margin for power systems with a high proportion of renewable energy, Power System Protection and Control, 51, 5, pp. 47-57, (2023)
  • [2] LUO Zhao, NIE Lingfeng, TIAN Xiao, Et al., Control strategy of electrolytic aluminum load participating in power network frequency stability based on model predictive control, Electric Power Construction, 44, 10, pp. 1-11, (2023)
  • [3] LI Qun, ZHANG Ningyu, WANG Xinbao, Et al., Review on application of flexible power flow control technology, Electric Power Engineering Technology, 42, 1, pp. 50-60, (2023)
  • [4] JIANG Wei, SA Pengcheng, JIA Jun, Et al., Virtual microgrid partitioning planning based on modularity of power flow tracking, Automation of Electric Power Systems, 47, 24, pp. 132-142, (2023)
  • [5] GUO Qinglai, LAN Jian, ZHOU Yanzhen, Et al., Architecture and key technologies of hybrid-intelligence-based decision-making of operation modes for new type power systems, Electric Power, 56, 9, pp. 1-13, (2023)
  • [6] LIU Yingshang, ZHANG Jianxin, XU Guanghu, Et al., Operation characteristics and safety and stability control of complex AC/DC interconnected power grids in the southern region, Southern Power System Technology, 14, 5, pp. 44-50, (2020)
  • [7] HUANG Tiangang, Integration of statistical analysis and causal analysis in transient stability quantitative assessment, (2018)
  • [8] ZHANG Gang, ZONG Qihang, KE Xianbo, Et al., Online warning of transient power angle stability of power systems with wind power based on critical inertia and anticipated faults, Power System Protection and Control, 51, 16, pp. 72-83, (2023)
  • [9] LU Guangming, ZHANG Lulu, MA Jing, Et al., Intelligent transient stability situation assessment of powergrid based on time-series feature selection and improved MSPCA algorithm, Electrical Measurement & Instrumentation, 60, 6, pp. 125-133, (2023)
  • [10] MA Haibin, LIU Daowei, ZHAO Gaoshang, Et al., Power grid voltage phasor trajectory fitting and transient stability evaluation index construction based on alternate direction multiplier method, Electric Power Construction, 44, 12, pp. 136-147, (2023)