Exploring the application of reinforcement learning to wind farm control

被引:11
|
作者
Korb, Henry [1 ]
Asmuth, Henrik [1 ]
Stender, Merten [2 ]
Ivanell, Stefan [1 ]
机构
[1] Uppsala Univ, Wind Energy Sect, Campus Gotland, S-62157 Visby, Sweden
[2] Hamburg Univ Technol, Dynam Grp, Am Schwarzenberg Campus 1, D-21073 Hamburg, Germany
来源
WAKE CONFERENCE 2021 | 2021年 / 1934卷
关键词
DYNAMIC INDUCTION CONTROL; SIMULATIONS;
D O I
10.1088/1742-6596/1934/1/012022
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Optimal control of wind farms to maximize power is a challenging task since the wake interaction between the turbines is a highly nonlinear phenomenon. In recent years the field of Reinforcement Learning has made great contributions to nonlinear control problems and has been successfully applied to control and optimization in 2D laminar flows. In this work, Reinforcement Learning is applied to wind farm control for the first time to the authors' best knowledge. To demonstrate the optimization abilities of the newly developed framework, parameters of an already existing control strategy, the helix approach, are tuned to optimize the total power production of a small wind farm. This also includes an extension of the helix approach to multiple turbines. Furthermore, it is attempted to develop novel control strategies based on the control of the generator torque. The results are analysed and difficulties in the setup in regards to Reinforcement Learning are discussed. The tuned helix approach yields a total power increase of 6.8 % on average for the investigated case, while the generator torque controller does not yield an increase in total power. Finally, an alternative setup is proposed to improve the design of the problem.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Application of Reinforcement Learning to Wind Farm Active Power Control Design
    Zhang, Xuanhe
    Badihi, Hamed
    Yu, Ziquan
    Benbouzid, Mohamed
    Lu, Ningyun
    Zhang, Youmin
    2022 IEEE ELECTRICAL POWER AND ENERGY CONFERENCE (EPEC), 2022, : 229 - 234
  • [2] Wind farm control technologies: from classical control to reinforcement learning
    Dong, Hongyang
    Xie, Jingjie
    Zhao, Xiaowei
    PROGRESS IN ENERGY, 2022, 4 (03):
  • [3] A Multiagent Reinforcement Learning Approach for Wind Farm Frequency Control
    Liang, Yanchang
    Zhao, Xiaowei
    Sun, Li
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1725 - 1734
  • [4] Composite Experience Replay-Based Deep Reinforcement Learning With Application in Wind Farm Control
    Dong, Hongyang
    Zhao, Xiaowei
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (03) : 1281 - 1295
  • [5] Cooperative Wind Farm Control With Deep Reinforcement Learning and Knowledge-Assisted Learning
    Zhao, Huan
    Zhao, Junhua
    Qiu, Jing
    Liang, Gaoqi
    Dong, Zhao Yang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (11) : 6912 - 6921
  • [6] Optimal control of a wind farm in time-varying wind using deep reinforcement learning
    Kim, Taewan
    Kim, Changwook
    Song, Jeonghwan
    You, Donghyun
    ENERGY, 2024, 303
  • [7] Intelligent Wind Farm Control via Grouping-Based Reinforcement Learning
    Dong, Hongyang
    Zhao, Xiaowei
    2022 EUROPEAN CONTROL CONFERENCE (ECC), 2022, : 993 - 998
  • [8] Exploring Reward Strategies for Wind Turbine Pitch Control by Reinforcement Learning
    Sierra-Garcia, Jesus Enrique
    Santos, Matilde
    APPLIED SCIENCES-BASEL, 2020, 10 (21): : 1 - 23
  • [9] Ensemble-based Deep Reinforcement Learning for robust cooperative wind farm control
    He, Binghao
    Zhao, Huan
    Liang, Gaoqi
    Zhao, Junhua
    Qiu, Jing
    Dong, Zhao Yang
    International Journal of Electrical Power and Energy Systems, 2022, 143
  • [10] Data-Driven Wind Farm Control via Multiplayer Deep Reinforcement Learning
    Dong, Hongyang
    Zhao, Xiaowei
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2023, 31 (03) : 1468 - 1475