Decentralized yaw optimization for maximizing wind farm production based on deep reinforcement learning

被引:8
|
作者
Deng, Zhiwen [1 ]
Xu, Chang [1 ,2 ]
Han, Xingxing [2 ]
Cheng, Zhe [2 ]
Xue, Feifei [1 ]
机构
[1] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 210098, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金;
关键词
Wind farm; Deep reinforcement learning; Dynamic wake model; Production maximization; Yaw meandering; MODEL; TURBINES;
D O I
10.1016/j.enconman.2023.117031
中图分类号
O414.1 [热力学];
学科分类号
摘要
This study describes a deep reinforcement learning (DRL) based decentralized yaw optimization method to maximize the power production of wind farms. Specifically, we apply the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to design agents separately for each turbine in the wind farm to make yaw de-cisions independently. This design allows setting different yaw rewards for the agents to promote faster and better convergence of MADDPG. To test the control effect of the proposed method, a novel analytical dynamic wake model is derived first, which can dynamically reflect the wake propagation of the wind turbine after the inflow wind speed, axial induction factor, and yaw angle change. Then, the static and dynamic characteristics of the proposed wake model are verified. The wind farm simulation is realized through the dynamic wake model, which provides an interactive environment for the simulation experiments to test the effect of the proposed DRL-based decentralized yaw optimization method. The results show that the proposed method can significantly increase the power generation of the wind farm, and the set yaw reward helps to guide MADDPG to converge to the optimal strategy.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based on Proximal Policy Optimization for the Maintenance of a Wind Farm with Multiple Crews
    Pinciroli, Luca
    Baraldi, Piero
    Ballabio, Guido
    Compare, Michele
    Zio, Enrico
    [J]. ENERGIES, 2021, 14 (20)
  • [2] Model-Free Optimization Scheme for Efficiency Improvement of Wind Farm Using Decentralized Reinforcement Learning
    Xu, Zhiwei
    Geng, Hua
    Chu, Bing
    Qian, Menghao
    Tan, Ni
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 12103 - 12108
  • [3] Machine-learning-based wind farm optimization through layout design and yaw control
    Yang, Shanghui
    Deng, Xiaowei
    Yang, Kun
    [J]. RENEWABLE ENERGY, 2024, 224
  • [4] MAXIMIZING ENERGY OUTPUT OF A WIND FARM USING TEACHING-LEARNING-BASED OPTIMIZATION
    Patel, Jaydeep
    Saysani, Vimal
    Patel, Rajesh
    [J]. PROCEEDINGS OF ASME 9TH INTERNATIONAL CONFERENCE ON ENERGY SUSTAINABILITY, 2015, VOL 2, 2016,
  • [5] Distributed Operation of Wind Farm for Maximizing Output Power: A Multi-Agent Deep Reinforcement Learning Approach
    Bui, Van-Hai
    Nguyen, Thai-Thanh
    Kim, Hak-Man
    [J]. IEEE ACCESS, 2020, 8 : 173136 - 173146
  • [6] A Distributed Reinforcement Learning Yaw Control Approach for Wind Farm Energy Capture Maximization
    Stanfel, Paul
    Johnson, Kathryn
    Bay, Christopher J.
    King, Jennifer
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 4065 - 4070
  • [7] Decentralized Reinforcement Learning Based MAC Optimization
    Nisioti, Eleni
    Thomos, Nikolaos
    [J]. 2018 IEEE 29TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2018,
  • [8] Wakes of Wind Turbines in Yaw for Wind Farm Power Optimization
    Crespo, Antonio
    [J]. ENERGIES, 2022, 15 (18)
  • [9] A teaching-learning-based optimization algorithm with reinforcement learning to address wind farm layout optimization problem
    Yu, Xiaobing
    Zhang, Wen
    [J]. APPLIED SOFT COMPUTING, 2024, 151
  • [10] Ensemble-based Deep Reinforcement Learning for robust cooperative wind farm control
    He, Binghao
    Zhao, Huan
    Liang, Gaoqi
    Zhao, Junhua
    Qiu, Jing
    Dong, Zhao Yang
    [J]. International Journal of Electrical Power and Energy Systems, 2022, 143