Decentralized yaw optimization for maximizing wind farm production based on deep reinforcement learning

被引:8
|
作者
Deng, Zhiwen [1 ]
Xu, Chang [1 ,2 ]
Han, Xingxing [2 ]
Cheng, Zhe [2 ]
Xue, Feifei [1 ]
机构
[1] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 210098, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金;
关键词
Wind farm; Deep reinforcement learning; Dynamic wake model; Production maximization; Yaw meandering; MODEL; TURBINES;
D O I
10.1016/j.enconman.2023.117031
中图分类号
O414.1 [热力学];
学科分类号
摘要
This study describes a deep reinforcement learning (DRL) based decentralized yaw optimization method to maximize the power production of wind farms. Specifically, we apply the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to design agents separately for each turbine in the wind farm to make yaw de-cisions independently. This design allows setting different yaw rewards for the agents to promote faster and better convergence of MADDPG. To test the control effect of the proposed method, a novel analytical dynamic wake model is derived first, which can dynamically reflect the wake propagation of the wind turbine after the inflow wind speed, axial induction factor, and yaw angle change. Then, the static and dynamic characteristics of the proposed wake model are verified. The wind farm simulation is realized through the dynamic wake model, which provides an interactive environment for the simulation experiments to test the effect of the proposed DRL-based decentralized yaw optimization method. The results show that the proposed method can significantly increase the power generation of the wind farm, and the set yaw reward helps to guide MADDPG to converge to the optimal strategy.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Data-Driven Wind Farm Control via Multiplayer Deep Reinforcement Learning
    Dong, Hongyang
    Zhao, Xiaowei
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2023, 31 (03) : 1468 - 1475
  • [42] Rolling horizon wind-thermal unit commitment optimization based on deep reinforcement learning
    Shi, Jinhao
    Wang, Bo
    Yuan, Ran
    Wang, Zhi
    Chen, Chunlin
    Watada, Junzo
    [J]. APPLIED INTELLIGENCE, 2023, 53 (16) : 19591 - 19609
  • [43] Rolling horizon wind-thermal unit commitment optimization based on deep reinforcement learning
    Jinhao Shi
    Bo Wang
    Ran Yuan
    Zhi Wang
    Chunlin Chen
    Junzo Watada
    [J]. Applied Intelligence, 2023, 53 : 19591 - 19609
  • [44] A Deep Reinforcement Learning Based Energy Storage System Control Method for Wind farm Integrating Prediction and Decision
    Yang, Jiajun
    Yang, Ming
    Du, Pingjing
    Yan, Fangqing
    Yu, Yixiao
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INTERNATIONAL ELECTRICAL AND ENERGY CONFERENCE (CIEEC), 2019, : 568 - 573
  • [45] Deep reinforcement learning for maintenance optimization of a scrap-based steel production line
    Ferreira Neto, Waldomiro Alves
    Cavalcante, Cristiano Alexandre Virginio
    Do, Phuc
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 249
  • [46] Accelerated wind farm yaw and layout optimisation with multi-fidelity deep transfer learning wake models
    Anagnostopoulos, Sokratis J.
    Bauer, Jens
    Clare, Mariana C. A.
    Piggott, Matthew D.
    [J]. RENEWABLE ENERGY, 2023, 218
  • [47] Container stacking optimization based on Deep Reinforcement Learning
    Jin, Xin
    Duan, Zhentang
    Song, Wen
    Li, Qiqiang
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [48] An Antenna Optimization Framework Based on Deep Reinforcement Learning
    Peng, Fengling
    Chen, Xing
    [J]. IEEE Transactions on Antennas and Propagation, 2024, 72 (10) : 7594 - 7605
  • [49] Aerodynamic optimization of airfoil based on deep reinforcement learning
    Lou, Jinhua
    Chen, Rongqian
    Liu, Jiaqi
    Bao, Yue
    You, Yancheng
    Chen, Zhengwu
    [J]. PHYSICS OF FLUIDS, 2023, 35 (03)
  • [50] Reentry trajectory optimization based on Deep Reinforcement Learning
    Gao, Jiashi
    Shi, Xinming
    Cheng, Zhongtao
    Xiong, Jizhang
    Liu, Lei
    Wang, Yongji
    Yang, Ye
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 2588 - 2592