Wind Farm Power Generation Control Via Double-Network-Based Deep Reinforcement Learning

被引:22
|
作者
Xie, Jingjie [1 ]
Dong, Hongyang [1 ]
Zhao, Xiaowei [1 ]
Karcanias, Aris [2 ]
机构
[1] Univ Warwick, Sch Engn, Intelligent Control & Smart Energy ICSE Res Grp, Coventry CV4 7AL, W Midlands, England
[2] PA Consulting, London SW1E 5DN, England
基金
英国工程与自然科学研究理事会;
关键词
Wind farms; Power generation; Informatics; Wind turbines; Training; Production; Optimal control; Model-free control; power generation control; reinforcement learning (RL); wind farm control; MODEL-PREDICTIVE CONTROL; OPTIMIZATION;
D O I
10.1109/TII.2021.3095563
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A model-free deep reinforcement learning (DRL) method is proposed in this article to maximize the total power generation of wind farms through the combination of induction control and yaw control. Specifically, a novel double-network (DN)-based DRL approach is designed to generate control policies for thrust coefficients and yaw angles simultaneously and separately. Two sets of critic-actor networks are constructed to this end. They are linked by a central power-related reward, providing a coordinated control structure while inheriting the critic-actor mechanism's advantages. Compared with conventional DRL methods, the proposed DN-based DRL strategy can adapt to the distinctive and incompatible features of different control inputs, guaranteeing a reliable training process and ensuring superior performance. Also, the prioritized experience replay strategy is utilized to improve the training efficiency of deep neural networks. Simulation tests based on a dynamic wind farm simulator show that the proposed method can significantly increase the power generation for wind farms with different layouts.
引用
收藏
页码:2321 / 2330
页数:10
相关论文
共 50 条
  • [1] Data-Driven Wind Farm Control via Multiplayer Deep Reinforcement Learning
    Dong, Hongyang
    Zhao, Xiaowei
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2023, 31 (03) : 1468 - 1475
  • [2] Intelligent Wind Farm Control via Grouping-Based Reinforcement Learning
    Dong, Hongyang
    Zhao, Xiaowei
    [J]. 2022 EUROPEAN CONTROL CONFERENCE (ECC), 2022, : 993 - 998
  • [3] Intelligent wind farm control via deep reinforcement learning and high-fidelity simulations
    Dong, Hongyang
    Zhang, Jincheng
    Zhao, Xiaowei
    [J]. APPLIED ENERGY, 2021, 292
  • [4] Ensemble-based Deep Reinforcement Learning for robust cooperative wind farm control
    He, Binghao
    Zhao, Huan
    Liang, Gaoqi
    Zhao, Junhua
    Qiu, Jing
    Dong, Zhao Yang
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2022, 143
  • [5] Deep Reinforcement Learning for Automatic Generation Control of Wind Farms
    Vijayshankar, Sanjana
    Stanfel, Paul
    King, Jennifer
    Spyrou, Evangelia
    Johnson, Kathryn
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1796 - 1802
  • [6] Application of Reinforcement Learning to Wind Farm Active Power Control Design
    Zhang, Xuanhe
    Badihi, Hamed
    Yu, Ziquan
    Benbouzid, Mohamed
    Lu, Ningyun
    Zhang, Youmin
    [J]. 2022 IEEE ELECTRICAL POWER AND ENERGY CONFERENCE (EPEC), 2022, : 229 - 234
  • [7] Reactive-Voltage Coordinated Control of Offshore Wind Farm Based on Deep Reinforcement Learning
    Tan, Hongtao
    Li, Hui
    Xie, Xiangjie
    Yang, Tian
    Zheng, Jie
    Yang, Wei
    [J]. 2021 3RD ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM (AEEES 2021), 2021, : 407 - 412
  • [8] Comparison of Deep Reinforcement Learning Techniques with Gradient based approach in Cooperative Control of Wind Farm
    Pujari, Keerthi NagaSree
    Srivastava, Vivek
    Miriyala, Srinivas Soumitri
    Mitra, Kishalay
    [J]. 2021 SEVENTH INDIAN CONTROL CONFERENCE (ICC), 2021, : 400 - 405
  • [9] Composite Experience Replay-Based Deep Reinforcement Learning With Application in Wind Farm Control
    Dong, Hongyang
    Zhao, Xiaowei
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (03) : 1281 - 1295
  • [10] Deep learning-based wind farm power prediction using Transformer network
    Li, Rui
    Zhang, Jincheng
    Zhao, Xiaowei
    [J]. 2022 EUROPEAN CONTROL CONFERENCE (ECC), 2022, : 1018 - 1023