Deep Reinforcement Learning for Load Frequency Control in Isolated Microgrids: A Knowledge Aggregation Approach with Emphasis on Power Symmetry and Balance

被引:2
|
作者
Wu, Min [1 ]
Ma, Dakui [1 ]
Xiong, Kaiqing [2 ]
Yuan, Linkun [2 ]
机构
[1] Guangdong Power Grid Co Ltd, Guangzhou 510600, Peoples R China
[2] Guangdong Power Grid Co Ltd, Yangjiang Power Supply Bur, Yangjiang 529500, Peoples R China
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 03期
基金
中国国家自然科学基金;
关键词
knowledge-data-driven load frequency control; power symmetry; isolated microgrid; deep reinforcement learning; knowledge aggregation; SYSTEM; STRATEGY; DESIGN;
D O I
10.3390/sym16030322
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
To address the issues of instability and inefficiency that the fluctuating and uncertain characteristics of renewable energy sources impose on low-carbon microgrids, this research introduces a novel Knowledge-Data-Driven Load Frequency Control (KDD-LFC) approach. This advanced strategy seamlessly combines pre-existing knowledge frameworks with the capabilities of deep learning neural networks, enabling the adaptive management and multi-faceted optimization of microgrid functionalities, with a keen emphasis on the symmetry and equilibrium of active power. Initially, the process involves the cultivation of foundational knowledge through established methodologies to augment the reservoir of experience. Following this, a Knowledge-Aggregation-based Proximal Policy Optimization (KA-PPO) technique is employed, which proficiently acquires an understanding of the microgrid's state representations and operational tactics. This strategy meticulously navigates the delicate balance between the exploration of new strategies and the exploitation of known efficacies, ensuring the harmonization of frequency stability, precision in tracking, and the optimization of control expenditures through the strategic formulation of the reward function. The empirical validation of the KDD-LFC method's effectiveness and its superiority are demonstrated via simulation tests conducted on the load frequency control (LFC) framework of the Sansha isolated island microgrid, which is under the administration of the China Southern Grid.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Load frequency control in isolated island city microgrids using deep graph reinforcement learning considering extensive scenarios
    He, Ping
    Huang, Xiongwei
    He, Ruobing
    Yuan, Linkun
    [J]. AIP Advances, 2025, 15 (01)
  • [2] A Deep Reinforcement Learning Based Framework for Power System Load Frequency Control
    Zhang, Guanyu
    Teng, Mengjie
    Chen, Chen
    Bie, Zhaohong
    [J]. 2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 1801 - 1805
  • [3] Load Frequency Control: A Deep Multi-Agent Reinforcement Learning Approach
    Rozada, Sergio
    Apostolopoulou, Dimitra
    Alonso, Eduardo
    [J]. 2020 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2020,
  • [4] Bio-inspired distributed load frequency control in Islanded Microgrids: A multi-agent deep reinforcement learning approach
    Li, Jiawen
    Zhou, Tao
    [J]. APPLIED SOFT COMPUTING, 2024, 166
  • [5] Secondary Frequency Control of Microgrids: An Online Reinforcement Learning Approach
    Adibi, Mahya
    van der Woude, Jacob
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (09) : 4824 - 4831
  • [6] Load Frequency Control Strategy of Hybrid Power Generation System: a Deep Reinforcement Learning-Based Approach
    Liang Y.
    Chen L.
    Zhang G.
    Ren M.
    Hu W.
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (07): : 1768 - 1779
  • [7] A Reinforcement Learning Approach for Frequency Control of Inverted-Based Microgrids
    Adibi, Mahya
    van der Woude, Jacob
    [J]. IFAC PAPERSONLINE, 2019, 52 (04): : 111 - 116
  • [8] Data driven frequency control of isolated microgrids based on priority experience replay soft deep reinforcement learning algorithm
    Wu, Zifan
    Lv, Zheng
    Huang, Xiongwei
    Li, Zhen
    [J]. ENERGY REPORTS, 2024, 11 : 2484 - 2492
  • [9] A Multiagent Quantum Deep Reinforcement Learning Method for Distributed Frequency Control of Islanded Microgrids
    Yan, Rudai
    Wang, Yu
    Xu, Yan
    Dai, Jiahong
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2022, 9 (04): : 1622 - 1632
  • [10] Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning
    Chen, Xiaodi
    Zhang, Meng
    Wu, Zhengguang
    Wu, Ligang
    Guan, Xiaohong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (04) : 6825 - 6833