Real-Time Microgrid Energy Scheduling Using Meta-Reinforcement Learning

被引:0
|
作者
Shen, Huan [1 ]
Shen, Xingfa [1 ]
Chen, Yiming [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou 310018, Peoples R China
关键词
microgrid; energy management; meta-learning; reinforcement learning; online scheduling; RENEWABLE ENERGY; MANAGEMENT; OPERATION;
D O I
10.3390/en17102367
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
With the rapid development of renewable energy and the increasing maturity of energy storage technology, microgrids are quickly becoming popular worldwide. The stochastic scheduling problem of microgrids can increase operational costs and resource wastage. In order to reduce operational costs and optimize resource utilization efficiency, the real-time scheduling of microgrids becomes particularly important. After collecting extensive data, reinforcement learning (RL) can provide good strategies. However, it cannot make quick and rational decisions in different environments. As a method with generalization ability, meta-learning can compensate for this deficiency. Therefore, this paper introduces a microgrid scheduling strategy based on RL and meta-learning. This method can quickly adapt to different environments with a small amount of training data, enabling rapid energy scheduling policy generation in the early stages of microgrid operation. This paper first establishes a microgrid model, including components such as energy storage, load, and distributed generation (DG). Then, we use a meta-reinforcement learning framework to train the initial scheduling strategy, considering the various operational constraints of the microgrid. The experimental results show that the MAML-based RL strategy has advantages in improving energy utilization and reducing operational costs in the early stages of microgrid operation. This research provides a new intelligent solution for microgrids' efficient, stable, and economical operation in their initial stages.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Towards A Robust Meta-Reinforcement Learning-Based Scheduling Framework for Time Critical Tasks in Cloud Environments
    Liu, Hongyun
    Chen, Peng
    Zhao, Zhiming
    [J]. 2021 IEEE 14TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2021), 2021, : 637 - 647
  • [22] Machine Learning Experiments for a Real-Time Energy Management in a Microgrid Cluster
    Rosero-Bernal, David
    Sanabria-Torres, Enrique A.
    Andrade-Rengifo, Fabio
    Diaz, Nelson L.
    Trujillo, Cesar L.
    [J]. IECON 2021 - 47TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2021,
  • [23] Image quality assessment for machine learning tasks using meta-reinforcement learning
    Saeed S.U.
    Fu Y.
    Stavrinides V.
    Baum Z.M.C.
    Yang Q.
    Rusu M.
    Fan R.E.
    Sonn G.A.
    Noble J.A.
    Barratt D.C.
    Hu Y.
    [J]. Medical Image Analysis, 2022, 78
  • [24] Prefrontal cortex as a meta-reinforcement learning system
    Jane X. Wang
    Zeb Kurth-Nelson
    Dharshan Kumaran
    Dhruva Tirumala
    Hubert Soyer
    Joel Z. Leibo
    Demis Hassabis
    Matthew Botvinick
    [J]. Nature Neuroscience, 2018, 21 : 860 - 868
  • [25] Offline Meta-Reinforcement Learning for Industrial Insertion
    Zhao, Tony Z.
    Luo, Jianlan
    Sushkov, Oleg
    Pevceviciute, Rugile
    Heess, Nicolas
    Scholz, Jon
    Schaal, Stefan
    Levine, Sergey
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 6386 - 6393
  • [26] Applying Reinforcement Learning Method for Real-time Energy Management
    Dayani, Aida Borhan
    Fazlollahtabar, Hamed
    Ahmadiahangar, Roya
    Rosin, Argo
    Naderi, Mohammad Salay
    Bagheri, Mehdi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2019 IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2019,
  • [27] Multiagent Meta-Reinforcement Learning for Optimized Task Scheduling in Heterogeneous Edge Computing Systems
    Niu, Liwen
    Chen, Xianfu
    Zhang, Ning
    Zhu, Yongdong
    Yin, Rui
    Wu, Celimuge
    Cao, Yangjie
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (12) : 10519 - 10531
  • [28] Meta-Reinforcement Learning in Nonstationary and Nonparametric Environments
    Bing, Zhenshan
    Knak, Lukas
    Cheng, Long
    Morin, Fabrice O.
    Huang, Kai
    Knoll, Alois
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (10) : 1 - 15
  • [29] Meta-Reinforcement Learning via Language Instructions
    Bing, Zhenshan
    Koch, Alexander
    Yao, Xiangtong
    Huang, Kai
    Knoll, Alois
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 5985 - 5991
  • [30] Offline Meta-Reinforcement Learning with Advantage Weighting
    Mitchell, Eric
    Rafailov, Rafael
    Peng, Xue Bin
    Levine, Sergey
    Finn, Chelsea
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139