Real-Time Microgrid Energy Scheduling Using Meta-Reinforcement Learning

被引:0
|
作者
Shen, Huan [1 ]
Shen, Xingfa [1 ]
Chen, Yiming [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou 310018, Peoples R China
关键词
microgrid; energy management; meta-learning; reinforcement learning; online scheduling; RENEWABLE ENERGY; MANAGEMENT; OPERATION;
D O I
10.3390/en17102367
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
With the rapid development of renewable energy and the increasing maturity of energy storage technology, microgrids are quickly becoming popular worldwide. The stochastic scheduling problem of microgrids can increase operational costs and resource wastage. In order to reduce operational costs and optimize resource utilization efficiency, the real-time scheduling of microgrids becomes particularly important. After collecting extensive data, reinforcement learning (RL) can provide good strategies. However, it cannot make quick and rational decisions in different environments. As a method with generalization ability, meta-learning can compensate for this deficiency. Therefore, this paper introduces a microgrid scheduling strategy based on RL and meta-learning. This method can quickly adapt to different environments with a small amount of training data, enabling rapid energy scheduling policy generation in the early stages of microgrid operation. This paper first establishes a microgrid model, including components such as energy storage, load, and distributed generation (DG). Then, we use a meta-reinforcement learning framework to train the initial scheduling strategy, considering the various operational constraints of the microgrid. The experimental results show that the MAML-based RL strategy has advantages in improving energy utilization and reducing operational costs in the early stages of microgrid operation. This research provides a new intelligent solution for microgrids' efficient, stable, and economical operation in their initial stages.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Prefrontal cortex as a meta-reinforcement learning system
    Wang, Jane X.
    Kurth-Nelson, Zeb
    Kumaran, Dharshan
    Tirumala, Dhruva
    Soyer, Hubert
    Leibo, Joel Z.
    Hassabis, Demis
    Botvinick, Matthew
    [J]. NATURE NEUROSCIENCE, 2018, 21 (06) : 860 - +
  • [42] Reinforcement Learning for Multi-Hop Scheduling and Routing of Real-Time Flows
    HasanzadeZonuzy, Aria
    Kalathil, Dileep
    Shakkottai, Srinivas
    [J]. 2020 18TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), 2020,
  • [43] A Study on Real-time Scheduling for Holonic Manufacturing Systems - Application of Reinforcement Learning
    Iwamura, Koji
    Mayumi, Norihisa
    Tanimizu, Yoshitaka
    Sugimura, Nobuhiro
    [J]. SERVICE ROBOTICS AND MECHATRONICS, 2010, : 201 - 204
  • [44] Enhanced real-time scheduling algorithm for energy management in a renewable-integrated microgrid
    Shotorbani, Amin Mohammadpour
    Zeinal-Kheiri, Sevda
    Chhipi-Shrestha, Gyan
    Mohammadi-Ivatloo, Behnam
    Sadiq, Rehan
    Hewage, Kasun
    [J]. APPLIED ENERGY, 2021, 304
  • [45] Reinforcement Learning for Real-Time Pricing and Scheduling Control in EV Charging Stations
    Wang, Shuoyao
    Bi, Suzhi
    Zhang, Yingjun Angela
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) : 849 - 859
  • [46] Application of Deep Reinforcement Learning in Real-time Plan Scheduling of Power Grid
    Liu, Jinbo
    Song, Xuri
    Yang, Nan
    Wan, Xiong
    Cai, Yu
    Huang, Yupeng
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (14): : 157 - 166
  • [47] Rollout strategies for real-time multi-energy scheduling in microgrid with storage system
    Lan, Yu
    Guan, Xiaohong
    Wu, Jiang
    [J]. IET GENERATION TRANSMISSION & DISTRIBUTION, 2016, 10 (03) : 688 - 696
  • [48] Benchmarking Real-Time Reinforcement Learning
    Thodoroff, Pierre
    Li, Wenyu
    Lawrence, Neil D.
    [J]. NEURIPS 2021 WORKSHOP ON PRE-REGISTRATION IN MACHINE LEARNING, VOL 181, 2021, 181 : 26 - 41
  • [49] Real-time scheduling for dynamic workshops with random new job insertions by using deep reinforcement learning
    Sun, Z. Y.
    Han, W. M.
    Gao, L. L.
    [J]. ADVANCES IN PRODUCTION ENGINEERING & MANAGEMENT, 2023, 18 (02): : 137 - 151
  • [50] Cost-aware real-time job scheduling for hybrid cloud using deep reinforcement learning
    Long Cheng
    Archana Kalapgar
    Amogh Jain
    Yue Wang
    Yongtai Qin
    Yuancheng Li
    Cong Liu
    [J]. Neural Computing and Applications, 2022, 34 : 18579 - 18593