Real-Time Microgrid Energy Scheduling Using Meta-Reinforcement Learning

被引:0
|
作者
Shen, Huan [1 ]
Shen, Xingfa [1 ]
Chen, Yiming [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou 310018, Peoples R China
关键词
microgrid; energy management; meta-learning; reinforcement learning; online scheduling; RENEWABLE ENERGY; MANAGEMENT; OPERATION;
D O I
10.3390/en17102367
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
With the rapid development of renewable energy and the increasing maturity of energy storage technology, microgrids are quickly becoming popular worldwide. The stochastic scheduling problem of microgrids can increase operational costs and resource wastage. In order to reduce operational costs and optimize resource utilization efficiency, the real-time scheduling of microgrids becomes particularly important. After collecting extensive data, reinforcement learning (RL) can provide good strategies. However, it cannot make quick and rational decisions in different environments. As a method with generalization ability, meta-learning can compensate for this deficiency. Therefore, this paper introduces a microgrid scheduling strategy based on RL and meta-learning. This method can quickly adapt to different environments with a small amount of training data, enabling rapid energy scheduling policy generation in the early stages of microgrid operation. This paper first establishes a microgrid model, including components such as energy storage, load, and distributed generation (DG). Then, we use a meta-reinforcement learning framework to train the initial scheduling strategy, considering the various operational constraints of the microgrid. The experimental results show that the MAML-based RL strategy has advantages in improving energy utilization and reducing operational costs in the early stages of microgrid operation. This research provides a new intelligent solution for microgrids' efficient, stable, and economical operation in their initial stages.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Real-time Energy Management of Microgrid Using Reinforcement Learning
    Bi, Wenzheng
    Shu, Yuankai
    Dong, Wei
    Yang, Qiang
    [J]. 2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 38 - 41
  • [2] Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning
    Ji, Ying
    Wang, Jianhui
    Xu, Jiacan
    Fang, Xiaoke
    Zhang, Huaguang
    [J]. ENERGIES, 2019, 12 (12)
  • [3] Real-time optimal scheduling for microgrid systems based on distributed deep reinforcement learning
    Guo, Fang-Hong
    He, Tong
    Wu, Xiang
    Dong, Hui
    Liu, Bing
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2022, 39 (10): : 1881 - 1889
  • [4] Meta-Reinforcement Learning-Based Transferable Scheduling Strategy for Energy Management
    Xiong, Luolin
    Tang, Yang
    Liu, Chensheng
    Mao, Shuai
    Meng, Ke
    Dong, Zhaoyang
    Qian, Feng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (04) : 1685 - 1695
  • [5] Real-time Scheduling using Reinforcement Learning Technique for the Connected Vehicles
    Park, Seongjin
    Yoo, Younghwan
    [J]. 2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [6] Optimal real-time scheduling of battery operation using reinforcement learning
    Juarez, Carolina Quiroz
    Musilek, Petr
    [J]. 2021 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2021,
  • [7] Real-time scheduling for a smart factory using a reinforcement learning approach
    Shiue, Yeou-Ren
    Lee, Ken-Chuan
    Su, Chao-Ton
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2018, 125 : 604 - 614
  • [8] Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning
    Guo, Chenyu
    Wang, Xin
    Zheng, Yihui
    Zhang, Feng
    [J]. ENERGY, 2022, 238
  • [9] Real-time scheduling of community microgrid
    Rana, Md Juel
    Zaman, Forhad
    Ray, Tapabrata
    Sarker, Ruhul
    [J]. JOURNAL OF CLEANER PRODUCTION, 2021, 286
  • [10] Deep reinforcement learning for real-time economic energy management of microgrid system considering uncertainties
    Liu, Ding
    Zang, Chuanzhi
    Zeng, Peng
    Li, Wanting
    Wang, Xin
    Liu, Yuqi
    Xu, Shuqing
    [J]. FRONTIERS IN ENERGY RESEARCH, 2023, 11