Reward Mechanism Design for Deep Reinforcement Learning-Based Microgrid Energy Management

被引:0
|
作者
Hu, Mingjie [1 ]
Han, Baohui [2 ]
Lv, Shilin [3 ]
Bao, Zhejing [2 ]
Lu, Lingxia [2 ]
Yu, Miao [2 ]
机构
[1] Zhejiang Univ, Polytech Inst, Hangzhou, Peoples R China
[2] Zhejiang Univ, Coll Elect Engn, Hangzhou, Peoples R China
[3] State Grid Zhejiang Elect Power Co Ltd, Hangzhou, Peoples R China
关键词
deep reinforcement learning; microgrid energy management; reward mechanism; cliff walking pattern; Leduc poker pattern;
D O I
10.1109/REPE59476.2023.10512009
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Deep Reinforcement Learning (DRL), with its data-driven nature and model-free advantage, has attracted great interest in the field of microgrid energy management system. The choice of reward mechanism plays a crucial role in the performance and effectiveness of DRL-based microgrid energy management. This paper aims to investigate the reward mechanism design by comparing the performances of DRL-based microgrid energy management under two different reward mechanisms, namely, cliff walking pattern and Leduc poker pattern. The reward mechanism incorporates auxiliary rewards alongside the primary reward to harmonize diverse objectives. Using a real microgrid dataset, the performance of DRL agents under different reward mechanisms are compared. The experimental results demonstrate that different reward mechanisms have a significant impact on the convergence speed and generalization ability of trained microgrid energy management policy.
引用
收藏
页码:201 / 205
页数:5
相关论文
共 50 条
  • [21] Deep Reinforcement Learning Based Double-layer Optimization Method for Energy Management of Microgrid
    Yu, Qinglei
    Xu, Wei
    Lv, Jianhu
    Wang, Ying
    Zhang, Kaifeng
    [J]. 2023 5TH ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM, AEEES, 2023, : 1016 - 1022
  • [22] A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems
    Bao, Gang
    Xu, Rui
    [J]. COGNITIVE COMPUTATION, 2023, 15 (02) : 739 - 750
  • [23] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    [J]. International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [24] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    [J]. INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [25] A novel deep learning-based forecasting model optimized by heuristic algorithm for energy management of microgrid
    Kim, H. J.
    Kim, M. K.
    [J]. APPLIED ENERGY, 2023, 332
  • [26] Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types
    Shaqour, Ayas
    Hagishima, Aya
    [J]. ENERGIES, 2022, 15 (22)
  • [27] Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles
    Li, Weihan
    Cui, Han
    Nemeth, Thomas
    Jansen, Jonathan
    Uenluebayir, Cem
    Wei, Zhongbao
    Zhang, Lei
    Wang, Zhenpo
    Ruan, Jiageng
    Dai, Haifeng
    Wei, Xuezhe
    Sauer, Dirk Uwe
    [J]. JOURNAL OF ENERGY STORAGE, 2021, 36
  • [28] Reinforcement Learning-Based School Energy Management System
    Chemingui, Yassine
    Gastli, Adel
    Ellabban, Omar
    [J]. ENERGIES, 2020, 13 (23)
  • [29] Deep Reinforcement Learning Algorithm Based on Optimal Energy Dispatching for Microgrid
    Bian, Haifeng
    Tian, Xin
    Zhang, Jun
    Han, Xinyang
    [J]. 2020 5TH ASIA CONFERENCE ON POWER AND ELECTRICAL ENGINEERING (ACPEE 2020), 2020, : 169 - 174
  • [30] Energy Optimization Management of Multi-microgrid using Deep Reinforcement Learning
    Zhang, Tingjun
    Yue, Dong
    Zhao, Nan
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4049 - 4053