Reinforcement Learning Based Energy Management Algorithm for Energy Trading and Contingency Reserve Application in a Microgrid

被引：0

作者：

Hau, ChongAih ^{[1
]}

Radhakrishnan, Krishnanand Kaippilly ^{[2
]}

Siu, JunYen ^{[1
]}

Panda, Sanjib Kumar ^{[1
]}

机构：

[1] Natl Univ Singapore, Elect & Comp Engn Dept, Singapore, Singapore

[2] Berkeley Educ Alliance Res Singapore, SinBerBEST, Singapore, Singapore

来源：

2020 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES EUROPE (ISGT-EUROPE 2020): SMART GRIDS: KEY ENABLERS OF A GREEN POWER SYSTEM | 2020年

基金：

新加坡国家研究基金会;

关键词：

Microgrid; energy management; dynamic pricing; contingency reserve; model-free reinforcement learning;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

This paper presents automation of energy trading using a value-based reinforcement learning and Deep-Q-Network based energy management algorithm for microgrid participants having energy storage systems, while maintaining required contingency reserves for the microgrid. A piecewise utility function is designed to form the trading strategies in response to the dynamic environment. By adjusting parameters of the utility function, two different behaviors of the microgrid operator, namely risk-seeking and risk-averse, are studied to analyze the impact on the energy storage's operation decision. The simulation results show that the proposed algorithm manages the storage optimally and outperforms rule-based algorithm, providing higher monetary benefits and better flexibility during an extreme scenario having highly dynamic pricing.

引用

页码：1005 / 1009

页数：5

共 50 条

[1] Reinforcement Learning Based Optimal Energy Management of A Microgrid
Iqbal, Saqib
Mehran, Kamyar
[J]. 2022 IEEE ENERGY CONVERSION CONGRESS AND EXPOSITION (ECCE), 2022,
[2] Reinforcement learning for microgrid energy management
Kuznetsova, Elizaveta
Li, Yan-Fu
Ruiz, Carlos
Zio, Enrico
Ault, Graham
Bell, Keith
[J]. ENERGY, 2013, 59 : 133 - 146
[3] Deep Reinforcement Learning Algorithm Based on Optimal Energy Dispatching for Microgrid
Bian, Haifeng
Tian, Xin
Zhang, Jun
Han, Xinyang
[J]. 2020 5TH ASIA CONFERENCE ON POWER AND ELECTRICAL ENGINEERING (ACPEE 2020), 2020, : 169 - 174
[4] Reinforcement Learning-Based Microgrid Energy Trading With a Reduced Power Plant Schedule
Lu, Xiaozhen
Xiao, Xingyu
Xiao, Liang
Dai, Canhuang
Peng, Mugen
Poor, H. Vincent
[J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06) : 10728 - 10737
[5] Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings
Kim, Sunyong
Lim, Hyuk
[J]. ENERGIES, 2018, 11 (08):
[6] Online Microgrid Energy Management Based on Safe Deep Reinforcement Learning
Li, Hepeng
Wang, Zhenhua
Li, Lusi
He, Haibo
[J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
[7] Energy Management in Solar Microgrid via Reinforcement Learning
Kofinas, Panagiotis
Vouros, George
Dounis, Anastasios I.
[J]. 9TH HELLENIC CONFERENCE ON ARTIFICIAL INTELLIGENCE (SETN 2016), 2016,
[8] Energy Management and Trading in a Smart Microgrid
Longe, O. M.
Ouahada, K.
[J]. 2018 IEEE 7TH INTERNATIONAL CONFERENCE ON ADAPTIVE SCIENCE & TECHNOLOGY (IEEE ICAST), 2018,
[9] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
Lee, Seongwoo
Seon, Joonho
Sun, Young Ghyu
Kim, Soo Hyun
Kyeong, Chanuk
Kim, Dong In
Kim, Jin Young
[J]. IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
[10] Reinforcement Learning-Based Energy Trading and Management of Regional Interconnected Microgrids
Liu, Shuai
Han, Siyuan
Zhu, Shanying
[J]. IEEE TRANSACTIONS ON SMART GRID, 2023, 14 (03) : 2047 - 2059

← 1 2 3 4 5 →