A two-layer energy management for islanded microgrid based on inverse reinforcement learning and distributed ADMM

被引:0
|
作者
Huang L. [1 ]
Sun W. [1 ]
Li Q. [1 ]
Mu D. [1 ]
Li W. [1 ]
机构
[1] Hefei University of Technology, Tunxi Rd. 193, Hefei
基金
中国国家自然科学基金;
关键词
Distributed algorithms; Energy management; Islanded microgrid; Optimization methods; Reinforcement learning;
D O I
10.1016/j.energy.2024.131672
中图分类号
学科分类号
摘要
The development of a scheduling strategy for an islanded microgrid (IMG) is critical for ensuring the system's stability and economic efficiency. Traditional scheduling strategies for IMGs predominantly utilize centralized management by the microgrid central controller (MGCC), which introduces a vulnerability to a single point of failure. To address this limitation, this paper presents a two-layer energy management strategy for IMGs based on the improved alternating direction method of multipliers (ADMM) and inverse reinforcement learning (IRL). First, the framework of the proposed strategy, comprising a scheduling layer and a real-time dispatch layer, is outlined. Next, the problem formulation of the scheduling layer is analyzed, and the proposed IRL-based management strategy for the energy storage system (ESS) is presented. Then, a distributed optimization algorithm based on the improved ADMM is proposed for the management of controllable distributed generators (CDGs) in the real-time dispatch layer. Lastly, the case study demonstrates the efficacy of the proposed strategy in diminishing MGCC dependency. The comparative analysis indicates that the proposed strategy outperforms existing scheduling strategies in terms of cost-effectiveness when the forecast error exceeds 3%. Moreover, in contrast to existing scheduling strategies, the proposed strategy mitigates the risk associated with a single point of failure. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [31] A reinforcement learning method for two-layer shipboard real-time energy management considering battery state estimation
    Zhang, Huayue
    Wen, Shuli
    Gu, Mingchang
    Zhu, Miao
    Ye, Huili
    IET ENERGY SYSTEMS INTEGRATION, 2024,
  • [32] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
    Lee, Seongwoo
    Seon, Joonho
    Sun, Young Ghyu
    Kim, Soo Hyun
    Kyeong, Chanuk
    Kim, Dong In
    Kim, Jin Young
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
  • [33] Energy management of hybrid electric vehicles based on inverse reinforcement learning
    Lv, Hengxu
    Qi, Chunyang
    Song, Chuanxue
    Song, Shixin
    Zhang, Ruiqiang
    Xiao, Feng
    ENERGY REPORTS, 2022, 8 : 5215 - 5224
  • [34] Adaptive Consensus Algorithm for Distributed Heat-Electricity Energy Management of an Islanded Microgrid
    Dong, Xiaofeng
    Zhang, Xiaoshun
    Jiang, Tong
    ENERGIES, 2018, 11 (09)
  • [35] An Efficient Distributed Reinforcement Learning for Enhanced Multi-Microgrid Management
    Das, Avijit
    Ni, Zhen
    Wu, Di
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [36] Reinforcement Learning Based Energy Management Algorithm for Energy Trading and Contingency Reserve Application in a Microgrid
    Hau, ChongAih
    Radhakrishnan, Krishnanand Kaippilly
    Siu, JunYen
    Panda, Sanjib Kumar
    2020 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES EUROPE (ISGT-EUROPE 2020): SMART GRIDS: KEY ENABLERS OF A GREEN POWER SYSTEM, 2020, : 1005 - 1009
  • [37] Benchmarking Reinforcement Learning Algorithms on Island Microgrid Energy Management
    Zhang, Siyue
    Nandakumar, Srinivasan
    Pan, Quanbiao
    Yang, Ezekiel
    Migne, Romain
    Subramanian, Lalitha
    2021 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT ASIA), 2021,
  • [38] Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market
    Fang, Xiaohan
    Zhao, Qiang
    Wang, Jinkuan
    Han, Yinghua
    Li, Yuchun
    SUSTAINABLE CITIES AND SOCIETY, 2021, 74
  • [39] Battery Energy Management in a Microgrid Using Batch Reinforcement Learning
    Mbuwir, Brida V.
    Ruelens, Frederik
    Spiessens, Fred
    Deconinck, Geert
    ENERGIES, 2017, 10 (11):
  • [40] Bidding Strategy of Two-Layer Optimization Model for Electricity Market Considering Renewable Energy Based on Deep Reinforcement Learning
    Ji, Xiu
    Li, Cong
    Li, Dexin
    Qi, Chenglong
    ELECTRONICS, 2022, 11 (19)