A deep reinforcement learning approach based energy management strategy for home energy system considering the time-of-use price and real-time control of energy storage system

被引:0
|
作者
Xiong, Shengtao [1 ,2 ]
Liu, Dehong [1 ]
Chen, Yuan [1 ]
Zhang, Yi [1 ]
Cai, Xiaoyan [1 ]
机构
[1] Wuhan City Coll, Wuhan 430083, Hubei, Peoples R China
[2] Wuhan Univ Sci & Technol, Wuhan 430081, Hubei, Peoples R China
关键词
Energy storage system; Home energy management system; Optimal dispatching strategy; Markov decision process; Soft actor -critic; POWER; MODEL;
D O I
10.1016/j.egyr.2024.03.003
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
To enhance the flexibility of the home load optimization dispatching strategy and ensure the safe operation of the energy storage system, an optimization dispatching strategy for home energy management system (HEMS) based on time -of -use pricing and real-time energy storage system control is proposed. Firstly, a HEMS dispatching model is established with the constraints of dispatchable load and energy storage system working status, aiming to minimize the total cost for home users. This dispatching strategy controls the energy storage system charging and discharging behavior based on time -of -use pricing and real-time battery state of charge, which helps to reduce the power cost for home users and ensure the safe operation of the battery. Then, the optimal dispatching problem of HEMS is modeled as a Markov decision process (MDP) and solved by a deep reinforcement learning algorithm called soft actor -critic (SAC). The example results verify the effectiveness and superiority of the proposed method compared with other benchmark methods, which the system cost can be reduced by 15.87% at least.
引用
收藏
页码:3501 / 3508
页数:8
相关论文
共 50 条
  • [1] A deep reinforcement learning approach based energy management strategy for home energy system considering the time-of-use price and real-time control of energy storage system
    Xiong, Shengtao
    Liu, Dehong
    Chen, Yuan
    Zhang, Yi
    Cai, Xiaoyan
    [J]. Energy Reports, 2024, 11 : 3501 - 3508
  • [2] Home energy system optimization based on time-of-use price and real-time control strategy of battery
    Wu, Huicheng
    Wang, Chun
    Zuo, Yuanlong
    Chen, Yujie
    Liu, Kuan
    [J]. Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2019, 47 (19): : 23 - 30
  • [3] Real-time Energy Control Approach for Smart Home Energy Management System
    Zhou, Suyang
    Wu, Zhi
    Li, Jianing
    Zhang, Xiao-Ping
    [J]. ELECTRIC POWER COMPONENTS AND SYSTEMS, 2014, 42 (3-4) : 315 - 326
  • [4] Deep reinforcement learning for real-time economic energy management of microgrid system considering uncertainties
    Liu, Ding
    Zang, Chuanzhi
    Zeng, Peng
    Li, Wanting
    Wang, Xin
    Liu, Yuqi
    Xu, Shuqing
    [J]. FRONTIERS IN ENERGY RESEARCH, 2023, 11
  • [5] Deep Reinforcement Learning for Real-Time Energy Management in Smart Home
    Wei, Guixi
    Chi, Ming
    Liu, Zhi-Wei
    Ge, Mingfeng
    Li, Chaojie
    Liu, Xianggang
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2489 - 2499
  • [6] Real-Time HEV Energy Management Strategy Considering Road Congestion Based on Deep Reinforcement Learning
    Inuzuka, Shota
    Zhang, Bo
    Shen, Tielong
    [J]. ENERGIES, 2021, 14 (17)
  • [7] Real-time energy scheduling for home energy management systems with an energy storage system and electric vehicle based on a supervised-learning-based strategy
    Huy, Truong Hoang Bao
    Dinh, Huy Truong
    Vo, Dieu Ngoc
    Kim, Daehee
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2023, 292
  • [8] Deep Reinforcement Learning Based Approach for Real-Time Dispatch of Integrated Energy System with Hydrogen Energy Utilization
    Han, Yi
    Zhang, Yuxian
    Qiao, Likui
    [J]. 2022 12TH INTERNATIONAL CONFERENCE ON POWER AND ENERGY SYSTEMS, ICPES, 2022, : 972 - 976
  • [9] A Deep Reinforcement Learning Based Approach for Home Energy Management System
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    [J]. 2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,
  • [10] Model predictive control based real-time energy management for hybrid energy storage system
    Chen, Huan
    Xiong, Rui
    Lin, Cheng
    Shen, Weixiang
    [J]. CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2021, 7 (04): : 862 - 874