A novel forecasting based scheduling method for household energy management system based on deep reinforcement learning

被引:34
|
作者
Ren, Mifeng [1 ]
Liu, Xiangfei [1 ]
Yang, Zhile [2 ]
Zhang, Jianhua [3 ]
Guo, Yuanjun [2 ]
Jia, Yanbing [1 ]
机构
[1] Taiyuan Univ Technol, Taiyuan 030024, Shanxi, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Guangdong, Peoples R China
[3] North China Elect Power Univ, Beijing 102206, Peoples R China
关键词
Household energy management system; Deep learning; Reinforcement learning; LSTM; Generalized correntropy; RESIDENTIAL DEMAND RESPONSE; LEVEL; INDEX; GO;
D O I
10.1016/j.scs.2021.103207
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The demand response (DR) strategy enables household users to actively optimize and dispatch the household energy management system (HEMS), which may significantly reduce the cost of user energy consumptions. However, the uncertainty of home users behaviors, the diversity of electrical equipment types, as well as the complexity of the working status of various devices have brought severe challenges to the home energy management system. This article proposes a new forecasting based optimization method to deliver the real-time scheduling considering the future environment trend. A recent proposed dueling based deep reinforcement learning approach is adopted to optimally dispatch the HEMS. In addition, due to the delay of heating, ventilation, and air Conditioning (HVAC) indoor and outdoor temperature data non-Gaussian, a new generalized correntropy assisted long short-term memory (GC-LSTM) neural network is proposed where the generalized correntropy (GC) loss function is adopted to predict the outdoor temperature. The proposed method is verified in a featured HEMS benchmark problem and the experimental results show that the user costs are effectively reduced while the user satisfaction is maintained utilizing the proposed method.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Deep reinforcement learning-based joint load scheduling for household multi-energy system
    Zhao, Liyuan
    Yang, Ting
    Li, Wei
    Zomaya, Albert Y.
    [J]. APPLIED ENERGY, 2022, 324
  • [2] Energy Management System for Microgrids based on Deep Reinforcement Learning
    Garrido, Cesar
    Marin, Luis G.
    Jimenez-Estevez, Guillermo
    Lozano, Fernando
    Higuera, Carolina
    [J]. 2021 IEEE CHILEAN CONFERENCE ON ELECTRICAL, ELECTRONICS ENGINEERING, INFORMATION AND COMMUNICATION TECHNOLOGIES (IEEE CHILECON 2021), 2021, : 609 - 615
  • [3] Dynamic Scheduling Method of Multi-element Energy Storage System Based on Deep Reinforcement Learning
    Liu, Siqu
    Yang, Jie
    Cai, Daomeng
    [J]. 2023 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA, I&CPS ASIA, 2023, : 1770 - 1776
  • [4] A Novel Interval Energy-Forecasting Method for Sustainable Building Management Based on Deep Learning
    Duan, Yun
    [J]. SUSTAINABILITY, 2022, 14 (14)
  • [5] Load Forecasting-Based Learning System for Energy Management With Battery Degradation Estimation: A Deep Reinforcement Learning Approach
    Zhang, Hongtao
    Zhang, Guanglin
    Zhao, Mingbo
    Liu, Yuping
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 2342 - 2352
  • [6] A Deep Reinforcement Learning Based Approach for Home Energy Management System
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    [J]. 2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,
  • [7] Deep Reinforcement Learning based Energy Scheduling for Edge Computing
    Yang, Qinglin
    Li, Peng
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD 2020), 2020, : 175 - 180
  • [8] Reinforcement Learning based scheduling in a workflow management system
    Kintsakis, Athanassios M.
    Psomopoulos, Fotis E.
    Mitkas, Pericles A.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2019, 81 : 94 - 106
  • [9] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
    Lee, Seongwoo
    Seon, Joonho
    Sun, Young Ghyu
    Kim, Soo Hyun
    Kyeong, Chanuk
    Kim, Dong In
    Kim, Jin Young
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
  • [10] Deep learning-based household electric energy consumption forecasting
    Hyeon, Jonghwan
    Lee, HyeYoung
    Ko, Bowon
    Choi, Ho-Jin
    [J]. JOURNAL OF ENGINEERING-JOE, 2020, 2020 (13): : 639 - 642