An Energy Management System at the Edge based on Reinforcement Learning

被引:8
|
作者
Cicirelli, F. [1 ]
Gentile, A. F. [1 ]
Greco, E. [1 ]
Guerrieri, A. [1 ]
Spezzano, G. [1 ]
Vinci, A. [1 ]
机构
[1] Natl Res Council Italy, Inst High Performance Comp & Networking ICAR, Arcavacata Di Rende, CS, Italy
关键词
Edge Computing; Reinforcement Learning; Energy Management Systems; Internet of Things; Multi-Agent Systems; SMART ENVIRONMENTS; IOT;
D O I
10.1109/ds-rt50469.2020.9213697
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we propose an IoT edge-based energy management system devoted to minimizing the energy cost for the daily-use of in-home appliances. The proposed approach employs a load scheduling based on a load shifting technique, and it is designed to operate in an edge-computing environment naturally. The scheduling considers all together time-variable profiles for energy cost, energy production, and energy consumption for each shiftable appliance. Deadlines for load termination can also be expressed. In order to address these goals, the scheduling problem is formulated as a Markov decision process and then processed through a reinforcement learning technique. The approach is validated by the development of an agent-based real-world test case deployed in an edge context.
引用
收藏
页码:155 / 162
页数:8
相关论文
共 50 条
  • [1] Optimal Management of Energy Storage System Based on Reinforcement Learning
    Liu Jing
    Tang Hao
    Matsui, Masayuki
    Takanokura, Masato
    Zhou Lei
    Gao Xueying
    [J]. 2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 8216 - 8221
  • [2] Reinforcement Learning Based Integrated Energy System Management: A Survey
    Xiong, Luo-Lin
    Mao, Shuai
    Tang, Yang
    Meng, Ke
    Dong, Zhao-Yang
    Qian, Feng
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (10): : 2321 - 2340
  • [3] Energy Management System for Microgrids based on Deep Reinforcement Learning
    Garrido, Cesar
    Marin, Luis G.
    Jimenez-Estevez, Guillermo
    Lozano, Fernando
    Higuera, Carolina
    [J]. 2021 IEEE CHILEAN CONFERENCE ON ELECTRICAL, ELECTRONICS ENGINEERING, INFORMATION AND COMMUNICATION TECHNOLOGIES (IEEE CHILECON 2021), 2021, : 609 - 615
  • [4] Reinforcement Learning-Based School Energy Management System
    Chemingui, Yassine
    Gastli, Adel
    Ellabban, Omar
    [J]. ENERGIES, 2020, 13 (23)
  • [5] Implementation of home energy management system based on reinforcement learning
    Ul Haq, Ejaz
    Lyu, Cheng
    Xie, Peng
    Yan, Shuo
    Ahmad, Fiaz
    Jia, Youwei
    [J]. ENERGY REPORTS, 2022, 8 : 560 - 566
  • [6] An Energy Management Strategy for Hybrid Energy Storage System Based on Reinforcement Learning
    Wang, Yujie
    Li, Wenhuan
    Liu, Zeyan
    Li, Ling
    [J]. WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (03):
  • [7] Reinforcement Learning-Based Home Energy Management System for Resiliency
    Raman, Naren Srivaths
    Gaikwad, Ninad
    Barooah, Prabir
    Meyn, Sean P.
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1358 - 1364
  • [8] A Deep Reinforcement Learning Based Approach for Home Energy Management System
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    [J]. 2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,
  • [9] A Reinforcement Learning based Energy Management System for a PV and Battery Connected Microgrid System
    Kosuru, Rahul
    Liu, Shichao
    Chaoui, Hicham
    [J]. PROCEEDINGS OF 2021 IEEE 30TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2021,
  • [10] Deep Reinforcement Learning based Energy Scheduling for Edge Computing
    Yang, Qinglin
    Li, Peng
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD 2020), 2020, : 175 - 180