Reinforcement Learning for Building Energy Optimization Through Controlling of Central HVAC System

被引:16
|
作者
Hao, Jun [1 ]
Gao, David Wenzhong [1 ]
Zhang, Jun Jason [2 ]
机构
[1] Univ Denver, Dept Elect & Comp Engn, Denver, CO 80210 USA
[2] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
基金
美国国家科学基金会;
关键词
Game theory; reinforcement learning; multi-agent system; HVAC control; cost minimization;
D O I
10.1109/OAJPE.2020.3023916
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper presents a novel methodology to control HVAC system and minimize energy cost on the premise of satisfying power system constraints. A multi-agent architecture based on game theory and reinforcement learning is developed so as to reduce the cost and computational complexity of the microgrid. The multi-agent architecture comprising agents, state variables, action variables, reward function and cost game is formulated. The paper fills the gap between multi-agent HVAC systems control and power system optimization and planning. The results and analysis indicate that the proposed algorithm is beneficial to deal with the problem of "curse of dimensionality" for multi-agent microgrid HVAC system control and speed up learning of unknown power system conditions.
引用
收藏
页码:320 / 328
页数:9
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Energy Cost Optimization in Building HVAC Systems
    Jiang, Zhanhong
    Risbeck, Michael J.
    Ramamurti, Vish
    Murugesan, Sugumar
    Amores, Jaume
    Lee, Young M.
    Drees, Kirk H.
    [J]. ASHRAE TRANSACTIONS 2021, VOL 127, PT 1, 2021, 127 : 38 - 47
  • [2] Study on the application of reinforcement learning in the operation optimization of HVAC system
    Xiaolei Yuan
    Yiqun Pan
    Jianrong Yang
    Weitong Wang
    Zhizhong Huang
    [J]. Building Simulation, 2021, 14 : 75 - 87
  • [3] Study on the application of reinforcement learning in the operation optimization of HVAC system
    Yuan, Xiaolei
    Pan, Yiqun
    Yang, Jianrong
    Wang, Weitong
    Huang, Zhizhong
    [J]. BUILDING SIMULATION, 2021, 14 (01) : 75 - 87
  • [4] Reinforcement Learning for Control of Building HVAC Systems
    Raman, Naren Srivaths
    Devraj, Adithya M.
    Barooah, Prabir
    Meyn, Sean P.
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2326 - 2332
  • [5] Deep Reinforcement Learning for Building HVAC Control
    Wei, Tianshu
    Wang, Yanzhi
    Zhu, Qi
    [J]. PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [6] Building HVAC control with reinforcement learning for reduction of energy cost and demand charge
    Jiang, Zhanhong
    Risbeck, Michael J.
    Ramamurti, Vish
    Murugesan, Sugumar
    Amores, Jaume
    Zhang, Chenlu
    Lee, Young M.
    Drees, Kirk H.
    [J]. ENERGY AND BUILDINGS, 2021, 239
  • [7] Comparison of reinforcement learning and model predictive control for building energy system optimization
    Wang, Dan
    Zheng, Wanfu
    Wang, Zhe
    Wang, Yaran
    Pang, Xiufeng
    Wang, Wei
    [J]. APPLIED THERMAL ENGINEERING, 2023, 228
  • [8] Reinforcement Learning Control for HVAC Energy Management System with Instant Operation by Selecting Virtual Building with Similar Environment
    Aoki, Yoshifumi
    Takahashi, Yusuke
    Ninagawa, Chuzo
    Morikawa, Junji
    [J]. IEEJ Transactions on Industry Applications, 2023, 143 (01) : 27 - 34
  • [9] Review on HVAC System Optimization Towards Energy Saving Building Operation
    Selamat, Hazlina
    Haniff, Mohamad Fadzli
    Sharif, Zainon Mat
    Attaran, Seyed Mohammad
    Sakri, Fadhilah Mohd
    Razak, Muhammad Al'Hapis Bin Abdul
    [J]. INTERNATIONAL ENERGY JOURNAL, 2020, 20 (03): : 345 - 357
  • [10] Multi-agent deep reinforcement learning optimization framework for building energy system with renewable energy
    Shen, Rendong
    Zhong, Shengyuan
    Wen, Xin
    An, Qingsong
    Zheng, Ruifan
    Li, Yang
    Zhao, Jun
    [J]. APPLIED ENERGY, 2022, 312