Methodology for Interpretable Reinforcement Learning Model for HVAC Energy Control

被引:5
|
作者
Kotevska, Olivera [1 ]
Munk, Jeffrey [2 ]
Kurte, Kuldeep [3 ]
Du, Yan [4 ]
Amasyali, Kadir [3 ]
Smith, Robert W. [1 ]
Zandi, Helia [3 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math, POB 2009, Oak Ridge, TN 37830 USA
[2] Oak Ridge Natl Lab, Energy & Transportat Sci, Oak Ridge, TN USA
[3] Oak Ridge Natl Lab, Computat Sci & Engn, Oak Ridge, TN USA
[4] Univ Tennessee, Elect Engn & Comp Sci, Knoxville, TN USA
关键词
reinforcement learning; decision making; interpretability; optimization; deep learning; machine learning; demand response; BUILDING ENERGY;
D O I
10.1109/BigData50022.2020.9377735
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep reinforcement learning (DRL) approaches have been used in various application areas to improve efficiency, optimization, or automation. However, very little is known about how the DRL algorithms make decisions and what features affect their performance. Using a case study of a DRL based Heating, Ventilation and Air Conditioning (HVAC) optimization methodology, we demonstrate how we can address these challenges by applying interpretability tools and systematically exploring the model inputs for better understanding the DRL behaviour and decision making process. We developed a methodology for interpretable reinforcement learning and evaluated our approach in real-world house located in Knoxville, TN. Our findings explain the reasoning behind DRL-based optimization decisions under different circumstances which has been discussed and confirmed by the experts in the field.
引用
收藏
页码:1555 / 1564
页数:10
相关论文
共 50 条
  • [1] Energy Management Model for HVAC Control Supported by Reinforcement Learning
    Macieira, Pedro
    Gomes, Luis
    Vale, Zita
    [J]. ENERGIES, 2021, 14 (24)
  • [2] Interpretable Control by Reinforcement Learning
    Hein, Daniel
    Limmer, Steffen
    Runkler, Thomas A.
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 8082 - 8089
  • [3] A DEEP REINFORCEMENT LEARNING APPROACH TO USING WHOLE BUILDING ENERGY MODEL FOR HVAC OPTIMAL CONTROL
    Zhang, Zhiang
    Chong, Adrian
    Pan, Yuqi
    Zhang, Chenlu
    Lu, Siliang
    Lam, Khee Poh
    [J]. 2018 BUILDING PERFORMANCE ANALYSIS CONFERENCE AND SIMBUILD, 2018, : 675 - 682
  • [4] An Hybrid Model-Free Reinforcement Learning Approach for HVAC Control
    Solinas, Francesco M.
    Bellagarda, Andrea
    Macii, Enrico
    Patti, Edoardo
    Bottaccioli, Lorenzo
    [J]. 2021 21ST IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2021 5TH IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC/I&CPS EUROPE), 2021,
  • [5] Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning
    Zhang, Zhiang
    Chong, Adrian
    Pan, Yuqi
    Zhang, Chenlu
    Lam, Khee Poh
    [J]. ENERGY AND BUILDINGS, 2019, 199 : 472 - 490
  • [6] Autonomous HVAC Control, A Reinforcement Learning Approach
    Barrett, Enda
    Linder, Stephen
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT III, 2015, 9286 : 3 - 19
  • [7] An online reinforcement learning approach for HVAC control
    Solinas, Francesco M.
    Macii, Alberto
    Patti, Edoardo
    Bottaccioli, Lorenzo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [8] Reinforcement Learning for Control of Building HVAC Systems
    Raman, Naren Srivaths
    Devraj, Adithya M.
    Barooah, Prabir
    Meyn, Sean P.
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2326 - 2332
  • [9] Deep Reinforcement Learning for Building HVAC Control
    Wei, Tianshu
    Wang, Yanzhi
    Zhu, Qi
    [J]. PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [10] Building HVAC control with reinforcement learning for reduction of energy cost and demand charge
    Jiang, Zhanhong
    Risbeck, Michael J.
    Ramamurti, Vish
    Murugesan, Sugumar
    Amores, Jaume
    Zhang, Chenlu
    Lee, Young M.
    Drees, Kirk H.
    [J]. ENERGY AND BUILDINGS, 2021, 239