Methodology for Interpretable Reinforcement Learning Model for HVAC Energy Control

被引:5
|
作者
Kotevska, Olivera [1 ]
Munk, Jeffrey [2 ]
Kurte, Kuldeep [3 ]
Du, Yan [4 ]
Amasyali, Kadir [3 ]
Smith, Robert W. [1 ]
Zandi, Helia [3 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math, POB 2009, Oak Ridge, TN 37830 USA
[2] Oak Ridge Natl Lab, Energy & Transportat Sci, Oak Ridge, TN USA
[3] Oak Ridge Natl Lab, Computat Sci & Engn, Oak Ridge, TN USA
[4] Univ Tennessee, Elect Engn & Comp Sci, Knoxville, TN USA
关键词
reinforcement learning; decision making; interpretability; optimization; deep learning; machine learning; demand response; BUILDING ENERGY;
D O I
10.1109/BigData50022.2020.9377735
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep reinforcement learning (DRL) approaches have been used in various application areas to improve efficiency, optimization, or automation. However, very little is known about how the DRL algorithms make decisions and what features affect their performance. Using a case study of a DRL based Heating, Ventilation and Air Conditioning (HVAC) optimization methodology, we demonstrate how we can address these challenges by applying interpretability tools and systematically exploring the model inputs for better understanding the DRL behaviour and decision making process. We developed a methodology for interpretable reinforcement learning and evaluated our approach in real-world house located in Knoxville, TN. Our findings explain the reasoning behind DRL-based optimization decisions under different circumstances which has been discussed and confirmed by the experts in the field.
引用
收藏
页码:1555 / 1564
页数:10
相关论文
共 50 条
  • [41] Reinforcement Learning for Building Energy Optimization Through Controlling of Central HVAC System
    Hao, Jun
    Gao, David Wenzhong
    Zhang, Jun Jason
    [J]. IEEE OPEN ACCESS JOURNAL OF POWER AND ENERGY, 2020, 7 : 320 - 328
  • [42] Using reinforcement learning to optimize occupant comfort and energy usage in HVAC systems
    Fazenda, Pedro
    Veeramachaneni, Kalyan
    Lima, Pedro
    O'Reilly, Una-May
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND SMART ENVIRONMENTS, 2014, 6 (06) : 675 - 690
  • [43] Building Energy Management With Reinforcement Learning and Model Predictive Control: A Survey
    Zhang, Huiliang
    Seal, Sayani
    Wu, Di
    Bouffard, Francois
    Boulet, Benoit
    [J]. IEEE ACCESS, 2022, 10 : 27853 - 27862
  • [44] Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings
    Yu, Liang
    Sun, Yi
    Xu, Zhanbo
    Shen, Chao
    Yue, Dong
    Jiang, Tao
    Guan, Xiaohong
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (01) : 407 - 419
  • [45] Optimal control of HVAC and window systems for natural ventilation through reinforcement learning
    Chen, Yujiao
    Norford, Leslie K.
    Samuelson, Holly W.
    Malkawi, Ali
    [J]. ENERGY AND BUILDINGS, 2018, 169 : 195 - 205
  • [46] Deep Reinforcement Learning based HVAC Control for Reducing Carbon Footprint of Buildings
    Kurte, Kuldeep
    Amasyali, Kadir
    Munk, Jeffrey
    Zandi, Helia
    [J]. 2023 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE, ISGT, 2023,
  • [47] Accelerate Online Reinforcement Learning for Building HVAC Control with Heterogeneous Expert Guidances
    Xu, Shichao
    Fu, Yangyang
    Wang, Yixuan
    Yang, Zhuoran
    O'Neill, Zheng
    Wang, Zhaoran
    Zhu, Qi
    [J]. PROCEEDINGS OF THE 2022 THE 9TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILDINGS, CITIES, AND TRANSPORTATION, BUILDSYS 2022, 2022, : 89 - 98
  • [48] Tunnel ventilation control using reinforcement learning methodology
    Chu, Baeksuk
    Kim, Dongnam
    Hong, Daehie
    Park, Jooyoung
    Chung, Jin Taek
    Kim, Tae-Hyung
    [J]. JSME INTERNATIONAL JOURNAL SERIES C-MECHANICAL SYSTEMS MACHINE ELEMENTS AND MANUFACTURING, 2006, 49 (04) : 1003 - 1010
  • [49] Modelling building HVAC control strategies using a deep reinforcement learning approach
    Nguyen, Anh Tuan
    Pham, Duy Hoang
    Oo, Bee Lan
    Santamouris, Mattheos
    Ahn, Yonghan
    Lim, Benson T. H.
    [J]. ENERGY AND BUILDINGS, 2024, 310
  • [50] Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning
    Xie, Yuansheng
    Vosoughi, Soroush
    Hassanpour, Saeed
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 5067 - 5074