Explainable reinforcement learning for distribution network reconfiguration

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ,2 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB, Canada
[2] Univ Hradec Kralove, Appl Cybernet, Hradec Kralove, Czech Republic
基金
加拿大自然科学与工程研究理事会;
关键词
Distribution network reconfiguration; Reinforcement learning; Deep Q-learning; Data-driven control; Explainable machine learning; DYNAMIC RECONFIGURATION; OPERATION;
D O I
10.1016/j.egyr.2024.05.031
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The lack of transparency in reinforcement learning methods' decision-making process has resulted in a significant lack of trust towards these models, subsequently limiting their utilization in critical decisionmaking applications. The use of reinforcement learning in distribution network reconfiguration is an inherently sensitive application due to the need to change the states of the switches, which can significantly impact the lifespan of the switches. Consequently, executing this process requires meticulous and deliberate consideration. This study presents a new methodology to analyze and elucidate reinforcement learning-based decisions in distribution network reconfiguration. The proposed approach involves the training of an explainer neural network based on the decisions of the reinforcement learning agent. The explainer network receives as input the active and reactive power of the buses at each hour and outputs the line states determined by the agent. To delve deeper into the inner workings of the explainer network, attribution methods are employed. These techniques facilitate the examination of the intricate relationship between the inputs and outputs of the network, offering valuable insights into the agent's decision-making process. The efficacy of this novel approach is demonstrated through its application to both the 33- and 136 -bus test systems, and the obtained results are presented.
引用
收藏
页码:5703 / 5715
页数:13
相关论文
共 50 条
  • [21] A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration
    Si, Ruiqi
    Chen, Siyuan
    Zhang, Jun
    Xu, Jian
    Zhang, Luxi
    APPLIED ENERGY, 2024, 372
  • [22] A Comparative Study of Reinforcement Learning Algorithms for Distribution Network Reconfiguration With Deep Q-Learning-Based Action Sampling
    Gholizadeh, Nastaran
    Kazemi, Nazli
    Musilek, Petr
    IEEE ACCESS, 2023, 11 : 13714 - 13723
  • [23] Reinforcement Learning (RL) to optimal reconfiguration of radial distribution system (RDS)
    Vlachogiannis, JG
    Hatziargyriou, N
    METHODS AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3025 : 439 - 446
  • [24] Dynamic Network Reconfiguration for Entropy Maximization using Deep Reinforcement Learning
    Doorman, Christoffel
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    LEARNING ON GRAPHS CONFERENCE, VOL 198, 2022, 198
  • [25] Reinforcement Learning Enabled Microgrid Network Reconfiguration Under Disruptive Events
    Rahman, Jubeyer
    Jacob, Roshni Anna
    Paul, Steve
    Chowdhury, Souma
    Zhang, Jie
    2022 IEEE KANSAS POWER AND ENERGY CONFERENCE (KPEC 2022), 2022,
  • [26] Explainable Reinforcement Learning for Longitudinal Control
    Liessner, Roman
    Dohmen, Jan
    Wiering, Marco
    ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2021, : 874 - 881
  • [27] Strategic Tasks for Explainable Reinforcement Learning
    Pocius, Rey
    Neal, Lawrence
    Fern, Alan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10007 - 10008
  • [28] A Reinforcement Learning Framework for Explainable Recommendation
    Wang, Xiting
    Chen, Yiru
    Yang, Jie
    Wu, Le
    Wu, Zhengtao
    Xie, Xing
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 587 - 596
  • [29] Explainable Agency in Reinforcement Learning Agents
    Madumal, Prashan
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13724 - 13725
  • [30] Reliability-driven distribution power network dynamic reconfiguration in presence of distributed generation by the deep reinforcement learning method
    Malekshah, Soheil
    Rasouli, Ali
    Malekshah, Yaser
    Ramezani, Afsaneh
    Malekshah, Arezoo
    ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (08) : 6541 - 6556