Explainable reinforcement learning for distribution network reconfiguration

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ,2 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB, Canada
[2] Univ Hradec Kralove, Appl Cybernet, Hradec Kralove, Czech Republic
基金
加拿大自然科学与工程研究理事会;
关键词
Distribution network reconfiguration; Reinforcement learning; Deep Q-learning; Data-driven control; Explainable machine learning; DYNAMIC RECONFIGURATION; OPERATION;
D O I
10.1016/j.egyr.2024.05.031
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The lack of transparency in reinforcement learning methods' decision-making process has resulted in a significant lack of trust towards these models, subsequently limiting their utilization in critical decisionmaking applications. The use of reinforcement learning in distribution network reconfiguration is an inherently sensitive application due to the need to change the states of the switches, which can significantly impact the lifespan of the switches. Consequently, executing this process requires meticulous and deliberate consideration. This study presents a new methodology to analyze and elucidate reinforcement learning-based decisions in distribution network reconfiguration. The proposed approach involves the training of an explainer neural network based on the decisions of the reinforcement learning agent. The explainer network receives as input the active and reactive power of the buses at each hour and outputs the line states determined by the agent. To delve deeper into the inner workings of the explainer network, attribution methods are employed. These techniques facilitate the examination of the intricate relationship between the inputs and outputs of the network, offering valuable insights into the agent's decision-making process. The efficacy of this novel approach is demonstrated through its application to both the 33- and 136 -bus test systems, and the obtained results are presented.
引用
收藏
页码:5703 / 5715
页数:13
相关论文
共 50 条
  • [41] Explainable Reinforcement Learning: A Survey and Comparative Review
    Milani, Stephanie
    Topin, Nicholay
    Veloso, Manuela
    Fang, Fei
    ACM COMPUTING SURVEYS, 2024, 56 (07) : 1 - 36
  • [42] Portfolio construction using explainable reinforcement learning
    Cortes, Daniel Gonzalez
    Onieva, Enrique
    Pastor, Iker
    Trinchera, Laura
    Wu, Jian
    EXPERT SYSTEMS, 2024,
  • [43] Causal State Distillation for Explainable Reinforcement Learning
    Lu, Wenhao
    Zhao, Xufeng
    Fryen, Thilo
    Lee, Jae Hee
    Li, Mengdi
    Magg, Sven
    Wermter, Stefan
    CAUSAL LEARNING AND REASONING, VOL 236, 2024, 236 : 106 - 142
  • [44] Safe Reinforcement Learning Control for Water Distribution Network
    Val, Jorge
    Wisniewski, Rafal
    Kallesoe, Carsten Skovmose
    5TH IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS (IEEE CCTA 2021), 2021, : 1148 - 1153
  • [45] Robust Distribution Network Reconfiguration
    Lee, Changhyeok
    Liu, Cong
    Mehrotra, Sanjay
    Bie, Zhaohong
    IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (02) : 836 - 842
  • [46] The Review on Distribution Network Reconfiguration
    Ma, Youjie
    Tong, Xin
    Zhou, Xuesong
    Gao, Zhiqiang
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 2292 - 2297
  • [47] Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network: a cloud-edge collaboration architecture
    Jiang, Siyuan
    Gao, Hongjun
    Wang, Xiaohui
    Liu, Junyong
    Zuo, Kunyu
    GLOBAL ENERGY INTERCONNECTION-CHINA, 2023, 6 (01): : 1 - 14
  • [48] Deep reinforcement learning based multi-level dynamic reconfiguration for urban distribution network:a cloud-edge collaboration architecture
    Siyuan Jiang
    Hongjun Gao
    Xiaohui Wang
    Junyong Liu
    Kunyu Zuo
    Global Energy Interconnection, 2023, 6 (01) : 1 - 14
  • [49] A Two-stage Multi-agent Deep Reinforcement Learning Method for Urban Distribution Network Reconfiguration Considering Switch Contribution
    Gao H.
    Jiang S.
    Li Z.
    Wang R.
    Liu Y.
    Liu J.
    IEEE Transactions on Power Systems, 2024, 39 (06) : 1 - 12
  • [50] Distribution network reconfiguration based on artificial network reconfiguration for variable load profile
    Youssef, Hesham Hanie
    Mokhlis, Hazlie
    Abu Talip, Mohamad Sofian
    Al Samman, Mohammad
    Muhammad, Munir Azam
    Mansor, Nurulafiqah Nadzirah
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2020, 28 (05) : 3013 - 3035