Explainable reinforcement learning for distribution network reconfiguration

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ,2 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB, Canada
[2] Univ Hradec Kralove, Appl Cybernet, Hradec Kralove, Czech Republic
基金
加拿大自然科学与工程研究理事会;
关键词
Distribution network reconfiguration; Reinforcement learning; Deep Q-learning; Data-driven control; Explainable machine learning; DYNAMIC RECONFIGURATION; OPERATION;
D O I
10.1016/j.egyr.2024.05.031
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The lack of transparency in reinforcement learning methods' decision-making process has resulted in a significant lack of trust towards these models, subsequently limiting their utilization in critical decisionmaking applications. The use of reinforcement learning in distribution network reconfiguration is an inherently sensitive application due to the need to change the states of the switches, which can significantly impact the lifespan of the switches. Consequently, executing this process requires meticulous and deliberate consideration. This study presents a new methodology to analyze and elucidate reinforcement learning-based decisions in distribution network reconfiguration. The proposed approach involves the training of an explainer neural network based on the decisions of the reinforcement learning agent. The explainer network receives as input the active and reactive power of the buses at each hour and outputs the line states determined by the agent. To delve deeper into the inner workings of the explainer network, attribution methods are employed. These techniques facilitate the examination of the intricate relationship between the inputs and outputs of the network, offering valuable insights into the agent's decision-making process. The efficacy of this novel approach is demonstrated through its application to both the 33- and 136 -bus test systems, and the obtained results are presented.
引用
收藏
页码:5703 / 5715
页数:13
相关论文
共 50 条
  • [1] Distribution Network Reconfiguration Using Deep Reinforcement Learning
    Gautam, Mukesh
    Benidris, Mohammed
    2022 17TH INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS (PMAPS), 2022,
  • [2] Dynamic Distribution Network Reconfiguration Using Reinforcement Learning
    Gao, Yuanqi
    Shi, Jie
    Wang, Wei
    Yu, Nanpeng
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS (SMARTGRIDCOMM), 2019,
  • [3] Batch-Constrained Reinforcement Learning for Dynamic Distribution Network Reconfiguration
    Gao, Yuanqi
    Wang, Wei
    Shi, Jie
    Yu, Nanpeng
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (06) : 5357 - 5369
  • [4] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Kundacina, Ognjen B.
    Vidovic, Predrag M.
    Petkovic, Milan R.
    ELECTRICAL ENGINEERING, 2022, 104 (03) : 1487 - 1501
  • [5] Fast Reconfiguration of Distribution Network Based on Deep Reinforcement Learning Algorithm
    Zhao, Bincheng
    Han, Xueshan
    Ma, Yiran
    Li, Zhiqi
    2020 5TH INTERNATIONAL CONFERENCE ON MATERIALS SCIENCE, ENERGY TECHNOLOGY AND ENVIRONMENTAL ENGINEERING, 2020, 571
  • [6] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Ognjen B. Kundačina
    Predrag M. Vidović
    Milan R. Petković
    Electrical Engineering, 2022, 104 : 1487 - 1501
  • [7] Fuzzy Centered Explainable Network for Reinforcement Learning
    Ou, Liang
    Chang, Yu-Chen
    Wang, Yu-Kai
    Lin, Chin-Teng
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (01) : 203 - 213
  • [8] Distribution Network Reconfiguration to Minimize Power Loss Using Deep Reinforcement Learning
    Lim, Se-Heon
    Kim, Tae-Geun
    Yoon, Sung-Guk
    Yoon, Sung-Guk (sgyoon@ssu.ac.kr); Kim, Tae-Geun (taegeun1520@gmail.com), 1659, Korean Institute of Electrical Engineers (69): : 1659 - 1667
  • [9] Self-healing radial distribution network reconfiguration based on deep reinforcement learning
    Jo, Seungchan
    Oh, Jae-Young
    Yoon, Yong Tae
    Jin, Young Gyu
    RESULTS IN ENGINEERING, 2024, 22
  • [10] An integrated network embedding with reinforcement learning for explainable recommendation
    Vo, Tham
    SOFT COMPUTING, 2022, 26 (08) : 3757 - 3775