Exploring grid topology reconfiguration using a simple deep reinforcement learning approach

被引:10
|
作者
Subramanian, Medha [1 ,4 ]
Viebahn, Jan [2 ]
Tindemans, Simon H. [1 ]
Donnot, Benjamin [3 ]
Marot, Antoine [3 ]
机构
[1] Delft Univ Technol, Dept Elect Sustainable Energy, Delft, Netherlands
[2] TenneT TSO BV, Digital & Proc Excellence, Arnhem, Netherlands
[3] RTE, Paris, France
[4] Smart Wires Inc, Durham, NC 27703 USA
来源
关键词
Reinforcement learning; power system operation; decision support; control room operators; OPTIMIZATION;
D O I
10.1109/PowerTech46648.2021.9494879
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
System operators are faced with increasingly volatile operating conditions. In order to manage system reliability in a cost-effective manner, control room operators are turning to computerised decision support tools based on AI and machine learning. Specifically, Reinforcement Learning (RL) is a promising technique to train agents that suggest grid control actions to operators. In this paper, a simple baseline approach is presented using RL to represent an artificial control room operator that can operate a IEEE 14-bus test case for a duration of 1 week. This agent takes topological switching actions to control power flows on the grid, and is trained on only a single well-chosen scenario. The behaviour of this agent is tested on different time-series of generation and demand, demonstrating its ability to operate the grid successfully in 965 out of 1000 scenarios. The type and variability of topologies suggested by the agent are analysed across the test scenarios, demonstrating efficient and diverse agent behaviour.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Coordinated Topology Attacks in Smart Grid Using Deep Reinforcement Learning
    Wang, Zhenhua
    He, Haibo
    Wan, Zhiqiang
    Sun, Yan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) : 1407 - 1415
  • [2] Distribution Network Reconfiguration Using Deep Reinforcement Learning
    Gautam, Mukesh
    Benidris, Mohammed
    [J]. 2022 17TH INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS (PMAPS), 2022,
  • [3] Service-Oriented Topology Reconfiguration of UAV Networks with Deep Reinforcement Learning
    Chen, Ziyan
    Cheng, Nan
    Yin, Zhisheng
    He, Jingchao
    Lu, Ning
    [J]. 2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 753 - 758
  • [4] HUGO - Highlighting Unseen Grid Options: Combining deep reinforcement learning with a heuristic target topology approach
    Lehna, Malte
    Holzhueter, Clara
    Tomforde, Sven
    Scholz, Christoph
    [J]. SUSTAINABLE ENERGY GRIDS & NETWORKS, 2024, 39
  • [5] Dynamic Network Reconfiguration for Entropy Maximization using Deep Reinforcement Learning
    Doorman, Christoffel
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    [J]. LEARNING ON GRAPHS CONFERENCE, VOL 198, 2022, 198
  • [6] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Kundacina, Ognjen B.
    Vidovic, Predrag M.
    Petkovic, Milan R.
    [J]. ELECTRICAL ENGINEERING, 2022, 104 (03) : 1487 - 1501
  • [7] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Ognjen B. Kundačina
    Predrag M. Vidović
    Milan R. Petković
    [J]. Electrical Engineering, 2022, 104 : 1487 - 1501
  • [8] Resilient Topology Design for Wireless Backhaul: A Deep Reinforcement Learning Approach
    Abdelmoaty, Ahmed
    Naboulsi, Diala
    Dahman, Ghassan
    Poitau, Gwenael
    Gagnon, Francois
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (12) : 2532 - 2536
  • [9] IAB Topology Design: A Graph Embedding and Deep Reinforcement Learning Approach
    Simsek, Meryem
    Orhan, Oner
    Nassar, Marcel
    Elibol, Oguz
    Nikopour, Hosein
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (02) : 489 - 493
  • [10] Wi-Fi Rate Adaptation using a Simple Deep Reinforcement Learning Approach
    Queiros, Ruben
    Almeida, Eduardo Nuno
    Fontes, Helder
    Ruela, Jose
    Campos, Rui
    [J]. 2022 27TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2022), 2022,