Multi-Timescale Voltage Control Method Using Limited Measurable Information with Explainable Deep Reinforcement Learning

被引:0
|
作者
Matsushima, Fumiya [1 ]
Aoki, Mutsumi [1 ]
Nakamura, Yuta [1 ]
Verma, Suresh Chand [1 ]
Ueda, Katsuhisa [2 ]
Imanishi, Yusuke [2 ]
机构
[1] Nagoya Inst Technol, Dept Elect & Mech Engn, Nagoya 4668555, Japan
[2] Chubu Elect Power Co Inc, Dept Elect Power Res & Dev Ctr, Nagoya 4598522, Japan
关键词
distributed energy resources; multi-timescale voltage control; deep reinforcement learning; Shapley additive explanation; voltage estimation; deep neural network; sub-transmission grid;
D O I
10.3390/en18030653
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The integration of photovoltaic (PV) power generation systems has significantly increased the complexity of voltage distribution in power grids, making it challenging for conventional Load Ratio Control Transformers (LRTs) to manage voltage fluctuations caused by weather-dependent PV output variations. Power Conditioning Systems (PCSs) interconnected with PV installations are increasingly considered for voltage control to address these challenges. This study proposes a Machine Learning (ML)-based control method for sub-transmission grids, integrating long-term LRT tap-changing with short-term reactive power control of PCSs. The approach estimates the voltage at each grid node using a Deep Neural Network (DNN) that processes measurable substation data. Based on these estimated voltages, the method determines optimal LRT tap positions and PCS reactive power outputs using Deep Reinforcement Learning (DRL). This enables real-time voltage monitoring and control using only substation measurements, even in grids without extensive sensor installations, ensuring all node voltages remain within specified limits. To improve the model's transparency, Shapley Additive Explanation (SHAP), an Explainable AI (XAI) technique, is applied to the DRL model. SHAP enhances interpretability and confirms the effectiveness of the proposed method. Numerical simulations further validate its performance, demonstrating its potential for effective voltage management in modern power grids.
引用
收藏
页数:28
相关论文
共 50 条
  • [21] Deep Reinforcement Learning for Voltage Control and Renewable Accommodation Using Spatial-Temporal Graph Information
    Li, Jinhao
    Zhang, Ruichang
    Wang, Hao
    Liu, Zhi
    Lai, Hongyang
    Zhang, Yanru
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2024, 15 (01) : 249 - 262
  • [22] Efficient DER Voltage Control Using Ensemble Deep Reinforcement Learning
    Obert, James
    Trevizan, Rodrigo D.
    Chavez, Adrian
    2022 5TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE FOR INDUSTRIES, AI4I, 2022, : 55 - 58
  • [23] Multi-timescale, multi-period decision-making model development by combining reinforcement learning and mathematical programming
    Shin, Joohyun
    Lee, Jay H.
    COMPUTERS & CHEMICAL ENGINEERING, 2019, 121 : 556 - 573
  • [24] Multi-agent deep reinforcement learning for efficient multi-timescale bidding of a hybrid power plant in day-ahead and real-time markets
    Ochoa, Tomas
    Gil, Esteban
    Angulo, Alejandro
    Valle, Carlos
    APPLIED ENERGY, 2022, 317
  • [25] Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory
    Martinolli, Marco
    Gerstner, Wulfram
    Gilra, Aditya
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2018, 12
  • [26] Deep Reinforcement Learning Approach for Dual-timescale Voltage Management in Distribution System
    Feng C.
    Zhang Y.
    Xie L.
    Wen F.
    Zhang K.
    Zhang Y.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (12): : 202 - 209
  • [27] Efficient Jamming Policy Generation Method Based on Multi-Timescale Ensemble Q-Learning
    Qian, Jialong
    Zhou, Qingsong
    Li, Zhihui
    Yang, Zhongping
    Shi, Shasha
    Xu, Zhenjia
    Xu, Qiyun
    REMOTE SENSING, 2024, 16 (17)
  • [28] Deep Reinforcement Learning for Electric Transmission Voltage Control
    Thayer, Brandon L.
    Overbye, Thomas J.
    2020 IEEE ELECTRIC POWER AND ENERGY CONFERENCE (EPEC), 2020,
  • [29] Deep reinforcement learning based voltage control revisited
    Nematshahi, Saeed
    Shi, Di
    Wang, Fengyu
    Yan, Bing
    Nair, Adithya
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2023, 17 (21) : 4826 - 4835
  • [30] A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning
    Wang, Shengyi
    Duan, Jiajun
    Shi, Di
    Xu, Chunlei
    Li, Haifeng
    Diao, Ruisheng
    Wang, Zhiwei
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (06) : 4644 - 4654