Multi-Timescale Voltage Control Method Using Limited Measurable Information with Explainable Deep Reinforcement Learning

被引:0
|
作者
Matsushima, Fumiya [1 ]
Aoki, Mutsumi [1 ]
Nakamura, Yuta [1 ]
Verma, Suresh Chand [1 ]
Ueda, Katsuhisa [2 ]
Imanishi, Yusuke [2 ]
机构
[1] Nagoya Inst Technol, Dept Elect & Mech Engn, Nagoya 4668555, Japan
[2] Chubu Elect Power Co Inc, Dept Elect Power Res & Dev Ctr, Nagoya 4598522, Japan
关键词
distributed energy resources; multi-timescale voltage control; deep reinforcement learning; Shapley additive explanation; voltage estimation; deep neural network; sub-transmission grid;
D O I
10.3390/en18030653
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The integration of photovoltaic (PV) power generation systems has significantly increased the complexity of voltage distribution in power grids, making it challenging for conventional Load Ratio Control Transformers (LRTs) to manage voltage fluctuations caused by weather-dependent PV output variations. Power Conditioning Systems (PCSs) interconnected with PV installations are increasingly considered for voltage control to address these challenges. This study proposes a Machine Learning (ML)-based control method for sub-transmission grids, integrating long-term LRT tap-changing with short-term reactive power control of PCSs. The approach estimates the voltage at each grid node using a Deep Neural Network (DNN) that processes measurable substation data. Based on these estimated voltages, the method determines optimal LRT tap positions and PCS reactive power outputs using Deep Reinforcement Learning (DRL). This enables real-time voltage monitoring and control using only substation measurements, even in grids without extensive sensor installations, ensuring all node voltages remain within specified limits. To improve the model's transparency, Shapley Additive Explanation (SHAP), an Explainable AI (XAI) technique, is applied to the DRL model. SHAP enhances interpretability and confirms the effectiveness of the proposed method. Numerical simulations further validate its performance, demonstrating its potential for effective voltage management in modern power grids.
引用
收藏
页数:28
相关论文
共 50 条
  • [11] DEALING WITH NON-STATIONARITY IN DECENTRALIZED COOPERATIVE MULTI-AGENT DEEP REINFORCEMENT LEARNING VIA MULTI-TIMESCALE LEARNING
    Nekoei, Hadi
    Badrinaaraayanan, Akilesh
    Sinha, Amit
    Amini, Mohammad
    Rajendran, Janarthanan
    Mahajan, Aditya
    Chandar, Sarath
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 232, 2023, 232 : 376 - 398
  • [12] Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning
    Emami, Patrick
    Zhang, Xiangyu
    Biagioni, David
    Zamzam, Ahmed S.
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 2372 - 2378
  • [13] Analysis of a Multi-Timescale Framework for the Voltage Control of Active Distribution Grids
    De Din, Edoardo
    Bigalke, Fabian
    Pau, Marco
    Ponci, Ferdinanda
    Monti, Antonello
    ENERGIES, 2021, 14 (07)
  • [14] Two-Timescale Voltage Regulation in Distribution Grids Using Deep Reinforcement Learning
    Yang, Qiuling
    Wang, Gang
    Sadeghi, Alireza
    Giannakis, Georgios B.
    Sun, Jian
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS (SMARTGRIDCOMM), 2019,
  • [15] Deep-Reinforcement-Learning-Based Two-Timescale Voltage Control for Distribution Systems
    Zhang, Jing
    Li, Yiqi
    Wu, Zhi
    Rong, Chunyan
    Wang, Tao
    Zhang, Zhang
    Zhou, Suyang
    ENERGIES, 2021, 14 (12)
  • [16] Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm
    Ma, Ming
    Du, Wanlin
    Wang, Ling
    Ding, Cangbi
    Liu, Siqi
    FRONTIERS IN ENERGY RESEARCH, 2023, 10
  • [17] A Fast Converged Voltage Control Method based on Deep Reinforcement Learning
    Wang, Xinqiao
    Liu, Siyan
    Wang, Bo
    2021 POWER SYSTEM AND GREEN ENERGY CONFERENCE (PSGEC), 2021, : 12 - 17
  • [18] Multi-Timescale Coordinated Voltage/Var Control of High Renewable-Penetrated Distribution Systems
    Xu, Yan
    Dong, Zhao Yang
    Zhang, Rui
    Hill, David J.
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (06) : 4398 - 4408
  • [19] Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems
    Cao, Di
    Zhao, Junbo
    Hu, Weihao
    Yu, Nanpeng
    Ding, Fei
    Huang, Qi
    Chen, Zhe
    IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (01) : 149 - 165
  • [20] Control of the Multi-Timescale Process Using Multiple Timescale Recurrent Neural Network-Based Model Predictive Control
    Li Jian, Ngiam
    Zabiri, Haslinda
    Ramasamy, Marappagounder
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2023, 62 (15) : 6176 - 6195