Multi-Timescale Voltage Control Method Using Limited Measurable Information with Explainable Deep Reinforcement Learning

被引:0
|
作者
Matsushima, Fumiya [1 ]
Aoki, Mutsumi [1 ]
Nakamura, Yuta [1 ]
Verma, Suresh Chand [1 ]
Ueda, Katsuhisa [2 ]
Imanishi, Yusuke [2 ]
机构
[1] Nagoya Inst Technol, Dept Elect & Mech Engn, Nagoya 4668555, Japan
[2] Chubu Elect Power Co Inc, Dept Elect Power Res & Dev Ctr, Nagoya 4598522, Japan
关键词
distributed energy resources; multi-timescale voltage control; deep reinforcement learning; Shapley additive explanation; voltage estimation; deep neural network; sub-transmission grid;
D O I
10.3390/en18030653
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The integration of photovoltaic (PV) power generation systems has significantly increased the complexity of voltage distribution in power grids, making it challenging for conventional Load Ratio Control Transformers (LRTs) to manage voltage fluctuations caused by weather-dependent PV output variations. Power Conditioning Systems (PCSs) interconnected with PV installations are increasingly considered for voltage control to address these challenges. This study proposes a Machine Learning (ML)-based control method for sub-transmission grids, integrating long-term LRT tap-changing with short-term reactive power control of PCSs. The approach estimates the voltage at each grid node using a Deep Neural Network (DNN) that processes measurable substation data. Based on these estimated voltages, the method determines optimal LRT tap positions and PCS reactive power outputs using Deep Reinforcement Learning (DRL). This enables real-time voltage monitoring and control using only substation measurements, even in grids without extensive sensor installations, ensuring all node voltages remain within specified limits. To improve the model's transparency, Shapley Additive Explanation (SHAP), an Explainable AI (XAI) technique, is applied to the DRL model. SHAP enhances interpretability and confirms the effectiveness of the proposed method. Numerical simulations further validate its performance, demonstrating its potential for effective voltage management in modern power grids.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning
    Wu, Zhi
    Li, Yiqi
    Gu, Wei
    Dong, Zengbo
    Zhao, Jingtao
    Liu, Weiliang
    Zhang, Xiao-Ping
    Liu, Pengxiang
    Sun, Qirun
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 147
  • [2] Multi-timescale nexting in a reinforcement learning robot
    Modayil, Joseph
    White, Adam
    Sutton, Richard S.
    ADAPTIVE BEHAVIOR, 2014, 22 (02) : 146 - 160
  • [3] Multi-timescale Deep Reinforcement Learning for Reactive Power Optimization of Distribution Network
    Hu D.
    Peng Y.
    Wei W.
    Xiao T.
    Cai T.
    Xi W.
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (14): : 5034 - 5044
  • [4] A soft actor-critic deep reinforcement learning method for multi-timescale coordinated operation of microgrids
    Hu, Chunchao
    Cai, Zexiang
    Zhang, Yanxu
    Yan, Rudai
    Cai, Yu
    Cen, Bowei
    PROTECTION AND CONTROL OF MODERN POWER SYSTEMS, 2022, 7 (01)
  • [5] A soft actor-critic deep reinforcement learning method for multi-timescale coordinated operation of microgrids
    Chunchao Hu
    Zexiang Cai
    Yanxu Zhang
    Rudai Yan
    Yu Cai
    Bowei Cen
    Protection and Control of Modern Power Systems, 2022, 7
  • [6] EdgeTimer: Adaptive Multi-Timescale Scheduling in Mobile Edge Computing with Deep Reinforcement Learning
    Hao, Yijun
    Yang, Shusen
    Li, Fang
    Zhang, Yifan
    Wang, Shibo
    Ren, Xuebin
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2024, : 671 - 680
  • [7] Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning
    Sun, Jian (sunjian@bit.edu.cn), 1600, Institute of Electrical and Electronics Engineers Inc., United States (11):
  • [8] Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning
    Yang, Qiuling
    Wang, Gang
    Sadeghi, Alireza
    Giannakis, Georgios B.
    Sun, Jian
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) : 2313 - 2323
  • [9] Dynamic Lane Traffic Signal Control with Group Attention and Multi-Timescale Reinforcement Learning
    Jiang, Qize
    Li, Jingze
    Sun, Weiwei
    Zheng, Baihua
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3642 - 3648
  • [10] Reinforcement Learning of Multi-Timescale Forecast Information for Designing Operating Policies of Multi-Purpose Reservoirs
    Zanutto, D.
    Ficchi, A.
    Giuliani, M.
    Castelletti, A.
    WATER RESOURCES RESEARCH, 2025, 61 (02)