A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

被引:3
|
作者
Zhang, Guozhou [1 ]
Zhao, Junbo [2 ]
Hu, Weihao [1 ]
Cao, Di [1 ]
Kamwa, Innocent [3 ]
Duan, Nan [4 ]
Chen, Zhe [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2] Univ Connecticut, Dept Elect & Comp Engn, Storrs, CT 06269 USA
[3] Laval Univ, Quebec City, PQ G1V 0A6, Canada
[4] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[5] Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark
关键词
Damping; Torque; Oscillators; Tuning; Robustness; Resonant frequency; Power system stability; Dual-branch (DB) damping controller; low-frequency oscillation (LFO); multiagent deep reinforcement learning (MADRL); power system control; ultralow-frequency oscillation (ULFO); ULTRALOW-FREQUENCY OSCILLATIONS; INTERAREA OSCILLATIONS; POWER-SYSTEMS; PERFORMANCE; SELECTION;
D O I
10.1109/TCST.2022.3176736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.
引用
收藏
页码:483 / 492
页数:10
相关论文
共 41 条
  • [1] Efficient Deep Reinforcement Learning-Enabled Recommendation
    Pang, Guangyao
    Wang, Xiaoming
    Wang, Liang
    Hao, Fei
    Lin, Yaguang
    Wan, Pengfei
    Min, Geyong
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (02): : 871 - 886
  • [2] Deep VULMAN: A deep reinforcement learning-enabled cyber vulnerability management framework
    Hore, Soumyadeep
    Shah, Ankit
    Bastian, Nathaniel D.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 221
  • [3] A deep reinforcement learning-enabled dynamic redeployment system for mobile ambulances
    Ji, Shenggong
    Zheng, Yu
    Wang, Zhaoyuan
    Li, Tianrui
    [J]. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3 (01):
  • [4] Deep Reinforcement Learning-Enabled Secure Visible Light Communication Against Eavesdropping
    Xiao, Liang
    Sheng, Geyi
    Liu, Sicong
    Dai, Huaiyu
    Peng, Mugen
    Song, Jian
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (10) : 6994 - 7005
  • [5] Deep Reinforcement Learning-Enabled Bridge Management Considering Asset and Network Risks
    Yang, David Y.
    [J]. JOURNAL OF INFRASTRUCTURE SYSTEMS, 2022, 28 (03)
  • [6] Transfer Deep Reinforcement Learning-Enabled Energy Management Strategy for Hybrid Tracked Vehicle
    Guo, Xiaowei
    Liu, Teng
    Tang, Bangbei
    Tang, Xiaolin
    Zhang, Jinwei
    Tan, Wenhao
    Jin, Shufeng
    [J]. IEEE ACCESS, 2020, 8 : 165837 - 165848
  • [7] Robustness assessment and enhancement of deep reinforcement learning-enabled load restoration for distribution systems
    Xie, Haipeng
    Tang, Lingfeng
    Zhu, Hao
    Cheng, Xiaofeng
    Bie, Zhaohong
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 237
  • [8] Deep Learning-Enabled Two-Directional Stretchable Strain Sensor Based on a Single Multimode Fiber
    Kang, Juan
    He, Sijin
    Alsalman, Osamah
    Liu, Xiao
    Zhu, Chen
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (12) : 19143 - 19150
  • [9] A Dual-Branch Deep Learning Architecture for Multisensor and Multitemporal Remote Sensing Semantic Segmentation
    Bergamasco, Luca
    Bovolo, Francesca
    Bruzzone, Lorenzo
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 2147 - 2162
  • [10] CMNet: deep learning model for colon polyp segmentation based on dual-branch structure
    Cao, Xuguang
    Fan, Kefeng
    Xu, Cun
    Ma, Huilin
    Jiao, Kaijie
    [J]. JOURNAL OF MEDICAL IMAGING, 2024, 11 (02)