A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

被引:5
|
作者
Zhang, Guozhou [1 ]
Zhao, Junbo [2 ]
Hu, Weihao [1 ]
Cao, Di [1 ]
Kamwa, Innocent [3 ]
Duan, Nan [4 ]
Chen, Zhe [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2] Univ Connecticut, Dept Elect & Comp Engn, Storrs, CT 06269 USA
[3] Laval Univ, Quebec City, PQ G1V 0A6, Canada
[4] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[5] Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark
关键词
Damping; Torque; Oscillators; Tuning; Robustness; Resonant frequency; Power system stability; Dual-branch (DB) damping controller; low-frequency oscillation (LFO); multiagent deep reinforcement learning (MADRL); power system control; ultralow-frequency oscillation (ULFO); ULTRALOW-FREQUENCY OSCILLATIONS; INTERAREA OSCILLATIONS; POWER-SYSTEMS; PERFORMANCE; SELECTION;
D O I
10.1109/TCST.2022.3176736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.
引用
收藏
页码:483 / 492
页数:10
相关论文
共 49 条
  • [41] SMA-PDPPO: Safe Multiagent Primal-Dual Deep Reinforcement Learning for Industrial Parks Energy Trading
    Lu, Renzhi
    Wu, Ning
    Yang, Tao
    Chen, Ying
    Sun, Mingyang
    Wang, Dong
    Peng, Xin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (03) : 2640 - 2649
  • [42] DB-Net: dual-branch deep learning network for cloud detection utilizing attention mechanism and cascaded multiscale feature fusion
    Zhou, Ruyan
    Zhang, Chenhao
    Pan, Haiyan
    He, Haiyang
    Zhang, Yun
    Han, Yanling
    Wang, Jing
    Yang, Shuhu
    Hong, Zhonghua
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (03)
  • [43] Deep Learning-Enabled Rapid Metabolic Decoding of Small Extracellular Vesicles via Dual-Use Mass Spectroscopy Chip Array
    Yang, Chenyu
    Chen, He
    Wu, Yun
    Shen, Xiangguo
    Liu, Hongchun
    Liu, Taotao
    Shen, Xizhong
    Xue, Ruyi
    Sun, Nianrong
    Deng, Chunhui
    ANALYTICAL CHEMISTRY, 2024, 97 (01) : 271 - 280
  • [44] Coordinated Operation of Multiple Microgrids With Heat-Electricity Energy Based on Graph Surrogate Model-Enabled Robust Multiagent Deep Reinforcement Learning
    Li, Sichen
    Hu, Weihao
    Cao, Di
    Hu, Jiaxiang
    Chen, Zhe
    Blaabjerg, Frede
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (01) : 248 - 257
  • [45] Adaptive inter-area power oscillation damping from offshore wind farm and MMC-HVDC using deep reinforcement learning
    Zhang, Zuan
    Liang, Yanchang
    Zhao, Xiaowei
    RENEWABLE ENERGY, 2024, 224
  • [46] Optimal dual-model controller of solid oxide fuel cell output voltage using imitation distributed deep reinforcement learning
    Li, Jiawen
    Cui, Haoyang
    Jiang, Wei
    Yu, Hengwen
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2023, 48 (37) : 14053 - 14067
  • [47] Load-aware dynamic controller placement based on deep reinforcement learning in SDN-enabled mobile cloud-edge computing networks
    Xu, Chenglin
    Xu, Cheng
    Li, Bo
    Li, Siqi
    Li, Tao
    COMPUTER NETWORKS, 2023, 234
  • [48] Multiagent Deep Reinforcement Learning-Aided Output Current Sharing Control for Input-Series Output-Parallel Dual Active Bridge Converter
    Zeng, Yu
    Pou, Josep
    Sun, Changjiang
    Maswood, Ali I.
    Dong, Jiaxin
    Mukherjee, Suvajit
    Gupta, Amit Kumar
    IEEE TRANSACTIONS ON POWER ELECTRONICS, 2022, 37 (11) : 12955 - 12961
  • [49] Double Deep Q-Network Next-Generation Cyber-Physical Systems: A Reinforcement Learning-Enabled Anomaly Detection Framework for Next-Generation Cyber-Physical Systems
    Zhang, Yinjun
    Jamjoom, Mona
    Ullah, Zahid
    ELECTRONICS, 2023, 12 (17)