A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

被引:5
|
作者
Zhang, Guozhou [1 ]
Zhao, Junbo [2 ]
Hu, Weihao [1 ]
Cao, Di [1 ]
Kamwa, Innocent [3 ]
Duan, Nan [4 ]
Chen, Zhe [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2] Univ Connecticut, Dept Elect & Comp Engn, Storrs, CT 06269 USA
[3] Laval Univ, Quebec City, PQ G1V 0A6, Canada
[4] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[5] Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark
关键词
Damping; Torque; Oscillators; Tuning; Robustness; Resonant frequency; Power system stability; Dual-branch (DB) damping controller; low-frequency oscillation (LFO); multiagent deep reinforcement learning (MADRL); power system control; ultralow-frequency oscillation (ULFO); ULTRALOW-FREQUENCY OSCILLATIONS; INTERAREA OSCILLATIONS; POWER-SYSTEMS; PERFORMANCE; SELECTION;
D O I
10.1109/TCST.2022.3176736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.
引用
收藏
页码:483 / 492
页数:10
相关论文
共 49 条
  • [31] Cooperative Management for PV/ESS-Enabled Electric Vehicle Charging Stations: A Multiagent Deep Reinforcement Learning Approach
    Shin, MyungJae
    Choi, Dae-Hyun
    Kim, Joongheon
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (05) : 3493 - 3503
  • [32] Asymmetric Self-Play-Enabled Intelligent Heterogeneous Multirobot Catching System Using Deep Multiagent Reinforcement Learning
    Gao, Yuan
    Chen, Junfeng
    Chen, Xi
    Wang, Chongyang
    Hu, Junjie
    Deng, Fuqin
    Lam, Tin Lun
    IEEE TRANSACTIONS ON ROBOTICS, 2023, 39 (04) : 2603 - 2622
  • [33] Entropy-based Reward Design for Deep Reinforcement Learning-enabled Routing, Modulation and Spectrum Assignment of Elastic Optical Networks
    Tu, Yuqi
    Tang, Bixia
    Huang, Yue-Cai
    2022 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE, ACP, 2022, : 1168 - 1172
  • [34] A Novel Deep Reinforcement Learning Enabled Multi-Band PSS for Multi-Mode Oscillation Control
    Zhang, Guozhou
    Hu, Weihao
    Zhao, Junbo
    Cao, Di
    Chen, Zhe
    Blaabjerg, Frede
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2021, 36 (04) : 3794 - 3797
  • [35] A vision-language-guided and deep reinforcement learning-enabled approach for unstructured human-robot collaborative manufacturing task fulfilment
    Zheng, Pai
    Li, Chengxi
    Fan, Junming
    Wang, Lihui
    CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2024, 73 (01) : 341 - 344
  • [36] DRESIA: Deep Reinforcement Learning-Enabled Gray Box Approach for Large-Scale Dynamic Cyber-Twin System Simulation
    Lin, Zhouyang
    Li, Kai
    Yang, Yang
    Sun, Fanglei
    Wu, Liantao
    Shi, Panpan
    Ci, Song
    Zuo, Yong
    IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2021, 2 : 321 - 333
  • [37] DT-Assisted VNF Migration in SDN/NVF-Enabled IoT Networks via Multiagent Deep Reinforcement Learning
    Tang, Lun
    Li, Zhixuan
    Li, Jinyu
    Fang, Dongxu
    Li, Li
    Chen, Qianbin
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (14): : 25294 - 25315
  • [38] Parameterized deep reinforcement learning-enabled maintenance decision-support and life-cycle risk assessment for highway bridge portfolios
    Du, Ao
    Ghavidel, Alireza
    STRUCTURAL SAFETY, 2022, 97
  • [39] A method for freshness detection of pork using two-dimensional correlation spectroscopy images combined with dual-branch deep learning
    Sun, Jun
    Cheng, Jiehong
    Xu, Min
    Yao, Kunshan
    JOURNAL OF FOOD COMPOSITION AND ANALYSIS, 2024, 129
  • [40] <middle dot>AI-enabled intelligent cockpit proactive affective interaction: middle-level feature fusion dual-branch deep learning network for driver emotion recognition
    Wu, Ying-Zhang
    Li, Wen-Bo
    Liu, Yu-Jing
    Zeng, Guan-Zhong
    Li, Cheng-Mou
    Jin, Hua-Min
    Li, Shen
    Guo, Gang
    ADVANCES IN MANUFACTURING, 2024,