Cooperative Multi-Agent Reinforcement Learning Method for Fast Voltage Regulation using Distributed Wind Turbine Generators

被引:0
|
作者
Jimenez-Aparicio, Miguel [1 ]
Darbali-Zamora, Rachid [1 ]
机构
[1] Sandia Natl Labs, POB 5800, Albuquerque, NM 87185 USA
关键词
Voltage Regulation; DERMS; Wind Turbine Generator; Multi-Agent System; Reinforcement Learning;
D O I
10.1109/ISGT-LA56058.2023.10328322
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper proposes a Multi-Agent Reinforcement Learning (MARL) voltage regulation method for distribution systems with presence of Wind Turbine Generators (WTGs). The control employs reactive power injection or absorption in three WTGs to regulate feeder voltages. A weighted global voltage metric is calculated to summarize nodes' voltages according to their relevance. Three independent RL Agents are trained using policy parameter sharing. Models are trained and tested on real-time Hardware-In-the-Loop setup. The proposed control effectively regulates voltage through the system, bringing median and mean voltages closer to 1 p.u. and reducing standard deviation.
引用
收藏
页码:215 / 219
页数:5
相关论文
共 50 条
  • [21] Phased Continuous Exploration Method for Cooperative Multi-Agent Reinforcement Learning
    Kang, Jie
    Hou, Yaqing
    Zeng, Yifeng
    Chen, Yongchao
    Tong, Xiangrong
    Xu, Xin
    Zhang, Qiang
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1086 - 1091
  • [22] A Cooperative Multi-Agent Reinforcement Learning Method Based on Coordination Degree
    Cui, Haoyan
    Zhang, Zhen
    IEEE ACCESS, 2021, 9 : 123805 - 123814
  • [23] Fast reinforcement learning approach to cooperative behavior acquisition in multi-agent system
    Piao, S
    Hong, B
    2002 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-3, PROCEEDINGS, 2002, : 871 - 875
  • [24] Parallel and distributed multi-agent reinforcement learning
    Kaya, M
    Arslan, A
    PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, 2001, : 437 - 441
  • [25] Coding for Distributed Multi-Agent Reinforcement Learning
    Wang, Baoqian
    Xie, Junfei
    Atanasov, Nikolay
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 10625 - 10631
  • [26] Distributed reinforcement learning in multi-agent networks
    Kar, Soummya
    Moura, Jose M. F.
    Poor, H. Vincent
    2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, : 296 - +
  • [27] Enhanced Cooperative Multi-agent Learning Algorithms (ECMLA) using Reinforcement Learning
    Vidhate, Deepak A.
    Kulkarni, Parag
    2016 INTERNATIONAL CONFERENCE ON COMPUTING, ANALYTICS AND SECURITY TRENDS (CAST), 2016, : 556 - 561
  • [28] A Multi-agent Cooperative Voltage Control Method
    Nagata, T.
    Nakachi, Y.
    Hatano, R.
    2008 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, VOLS 1-11, 2008, : 3685 - +
  • [29] Distributed Multi-Agent Reinforcement Learning by Actor-Critic Method
    Heredia, Paulo C.
    Mou, Shaoshuai
    IFAC PAPERSONLINE, 2019, 52 (20): : 363 - 368
  • [30] Distributed cooperative tracking of uncertain nonlinear multi-agent systems with fast learning
    Peng, Zhouhua
    Wang, Dan
    Wang, Hao
    Wang, Wei
    NEUROCOMPUTING, 2014, 129 : 494 - 503