A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids

被引:3
|
作者
Wang, Tianhao [1 ]
Ma, Shiqian [1 ]
Tang, Zhuo [2 ]
Xiang, Tianchun [3 ]
Mu, Chaoxu [2 ]
Jin, Yao [3 ]
机构
[1] State Grid Tianjin Elect Power Co, Elect Power Res Inst, Huayuan Ind Zone, Binhai High Tech Zone, 8,Haitai Huake 4th Rd, Tianjin 300384, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, 92 Weijin Rd, Tianjin 300072, Peoples R China
[3] State Grid Tianjin Elect Power Co, 39 Wujing,Guangfu St, Tianjin 300010, Peoples R China
关键词
multi-agent reinforcement learning; microgrid; voltage control; attention mechanism; FREQUENCY CONTROL; ISLANDED MICROGRIDS; FRAMEWORK; SYSTEM;
D O I
10.3390/en16155653
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper proposes a novel cooperative voltage control strategy for an isolated microgrid based on the multi-agent advantage actor-critic (MA2C) algorithm. The proposed method facilitates the collaborative operation of a distributed energy system (DES) by adopting an attention mechanism to adaptively boost information processing effectiveness through the assignment of importance scores. Additionally, the algorithm we propose, executed through a centralized training and decentralized execution framework, implements secondary control and effectively restores voltage deviation. The introduction of an attention mechanism alleviates the burden of information transmission. Finally, we illustrate the effectiveness of the proposed method through a DES consisting of six energy nodes.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning for Microgrids
    Dimeas, A. L.
    Hatziargyriou, N. D.
    IEEE POWER AND ENERGY SOCIETY GENERAL MEETING 2010, 2010,
  • [2] A Multi-agent Cooperative Voltage Control Method
    Nagata, T.
    Nakachi, Y.
    Hatano, R.
    2008 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, VOLS 1-11, 2008, : 3685 - +
  • [3] Secondary control of microgrids based on distributed cooperative control of multi-agent systems
    Bidram, Ali
    Davoudi, Ali
    Lewis, Frank L.
    Qu, Zhihua
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2013, 7 (08) : 822 - 831
  • [4] Secondary Voltage Control for Microgrids based on Fixed-time Distributed Cooperative Control of Multi-agent Systems
    Ni, Junkang
    Liu, Ling
    Liu, Chongxin
    Hu, Xiaoyu
    Li, Shilei
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 761 - 766
  • [5] A Large-Scale Multi-Agent Deep Reinforcement Learning Method for Cooperative Output Voltage Control of PEMFCs
    Li, Jiawen
    Cui, Haoyang
    Jiang, Wei
    Yu, Hengwen
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (01): : 78 - 94
  • [6] Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems
    Javalera-Rincon, Valeria
    Puig Cayuela, Vicenc
    Morcego Seix, Bernardo
    Orduna-Cabrera, Fernando
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 80 - 91
  • [7] Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control
    Peake, Ashley
    McCalmon, Joe
    Raiford, Benjamin
    Liu, Tongtong
    Alqahtani, Sarra
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 15 - 22
  • [8] WRFMR: A Multi-Agent Reinforcement Learning Method for Cooperative Tasks
    Liu, Hui
    Zhang, Zhen
    Wang, Dongqing
    IEEE ACCESS, 2020, 8 : 216320 - 216331
  • [9] Multi-Agent Uncertainty Sharing for Cooperative Multi-Agent Reinforcement Learning
    Chen, Hao
    Yang, Guangkai
    Zhang, Junge
    Yin, Qiyue
    Huang, Kaiqi
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] Distributed secondary control for DC microgrids using two-stage multi-agent reinforcement learning
    Li, Fei
    Tu, Weifei
    Zhou, Yun
    Li, Heng
    Zhou, Feng
    Liu, Weirong
    Hu, Chao
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2025, 164