A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids

被引:3
|
作者
Wang, Tianhao [1 ]
Ma, Shiqian [1 ]
Tang, Zhuo [2 ]
Xiang, Tianchun [3 ]
Mu, Chaoxu [2 ]
Jin, Yao [3 ]
机构
[1] State Grid Tianjin Elect Power Co, Elect Power Res Inst, Huayuan Ind Zone, Binhai High Tech Zone, 8,Haitai Huake 4th Rd, Tianjin 300384, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, 92 Weijin Rd, Tianjin 300072, Peoples R China
[3] State Grid Tianjin Elect Power Co, 39 Wujing,Guangfu St, Tianjin 300010, Peoples R China
关键词
multi-agent reinforcement learning; microgrid; voltage control; attention mechanism; FREQUENCY CONTROL; ISLANDED MICROGRIDS; FRAMEWORK; SYSTEM;
D O I
10.3390/en16155653
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper proposes a novel cooperative voltage control strategy for an isolated microgrid based on the multi-agent advantage actor-critic (MA2C) algorithm. The proposed method facilitates the collaborative operation of a distributed energy system (DES) by adopting an attention mechanism to adaptively boost information processing effectiveness through the assignment of importance scores. Additionally, the algorithm we propose, executed through a centralized training and decentralized execution framework, implements secondary control and effectively restores voltage deviation. The introduction of an attention mechanism alleviates the burden of information transmission. Finally, we illustrate the effectiveness of the proposed method through a DES consisting of six energy nodes.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Graphon mean-field control for cooperative multi-agent reinforcement learning
    Hu, Yuanquan
    Wei, Xiaoli
    Yan, Junji
    Zhang, Hengxi
    JOURNAL OF THE FRANKLIN INSTITUTE, 2023, 360 (18) : 14783 - 14805
  • [42] Cooperative Multi-agent Reinforcement Learning Models (CMRLM) for Intelligent Traffic Control
    Vidhate, Deepak A.
    Kulkarni, Parag
    2017 1ST INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND INFORMATION MANAGEMENT (ICISIM), 2017, : 325 - 331
  • [43] Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control
    Zhao, Yang
    Hu, Jian-Ming
    Gao, Ming-Yang
    Zhang, Zuo
    CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 458 - 470
  • [44] Cooperative Multi-Agent Reinforcement Learning Method for Fast Voltage Regulation using Distributed Wind Turbine Generators
    Jimenez-Aparicio, Miguel
    Darbali-Zamora, Rachid
    2023 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES LATIN AMERICA, ISGT-LA, 2023, : 215 - 219
  • [45] Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks
    Wang, Jianhong
    Xu, Wangkun
    Gu, Yunjie
    Song, Wenbin
    Green, Tim C.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [46] Multi-agent reinforcement learning for character control
    Li, Cheng
    Fussell, Levi
    Komura, Taku
    VISUAL COMPUTER, 2021, 37 (12): : 3115 - 3123
  • [47] Multi-agent reinforcement learning for character control
    Cheng Li
    Levi Fussell
    Taku Komura
    The Visual Computer, 2021, 37 : 3115 - 3123
  • [48] Data-driven cooperative load frequency control method for microgrids using effective exploration-distributed multi-agent deep reinforcement learning
    Li, Jiawen
    Yang, Shengchun
    Yu, Tao
    IET RENEWABLE POWER GENERATION, 2022, 16 (04) : 655 - 670
  • [49] Multi-Agent Cooperative Voltage and Reactive Power Control
    Nagata, Takeshi
    Saeki, Hiroshi
    Utatani, Masahiro
    Nakachi, Yoshiki
    Hatano, Ryousuke
    ELECTRICAL ENGINEERING IN JAPAN, 2011, 174 (01) : 25 - 32
  • [50] Pacesetter Learning for Large Scale Cooperative Multi-Agent Reinforcement Learning
    Zhou, Pingqi
    Li, Chao
    Qiu, Mengwei
    Liu, Jun
    Ma, Chennan
    Yan, Ming
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 115 - 126