Distributed game coordination control method based on reinforcement learning for multi-microgrid

被引:0
|
作者
Liu, Wei [1 ]
Zhang, Sicong [1 ]
Zhang, Xiao-Ping [2 ]
Qian, Zhihao [1 ]
Hu, Tianhuan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
[2] Univ Birmingham, Dept Elect Elect & Syst Engn, Birmingham B15 2TT, Warwickshire, England
基金
中国国家自然科学基金;
关键词
Multi-microgrid (MMG); Potential game (PG); Q-learning; Distributed coordinated control;
D O I
暂无
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The traditional centralized control method hardly meets the coordination control demand for multi-microgrid (MMG), due to the conflict between the individual interests of a single microgrid (MG) and the global interests of MMG. In this study, a distributed coordination control method that integrates potential game (PG) and reinforcement learning (RL) is proposed to achieve balance of interests of an MMG. The proposed method fully exploits the distributed characteristic of the PG by considering each MG as an agent. It also establishes a PG-based distributed coordination control structure to maximize and balance the economy of single MG and overall MMG. Then, it combines the PG with the RL algorithm by the parameter transfer to obtain the optimal Nash equilibrium (NE) solution and improve the optimization performance based on Q-learning algorithm. Eventually, a simulation model is performed in MATLAB to demonstrate the effectiveness and superiority of the proposed control method.
引用
收藏
页码:912 / 921
页数:10
相关论文
共 50 条
  • [1] Distributed game coordination control method based on reinforcement learning for multi-microgrid
    Liu, Wei
    Zhang, Sicong
    Zhang, Xiao-Ping
    Qian, Zhihao
    Hu, Tianhuan
    [J]. ENERGY REPORTS, 2023, 9 : 912 - 921
  • [2] Distributed Coordination Control Strategy for a Multi-Microgrid Based on a Consensus Algorithm
    Lee, Sang-Ji
    Choi, Jin-Young
    Lee, Hyung-Joo
    Won, Dong-Jun
    [J]. ENERGIES, 2017, 10 (07)
  • [3] An Efficient Distributed Reinforcement Learning for Enhanced Multi-Microgrid Management
    Das, Avijit
    Ni, Zhen
    Wu, Di
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [4] Collaborative Optimization of Multi-microgrid System Based on Multi-agent Game and Reinforcement Learning
    Liu, Junfeng
    Wang, Xiaosheng
    Lu, Junbo
    Zeng, Jun
    [J]. Dianwang Jishu/Power System Technology, 2022, 46 (07): : 2722 - 2732
  • [5] Multi-microgrid Optimization Based on Hierarchical Reinforcement Learning
    Liu, Fengkui
    Tian, Jie
    Yang, Zimin
    Li, Jian
    Wu, Guoliang
    [J]. 2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 966 - 971
  • [6] Research on Multi-microgrid Distributed Optimization Operation Method
    Yang, Donghua
    Yang, Ming
    [J]. 2023 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA, I&CPS ASIA, 2023, : 35 - 42
  • [7] Deep reinforcement learning-based integrated frequency and voltage control for isolated multi-microgrid system
    Xie, Lilong
    Li, Yonghui
    Fan, Peixiao
    Wan, Li
    Huang, Mengqi
    Yang, Jun
    [J]. Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2024, 44 (06): : 118 - 126
  • [8] Cost Effective Dynamic Multi-Microgrid Formulation Method Using Deep Reinforcement Learning
    Jung, YoonGun
    Chang, Minhyeok
    Kang, Sungwoo
    Jang, Gilsoo
    Lee, Hojun
    Yoon, Minhan
    Song, Sungyoon
    Han, Changhee
    [J]. 2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,
  • [9] Economical Optimization for Multi-Microgrid Based on Stackelberg Game
    Tong, Xin
    Hu, Cungang
    Rui, Tao
    Shen, Weixiang
    [J]. PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1760 - 1764
  • [10] Distributed Signal Control of Multi-agent Reinforcement Learning Based on Game
    Qu Z.-W.
    Pan Z.-T.
    Chen Y.-H.
    Li H.-T.
    Wang X.
    [J]. Chen, Yong-Heng (cyh@jlu.edu.cn), 1600, Science Press (20): : 76 - 82and100