Cooperative optimal scheduling strategy of source and storage in microgrid based on soft actor-critic

被引:0
|
作者
Liu L. [1 ]
Zhu J. [1 ]
Chen J. [1 ]
Ye H. [1 ]
机构
[1] School of Electric Power, South China University of Technology, Guangzhou
基金
中国国家自然科学基金;
关键词
Deep learning; Distributionally robust optimizationKey words:microgrid; Energy storage; Generation and transmission system; Optimization and planning; Reinforcement learning; Renewable energy; Robust optimization; Security constraint; Soft actor-critic; Uncertainty;
D O I
10.16081/j.epae.202110036
中图分类号
学科分类号
摘要
In recent years, the proportion of renewable energy and energy storage in microgrid is increasing, which brings new challenges to its optimal scheduling. Aiming at the difficulty in solving the cooperative optimal scheduling problem of source and storage in microgrid due to the non-convex nonlinear constraints, the deep reinforcement learning algorithm is used to construct the data-based strategy function, and the optimal strategy is found out through continuous interactive learning with the environment, so that avoiding the direct solution of the original non-convex nonlinear problem. Considering the strategy function may not meet the security constraints in the training process, furthermore, a learning method of cooperative optimal scheduling secure strategy of source and storage in microgrid based on partial model information is proposed, and the optimal strategy meeting the network security constraints is obtained. In addition, aiming at the problem of long time-consuming due to the interaction between agents and environment in the training process for reinforcement learning, the neural network is used to model the environment, so as to improve the learning efficiency.Review and prospect of robust optimization and planning research on generation and transmission systemYUAN Yang1, ZHANG Heng1, CHENG Haozhong1, LIU Lu1, ZHANG Xiaohu2, LI Gang2, ZHANG Jianping2(1. Key Laboratory Control of Power Transmission and Conversion, Ministry of Education, Shanghai Jiao Tong University, Shanghai 200240, China;2. East China Branch of State Grid Corporation of China, Shanghai 200120, China)With the uncertainty of power system increasing gradually, the application of robust optimization and planning research on generation and transmission system to resist the uncertainty of extremely scenes has become a significant research method. Firstly, the robust optimization is divided into classical robust optimization and distributionally robust optimization from the perspective of whether the probability distribution characteristics of uncertain factors are considered, the mathematical models and uncertain set characteristics of these two kinds of robust optimization are sorted out. Secondly, the existing classical robust optimization and distributionally robust optimization research on generation and transmission system are divided into three aspects:considering the uncertainty of node injection power, considering the uncertainty of power capacity growth and cost, and considering the uncertainty of transmission network state, and the research framework and limitations of robust optimization planning research on generation and transmission system are refined. Finally, the problems worthy of further study in robust optimization planning on power generation and transmission system are prospected, which provides ideas and directions for the robust optimization planning follow-up research on power generation and transmission system. © 2022, Electric Power Automation Equipment Press. All right reserved.
引用
收藏
页码:79 / 85
页数:6
相关论文
共 50 条
  • [41] Resource Allocation Strategy for Virtualized Wireless Sensor Networks Based on Actor-Critic
    Li, Changjin
    Zhou, Guangxu
    Guo, Yue
    Hou, Junfeng
    Zhang, Hongjun
    Li, Song
    [J]. 2022 IEEE 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING AND COMMUNICATIONS, IUCC/CIT/DSCI/SMARTCNS, 2022, : 132 - 139
  • [42] Soft-Robust Actor-Critic Policy-Gradient
    Derman, Esther
    Mankowitz, Daniel J.
    Mann, Timothy A.
    Mannor, Shie
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2018, : 208 - 218
  • [43] Actor-Critic based Improper Reinforcement Learning
    Zaki, Mohammadi
    Mohan, Avinash
    Gopalan, Aditya
    Mannor, Shie
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [44] Stepwise Soft Actor-Critic for UAV Autonomous Flight Control
    Hwang, Ha Jun
    Jang, Jaeyeon
    Choi, Jongkwan
    Bae, Jung Ho
    Kim, Sung Ho
    Kim, Chang Ouk
    [J]. DRONES, 2023, 7 (09)
  • [45] Enhancing Autonomous Driving Navigation Using Soft Actor-Critic
    Elallid, Badr Ben
    Benamar, Nabil
    Bagaa, Miloud
    Hadjadj-Aoul, Yassine
    [J]. FUTURE INTERNET, 2024, 16 (07)
  • [46] Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy
    Xi, Lei
    Wu, Junnan
    Xu, Yanchun
    Sun, Hongbin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2483 - 2493
  • [47] Online Virtual Training in Soft Actor-Critic for Autonomous Driving
    Savari, Maryam
    Choe, Yoonsuck
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [48] A Proposed Priority Pushing and Grasping Strategy Based on an Improved Actor-Critic Algorithm
    You, Tianya
    Wu, Hao
    Xu, Xiangrong
    Petrovic, Petar B.
    Rodic, Aleksandar
    [J]. ELECTRONICS, 2022, 11 (13)
  • [49] GRU-integrated constrained soft actor-critic learning enabled fully distributed scheduling strategy for residential virtual power plant
    Deng, Xiaoyun
    Chen, Yongdong
    Fan, Dongchuan
    Liu, Youbo
    Ma, Chao
    [J]. GLOBAL ENERGY INTERCONNECTION-CHINA, 2024, 7 (02): : 117 - 129
  • [50] GRU-integrated constrained soft actor-critic learning enabled fully distributed scheduling strategy for residential virtual power plant
    Xiaoyun Deng
    Yongdong Chen
    Dongchuan Fan
    Youbo Liu
    Chao Ma
    [J]. Global Energy Interconnection, 2024, 7 (02) : 117 - 129