Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

被引:3
|
作者
Ding, Yongkang [1 ]
Chen, Xinjiang [1 ]
Wang, Jianxiao [2 ]
机构
[1] Peking Univ, Dept Ind Engn & Management, Beijing 100871, Peoples R China
[2] Peking Univ, Natl Engn Lab Big Data Anal & Applicat, Beijing 100871, Peoples R China
来源
BATTERIES-BASEL | 2023年 / 9卷 / 04期
基金
中国国家自然科学基金;
关键词
renewable energy; battery energy storage system; machine learning; deep reinforcement learning; data-driven optimization; cost minimization; TRANSPORTATION; MANAGEMENT;
D O I
10.3390/batteries9040219
中图分类号
O646 [电化学、电解、磁化学];
学科分类号
081704 ;
摘要
The joint optimization of power systems, mobile energy storage systems (MESSs), and renewable energy involves complex constraints and numerous decision variables, and it is difficult to achieve optimization quickly through the use of commercial solvers, such as Gurobi and Cplex. To address this challenge, we present an effective joint optimization approach for MESSs and power grids that consider various renewable energy sources, including wind power (WP), photovoltaic (PV) power, and hydropower. The integration of MESSs could alleviate congestion, minimize renewable energy waste, fulfill unexpected energy demands, and lower the operational costs for power networks. To model the entire system, a mixed-integer programming (MIP) model was proposed that considered both the MESSs and the power grid, with the goal of minimizing costs. Furthermore, this research proposed a highly efficient deep reinforcement learning (DRL)-based method to optimize route selection and charging/discharging operations. The efficacy of the proposed method was demonstrated through many numerical simulations.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Energy Storage Scheduling Optimization Strategy Based on Deep Reinforcement Learning
    Hou, Shixi
    Han, Jienan
    Liu, Xiangjiang
    Guo, Ruoshan
    Chu, Yundi
    [J]. ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 33 - 44
  • [22] Optimal planning of hybrid energy storage systems using curtailed renewable energy through deep reinforcement learning
    Kang, Dongju
    Kang, Doeun
    Hwangbo, Sumin
    Niaz, Haider
    Lee, Won Bo
    Liu, J. Jay
    Na, Jonggeol
    [J]. ENERGY, 2023, 284
  • [23] Confidence Estimation Transformer for Long-Term Renewable Energy Forecasting in Reinforcement Learning-based Power Grid Dispatching
    Li, Xinhang
    Yang, Nan
    Li, Zihao
    Huang, Yupeng
    Yuan, Zheng
    Song, Xuri
    Li, Lei
    Zhang, Lin
    [J]. CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2024, 10 (04): : 1502 - 1513
  • [24] Deep reinforcement learning-based optimal scheduling of integrated energy systems for electricity, heat, and hydrogen storage
    Liang, Tao
    Zhang, Xiaochan
    Tan, Jianxin
    Jing, Yanwei
    Liangnian, Lv
    [J]. ELECTRIC POWER SYSTEMS RESEARCH, 2024, 233
  • [25] Optimization of energy storage systems for integration of renewable energy sources - A bibliometric analysis
    Tahir, Hira
    [J]. JOURNAL OF ENERGY STORAGE, 2024, 94
  • [26] Deep Reinforcement Learning-based Energy Efficiency Optimization For Flying LoRa Gateways
    Jouhari, Mohammed
    Ibrahimi, Khalil
    Ben Othman, Jalel
    Amhoud, El Mehdi
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 6157 - 6162
  • [27] Superconducting Magnetic Energy Storage (SMES) in Power Systems with Renewable Energy Sources
    Nielsen, Knut Erik
    Molinas, Marta
    [J]. IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE 2010), 2010, : 2487 - 2492
  • [28] Deep reinforcement learning-based approach for optimizing energy conversion in integrated electrical and heating system with renewable energy
    Zhang, Bin
    Hu, Weihao
    Cao, Di
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2019, 202
  • [29] A Distributed Fault Protection Method for Power Grid with High Penetration of Renewable Energy Sources
    Dustegor, D.
    El Mezyani, T.
    Srivastava, S. K.
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2011,
  • [30] Operational optimization for off-grid renewable building energy system using deep reinforcement learning
    Gao, Yuan
    Matsunami, Yuki
    Miyata, Shohei
    Akashi, Yasunori
    [J]. APPLIED ENERGY, 2022, 325