Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

被引:3
|
作者
Ding, Yongkang [1 ]
Chen, Xinjiang [1 ]
Wang, Jianxiao [2 ]
机构
[1] Peking Univ, Dept Ind Engn & Management, Beijing 100871, Peoples R China
[2] Peking Univ, Natl Engn Lab Big Data Anal & Applicat, Beijing 100871, Peoples R China
来源
BATTERIES-BASEL | 2023年 / 9卷 / 04期
基金
中国国家自然科学基金;
关键词
renewable energy; battery energy storage system; machine learning; deep reinforcement learning; data-driven optimization; cost minimization; TRANSPORTATION; MANAGEMENT;
D O I
10.3390/batteries9040219
中图分类号
O646 [电化学、电解、磁化学];
学科分类号
081704 ;
摘要
The joint optimization of power systems, mobile energy storage systems (MESSs), and renewable energy involves complex constraints and numerous decision variables, and it is difficult to achieve optimization quickly through the use of commercial solvers, such as Gurobi and Cplex. To address this challenge, we present an effective joint optimization approach for MESSs and power grids that consider various renewable energy sources, including wind power (WP), photovoltaic (PV) power, and hydropower. The integration of MESSs could alleviate congestion, minimize renewable energy waste, fulfill unexpected energy demands, and lower the operational costs for power networks. To model the entire system, a mixed-integer programming (MIP) model was proposed that considered both the MESSs and the power grid, with the goal of minimizing costs. Furthermore, this research proposed a highly efficient deep reinforcement learning (DRL)-based method to optimize route selection and charging/discharging operations. The efficacy of the proposed method was demonstrated through many numerical simulations.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Reinforcement learning-based optimization for power scheduling in a renewable energy connected grid
    Ebrie, Awol Seid
    Kim, Young Jin
    [J]. RENEWABLE ENERGY, 2024, 230
  • [2] Operation strategy optimization of combined cooling, heating, and power systems with energy storage and renewable energy based on deep reinforcement learning
    Ruan, Yingjun
    Liang, Zhenyu
    Qian, Fanyue
    Meng, Hua
    Gao, Yuan
    [J]. JOURNAL OF BUILDING ENGINEERING, 2023, 65
  • [3] A Deep Learning-Based Approach to Optimize Power Systems with Hybrid Renewable Energy Sources
    Dhandapani, Lakshmi
    Shinde, Sagar Bhilaji
    Wadhwa, Lalitkumar
    Hariramakrishnan, Perumal
    Padmaja, Suragani Mohini
    Gurusamy, Meena Devi
    Venkatarao, Malini Kalale
    Razia, Shaik
    [J]. ELECTRIC POWER COMPONENTS AND SYSTEMS, 2023, 51 (16) : 1740 - 1755
  • [4] Deep-Learning-Based Joint Optimization of Renewable Energy Storage and Routing in Vehicular Energy Network
    Fu, Tingting
    Wang, Chaoyu
    Cheng, Nan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6229 - 6241
  • [5] Deep learning-based correlation analysis for probabilistic power flow considering renewable energy and energy storage
    Xia, Xiaotian
    Xiao, Liye
    Ye, Hua
    [J]. FRONTIERS IN ENERGY RESEARCH, 2024, 12
  • [6] Distributed Reinforcement Learning Framework for Autonomous Optimization of Grid-Scale Energy Storage Systems in Renewable Energy Integration
    Nuvvula, Ramakrishna S. S.
    Kumar, Polamarasetty P.
    Ahammed, Syed Riyaz
    Hushein, R.
    Reddy, R. Siva Subramanyam
    Babu, Bachina Harish
    Ali, Ahmed
    [J]. 12TH INTERNATIONAL CONFERENCE ON SMART GRID, ICSMARTGRID 2024, 2024, : 290 - 297
  • [7] Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning
    Pinciroli, Luca
    Baraldi, Piero
    Ballabio, Guido
    Compare, Michele
    Zio, Enrico
    [J]. RENEWABLE ENERGY, 2022, 183 : 752 - 763
  • [8] Microgrid control for renewable energy sources based on deep reinforcement learning and numerical optimization approaches
    Zhadan, A. Yu
    Wu, H.
    Kudin, P. S.
    Zhang, Y.
    Petrosian, O. L.
    [J]. VESTNIK SANKT-PETERBURGSKOGO UNIVERSITETA SERIYA 10 PRIKLADNAYA MATEMATIKA INFORMATIKA PROTSESSY UPRAVLENIYA, 2023, 19 (03): : 391 - 402
  • [9] Frequency stability of the Israeli power grid with high penetration of renewable sources and energy storage systems
    Ben Yosef, Gefen
    Navon, Aviad
    Poliak, Olga
    Etzion, Naomi
    Gal, Nurit
    Belikov, Juri
    Levron, Yoash
    [J]. ENERGY REPORTS, 2021, 7 : 6148 - 6161
  • [10] Energy Trading in Smart Grid: A Deep Reinforcement Learning-based Approach
    Zhang, Feiye
    Yang, Qingyu
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 3677 - 3682