Modeling market trading strategies of the intermediary entity for microgrids: A reinforcement learning-based approach

被引:3
|
作者
Ghanbari, Sanaz [1 ]
Bahramara, Salah [2 ]
Golpira, Hemin [1 ]
机构
[1] Univ Kurdistan, Dept Elect & Comp Engn, Power Syst Modeling & Simulat Lab, Sanandaj 6617715175, Kurdistan, Iran
[2] Islamic Azad Univ, Dept Elect Engn, Sanandaj Branch, Sanandaj, Iran
关键词
Energy management; Intermediary entity; Monte Carlo method; Multi-microgrid; Reinforcement learning; ENERGY MANAGEMENT; STORAGE; INTERNET; SYSTEM;
D O I
10.1016/j.epsr.2023.109989
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Participation of a large number of microgrids (MGs) in the energy markets faces several challenges. To address these challenges, MGs can be aggregated by an Intermediary entity (IE). In this paper, a new decision-making framework is proposed to solve the energy management problem of multiple MGs and their participation in the energy market through the IE. This framework has three main functions. First, energy price forecasting is conducted using the long short-term memory (LSTM) recurrent neural networks method. Then, the power exchange of the MGs with the main grid is optimized by solving their energy management problem. In this stage, the integrated power exchanges of the MGs with the grid are determined based on the predicted prices. In the final function, the Monte Carlo reinforcement learning technique is employed to optimize real-time pricing decisions and identify potential obstacles that may affect proposed bid prices. This approach addresses energy management challenges and enables profitable energy trading in multiple MGs within energy markets, with confirmation supported by simulation results. The results show a maximum increment of 4.55% in the profit of the IE when purchasing energy and a 3.79% maximum increment when selling energy in the real-time market compared to day-ahead decisions, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [11] A Multifaceted Approach to Stock Market Trading Using Reinforcement Learning
    Ansari, Yasmeen
    Gillani, Saira
    Bukhari, Maryam
    Lee, Byeongcheon
    Maqsood, Muazzam
    Rho, Seungmin
    IEEE ACCESS, 2024, 12 : 90041 - 90060
  • [12] Stock Trading Strategies Based on Deep Reinforcement Learning
    Li, Yawei
    Liu, Peipei
    Wang, Ze
    SCIENTIFIC PROGRAMMING, 2022, 2022
  • [13] A multi-agent virtual market model for generalization in reinforcement learning based trading strategies
    He, Fei-Fan
    Chen, Chiao-Ting
    Huang, Szu-Hao
    APPLIED SOFT COMPUTING, 2023, 134
  • [14] Integrated Demand Response in Multi-Energy Microgrids: A Deep Reinforcement Learning-Based Approach
    Xu, Chenhui
    Huang, Yunkai
    ENERGIES, 2023, 16 (12)
  • [15] Energy Trading Game for Microgrids Using Reinforcement Learning
    Xiao, Xingyu
    Dai, Canhuang
    Li, Yanda
    Zhou, Changhua
    Xiao, Liang
    GAME THEORY FOR NETWORKS (GAMENETS 2017), 2017, 212 : 131 - 140
  • [16] Reinforcement Learning-based Collective Entity Alignment with Adaptive Features
    Zeng, Weixin
    Zhao, Xiang
    Tang, Jiuyang
    Lin, Xuemin
    Groth, Paul
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2021, 39 (03)
  • [17] Machine learning-based quantitative trading strategies across different time intervals in the American market
    Wang, Yimeng
    Yan, Keyue
    QUANTITATIVE FINANCE AND ECONOMICS, 2023, 7 (04): : 569 - 594
  • [18] Novel Energy Trading System Based on Deep-Reinforcement Learning in Microgrids
    Lee, Seongwoo
    Seon, Joonho
    Kyeong, Chanuk
    Kim, Soohyun
    Sun, Youngghyu
    Kim, Jinyoung
    ENERGIES, 2021, 14 (17)
  • [19] A two-stage reinforcement learning-based approach for multi-entity task allocation☆
    Gong, Aicheng
    Yang, Kai
    Lyu, Jiafei
    Li, Xiu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 136
  • [20] Quantitative Trading on Stock Market Based on Deep Reinforcement Learning
    Wu, Jia
    Wang, Chen
    Xiong, Lidong
    Sun, Hongyong
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,