A Deep Reinforcement Learning Bidding Algorithm on Electricity Market

被引:0
|
作者
JIA Shuai [1 ]
GAN Zhongxue [2 ]
XI Yugeng [1 ]
LI Dewei [1 ]
XUE Shibei [1 ]
WANG Limin [3 ]
机构
[1] Department of Automation,Key Laboratory of System Control and Information Processing,Shanghai Jiao Tong University
[2] State Key Laboratory of Coal-based Low-carbon Energy,ENN Science and Technology Development Co.,Ltd.
[3] ENN Energy Power Technology Shanghai Co.,Ltd.
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
F426.61 [];
学科分类号
0202 ; 020205 ;
摘要
In this paper,we design a new bidding algorithm by employing a deep reinforcement learning approach.Firms use the proposed algorithm to estimate conjectural variation of the other firms and then employ this variable to generate the optimal bidding strategy so as to pursue maximal profits.With this algorithm,electricity generation firms can improve the accuracy of conjectural variations of competitors by dynamically learning in an electricity market with incomplete information.Electricity market will reach an equilibrium point when electricity firms adopt the proposed bidding algorithm for a repeated game of power trading.The simulation examples illustrate the overall energy efficiency of power network will increase by 9.90% as the market clearing price decreasing when all companies use the algorithm.The simulation examples also show that the power demand elasticity has a positive effect on the convergence of learning process.
引用
收藏
页码:1125 / 1134
页数:10
相关论文
共 50 条
  • [1] A Deep Reinforcement Learning Bidding Algorithm on Electricity Market
    Jia, Shuai
    Gan, Zhongxue
    Xi, Yugeng
    Li, Dewei
    Xue, Shibei
    Wang, Limin
    [J]. JOURNAL OF THERMAL SCIENCE, 2020, 29 (05) : 1125 - 1134
  • [2] A Deep Reinforcement Learning Bidding Algorithm on Electricity Market
    Shuai Jia
    Zhongxue Gan
    Yugeng Xi
    Dewei Li
    Shibei Xue
    Limin Wang
    [J]. Journal of Thermal Science, 2020, 29 : 1125 - 1134
  • [3] Deep Reinforcement Learning for Strategic Bidding in Electricity Markets
    Ye, Yujian
    Qiu, Dawei
    Sun, Mingyang
    Papadaskalopoulos, Dimitrios
    Strbac, Goran
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (02) : 1343 - 1355
  • [4] Deep Reinforcement Learning for Strategic Bidding in Electricity Markets
    Ye, Yujian
    Qiu, Dawei
    Sun, Mingyang
    Papadaskalopoulos, Dimitrios
    Strbac, Goran
    [J]. 2020 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2020,
  • [5] Deep Reinforcement Learning for Virtual Bidding in Electricity Markets
    Han D.
    Huang W.
    Yan Z.
    [J]. Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (04): : 1443 - 1454
  • [6] Strategic Bidding of Price-quantity Pairs in Electricity Market Based on Deep Reinforcement Learning
    Xu, Dan
    Hu, Xiaojing
    Hu, Fei
    Zha, Yuchen
    Zhang, Changshun
    Yu, Yaowen
    Zhao, Yong
    [J]. Dianwang Jishu/Power System Technology, 2024, 48 (08): : 3278 - 3286
  • [7] Deep reinforcement learning-based prosumer aggregation bidding strategy in a hierarchical local electricity market
    Zhang, Haoyang
    Kok, Koen
    Paterakis, Nikolaos G.
    [J]. 2023 ASIA MEETING ON ENVIRONMENT AND ELECTRICAL ENGINEERING, EEE-AM, 2023,
  • [8] A deep reinforcement learning framework for continuous intraday market bidding
    Boukas, Ioannis
    Ernst, Damien
    Theate, Thibaut
    Bolland, Adrien
    Huynen, Alexandre
    Buchwald, Martin
    Wynants, Christelle
    Cornelusse, Bertrand
    [J]. MACHINE LEARNING, 2021, 110 (09) : 2335 - 2387
  • [9] A deep reinforcement learning framework for continuous intraday market bidding
    Ioannis Boukas
    Damien Ernst
    Thibaut Théate
    Adrien Bolland
    Alexandre Huynen
    Martin Buchwald
    Christelle Wynants
    Bertrand Cornélusse
    [J]. Machine Learning, 2021, 110 : 2335 - 2387
  • [10] Finding Nash equilibrium based on reinforcement learning for bidding strategy and distributed algorithm for ISO in imperfect electricity market
    Yu, Liying
    Wang, Peng
    Chen, Zhe
    Li, Dewen
    Li, Ning
    Cherkaoui, Rachid
    [J]. APPLIED ENERGY, 2023, 350