Dynamic customer demand management: A reinforcement learning model based on real-time pricing and incentives

被引:5
|
作者
Salazar, Eduardo J. [1 ,2 ]
Samper, Mauricio E. [1 ,2 ]
Patino, Daniel [3 ]
机构
[1] Natl Univ San Juan UNSJ, Inst Elect Energy IEE, San Juan, Argentina
[2] Natl Sci & Tech Res Council CONICET, San Juan, Argentina
[3] Natl Univ San Juan UNSJ, Inst Automat, Fac Engn, San Juan, Argentina
关键词
Price-based demand response; Incentive-based demand response; Reinforcement Q-learning; K-Means algorithm;
D O I
10.1016/j.ref.2023.05.004
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The demand response model proposed in this work offers a game-changing solution to the challenges posed by the unpredictability of renewable energy sources. By combining both pricing and incentives, this model significantly improves the accuracy of demand response strategies, leading to more effective modulation of customer demand. The real-time and time-of-use pricing options presented to customers incentivize them to actively increase or decrease their energy consumption, thereby contributing to the stability of the energy grid. This work also sheds light on the crucial role that characteristic parameters such as the internal or external coincidence factor play in the classification of customers using the k-means algorithm. The reinforcement learning method used in the model not only optimizes prices and incentives, but also ensures that both customers and energy distribution companies benefit equally. A sensitivity analysis of customer elasticity highlights the dynamic interplay between clustering and reinforcement learning algorithms and customer behavior, demonstrating the power and effectiveness of this model. With its innovative approach and cutting-edge techniques, this work sets a new model for demand response and makes a compelling case for the inclusion of prices and incentives in future models. (C) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:39 / 56
页数:18
相关论文
共 50 条
  • [1] Dynamic pricing with real-time demand learning
    Lin, Kyle Y.
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2006, 174 (01) : 522 - 538
  • [2] Energy Management of Networked Microgrids With Real-Time Pricing by Reinforcement Learning
    Cui, Gaochen
    Jia, Qing-Shan
    Guan, Xiaohong
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (01) : 570 - 580
  • [3] Learning Dynamical Demand Response Model in Real-Time Pricing Program
    Xu, Hanchen
    Sun, Hongbo
    Nikovski, Daniel
    Kitamura, Shoichi
    Mori, Kazuyuki
    [J]. 2019 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2019,
  • [4] Real-time dynamic pricing in a non-stationary environment using model-free reinforcement learning
    Rana, Rupal
    Oliveira, Fernando S.
    [J]. OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 2014, 47 : 116 - 126
  • [5] Dynamic Incentive Pricing on Charging Stations for Real-Time Congestion Management in Distribution Network: An Adaptive Model-Based Safe Deep Reinforcement Learning Method
    Yang, Hongrong
    Xu, Yinliang
    Guo, Qinglai
    [J]. IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2024, 15 (02) : 1100 - 1113
  • [6] Based Real-time Supply Chain Management Dynamic Pricing Model in E-commerce
    Wang, Wenxing
    Sun, Shuying
    [J]. SEVENTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS I-III: UNLOCKING THE FULL POTENTIAL OF GLOBAL TECHNOLOGY, 2008, : 705 - 711
  • [7] Real-Time Demand Response Management for Controlling Load Using Deep Reinforcement Learning
    Zhao, Yongjiang
    Yoo, Jae Hung
    Lim, Chang Gyoon
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5671 - 5686
  • [8] Dynamic Residential Energy Management for Real-Time Pricing
    Yao, Leehter
    Hashim, Fazida Hanim
    Lai, Chien-Chi
    [J]. ENERGIES, 2020, 13 (10)
  • [9] Dynamic Vehicle Routing Problem Based on Real-Time Traffic Information and Customer Demand
    Du, Xiangqun
    Hu, Dawei
    Xu, Jie
    [J]. CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 4892 - 4902
  • [10] A hybrid demand response mechanism based on real-time incentive and real-time pricing
    Xu, Bo
    Wang, Jiexin
    Guo, Mengyuan
    Lu, Jiayu
    Li, Gehui
    Han, Liang
    [J]. ENERGY, 2021, 231