MARLA-SG: Multi-Agent Reinforcement Learning Algorithm for Efficient Demand Response in Smart Grid

被引:24
|
作者
Aladdin, Sally [1 ]
El-Tantawy, Samah [2 ]
Fouda, Mostafa M. [1 ,3 ]
Tag Eldien, Adly S. [1 ]
机构
[1] Benha Univ, Fac Engn Shoubra, Dept Elect Engn, Cairo 11629, Egypt
[2] Cairo Univ, Fac Engn, Dept Engn Math & Phys, Giza 12613, Egypt
[3] Idaho State Univ, Coll Sci & Engn, Dept Elect & Comp Engn, Pocatello, ID 83209 USA
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Smart grids; Task analysis; Reinforcement learning; Load management; Peak to average power ratio; Smart meters; Delays; Smart grid; demand response; reinforcement learning; Q-learning; SARSA (State Action Reward State Action); ENERGY-STORAGE; ELECTRICITY;
D O I
10.1109/ACCESS.2020.3038863
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The population is sharply growing in the last decade, resulting in non-potential power requests in dense urban areas, especially with the traditional power grid where the system is not compatible with the infrequent changes. Smart grids have shown strong potential to effectively mitigate and smooth power consumption curves to avoid shortages by adjusting and forecasting the cost function in real-time in response to consumption fluctuations to achieve the desired objectives. The main challenge for the smart grid designers is to reduce the cost and Peak to Average Ratio (PAR) while maintaining the desired satisfaction level. This article presents the development and evaluation of a Multi-Agent Reinforcement Learning Algorithm for efficient demand response in Smart Grid (MARLA-SG). Also, it shows a simple and flexible way of choosing state elements to reduce the possible number of states, regardless of the device type, range of operation, and maximum allowable delay. It also produces a simple way to represent the reward function regardless of the used cost function. SARSA (State-Action-Reward-State-Action) and Q-learning schemes are used and attained PAR reduction of 9.6%, 12.16%, and an average cost reduction of 10.2%, 7.8%, respectively.
引用
收藏
页码:210626 / 210639
页数:14
相关论文
共 50 条
  • [1] Multi-agent reinforcement learning for adaptive demand response in smart cities
    Vazquez-Canteli, Jose
    Detjeen, Thomas
    Henze, Gregor
    Kampf, Jerome
    Nagy, Zoltan
    [J]. CLIMATE RESILIENT CITIES - ENERGY EFFICIENCY & RENEWABLES IN THE DIGITAL ERA (CISBAT 2019), 2019, 1343
  • [2] Spectrum allocation algorithm based on multi-agent reinforcement learning in smart grid
    Yan, Feng
    Lin, Xiaowei
    Li, Zhenghao
    Xu, Xia
    Xia, Weiwei
    Shen, Lianfeng
    [J]. Tongxin Xuebao/Journal on Communications, 2023, 44 (09): : 12 - 24
  • [3] Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid
    Ding, Lifu
    Lin, Zhiyun
    Yan, Gangfeng
    [J]. IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 3529 - 3534
  • [4] Smart Grid for Industry Using Multi-Agent Reinforcement Learning
    Roesch, Martin
    Linder, Christian
    Zimmermann, Roland
    Rudolf, Andreas
    Hohmann, Andrea
    Reinhart, Gunther
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (19): : 1 - 20
  • [5] A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
    Lu, Renzhi
    Hong, Seung Ho
    Zhang, Xiongfeng
    [J]. APPLIED ENERGY, 2018, 220 : 220 - 230
  • [6] Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings*
    Xie, Jiahan
    Ajagekar, Akshay
    You, Fengqi
    [J]. APPLIED ENERGY, 2023, 342
  • [7] Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid
    Park, Keonwoo
    Moon, Ilkyeong
    [J]. APPLIED ENERGY, 2022, 328
  • [8] Multi-Agent Reinforcement Learning for Autonomous On Demand Vehicles
    Boyali, Ali
    Hashimoto, Naohisa
    John, Vijay
    Acarman, Tankut
    [J]. 2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1461 - 1468
  • [9] Multi-agent reinforcement learning algorithm to solve a partially-observable multi-agent problem in disaster response
    Lee, Hyun-Rok
    Lee, Taesik
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 291 (01) : 296 - 308
  • [10] An Online Learning Algorithm for Demand Response in Smart Grid
    Bahraini, Shahab
    Wong, Vincent W. S.
    Huang, Jianwei
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (05) : 4712 - 4725