MARLA-SG: Multi-Agent Reinforcement Learning Algorithm for Efficient Demand Response in Smart Grid

被引:24
|
作者
Aladdin, Sally [1 ]
El-Tantawy, Samah [2 ]
Fouda, Mostafa M. [1 ,3 ]
Tag Eldien, Adly S. [1 ]
机构
[1] Benha Univ, Fac Engn Shoubra, Dept Elect Engn, Cairo 11629, Egypt
[2] Cairo Univ, Fac Engn, Dept Engn Math & Phys, Giza 12613, Egypt
[3] Idaho State Univ, Coll Sci & Engn, Dept Elect & Comp Engn, Pocatello, ID 83209 USA
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Smart grids; Task analysis; Reinforcement learning; Load management; Peak to average power ratio; Smart meters; Delays; Smart grid; demand response; reinforcement learning; Q-learning; SARSA (State Action Reward State Action); ENERGY-STORAGE; ELECTRICITY;
D O I
10.1109/ACCESS.2020.3038863
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The population is sharply growing in the last decade, resulting in non-potential power requests in dense urban areas, especially with the traditional power grid where the system is not compatible with the infrequent changes. Smart grids have shown strong potential to effectively mitigate and smooth power consumption curves to avoid shortages by adjusting and forecasting the cost function in real-time in response to consumption fluctuations to achieve the desired objectives. The main challenge for the smart grid designers is to reduce the cost and Peak to Average Ratio (PAR) while maintaining the desired satisfaction level. This article presents the development and evaluation of a Multi-Agent Reinforcement Learning Algorithm for efficient demand response in Smart Grid (MARLA-SG). Also, it shows a simple and flexible way of choosing state elements to reduce the possible number of states, regardless of the device type, range of operation, and maximum allowable delay. It also produces a simple way to represent the reward function regardless of the used cost function. SARSA (State-Action-Reward-State-Action) and Q-learning schemes are used and attained PAR reduction of 9.6%, 12.16%, and an average cost reduction of 10.2%, 7.8%, respectively.
引用
收藏
页码:210626 / 210639
页数:14
相关论文
共 50 条
  • [21] A review of the applications of multi-agent reinforcement learning in smart factories
    Bahrpeyma, Fouad
    Reichelt, Dirk
    [J]. FRONTIERS IN ROBOTICS AND AI, 2022, 9
  • [22] Multi-Agent Reinforcement Learning
    Stankovic, Milos
    [J]. 2016 13TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2016, : 43 - 43
  • [23] Correction to: Multi-agent reinforcement learning for fast-timescale demand response of residential loads
    Vincent Mai
    Philippe Maisonneuve
    Tianyu Zhang
    Hadi Nekoei
    Liam Paull
    Antoine Lesage-Landry
    [J]. Machine Learning, 2024, 113 : 3355 - 3355
  • [24] Efficient Adversarial Attacks on Online Multi-agent Reinforcement Learning
    Liu, Guanlin
    Lai, Lifeng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [25] Determining the Applicability of Advice for Efficient Multi-Agent Reinforcement Learning
    Wang, Yuchen
    Ren, Fenghui
    Zhang, Minjie
    [J]. PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2018, 11013 : 343 - 351
  • [26] A Multi-agent Reinforcement Learning Algorithm Based on Stackelberg Game
    Cheng, Chi
    Zhu, Zhangqing
    Xin, Bo
    Chen, Chunlin
    [J]. 2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 727 - 732
  • [27] Multi-Agent Reinforcement Learning Algorithm Based on Action Prediction
    童亮
    陆际联
    [J]. Journal of Beijing Institute of Technology, 2006, (02) : 133 - 137
  • [28] Multi-agent reinforcement learning algorithm based on neural networks
    Tang, Lianggui
    Yang, Hu
    An, Bo
    Cheng, Daijie
    [J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 1569 - 1574
  • [29] A Sample Efficient Multi-Agent Approach to Continuous Reinforcement Learning
    Corcoran, Diarmuid
    Kreuger, Per
    Boman, Magnus
    [J]. 2022 18TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM 2022): INTELLIGENT MANAGEMENT OF DISRUPTIVE NETWORK TECHNOLOGIES AND SERVICES, 2022, : 338 - 344
  • [30] Efficient Communications in Multi-Agent Reinforcement Learning for Mobile Applications
    Lv, Zefang
    Xiao, Liang
    Du, Yousong
    Zhu, Yunjun
    Han, Shuai
    Liu, Yong-Jin
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 12440 - 12454