Reinforcement learning based PID controller design for LFC in a microgrid

被引:18
|
作者
Esmaeili, Mehran [1 ]
Shayeghi, Hossein [1 ]
Nejad, Hamid Mohammad [1 ]
Younesi, Abdollah [1 ]
机构
[1] Univ Mohaghegh Ardabili, Tech Engn Dept, Ardebil, Iran
关键词
Design optimization; Control theory; Adaptive fuzzy logic control; Electrical power systems; Microgrid; Reinforcement learning; FREQUENCY CONTROL; ENERGY; SYSTEM;
D O I
10.1108/COMPEL-09-2016-0408
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Purpose - This paper aims to propose an improved reinforcement learning-based fuzzy-PID controller for load frequency control (LFC) of an island microgrid. Design/methodology/approach - To evaluate the performance of the proposed controller, three different types of controllers including optimal proportional-integral-derivative (PID) controller, optimal fuzzy PID controller and the proposed reinforcement learning-based fuzzy-PID controller are compared. Optimal PID controller and classic fuzzy-PID controller parameters are tuned using Non-dominated Sorting Genetic Algorithm-II algorithm to minimize overshoot, settling time and integral square error over a wide range of load variations. The simulations are carried out usingMATLAB/SIMULINK package. Findings - Simulation results indicated the superiority of the proposed reinforcement learning-based controller over fuzzy-PID and optimal-PID controllers in the same operational conditions. Originality/value - In this paper, an improved reinforcement learning-based fuzzy-PID controller is proposed for LFC of an island microgrid. The main advantage of the reinforcement learning-based controllers is their hardiness behavior along with uncertainties and parameters variations. Also, they do not need any knowledge about the system under control; thus, they can control any large system with high nonlinearities.
引用
收藏
页码:1287 / 1297
页数:11
相关论文
共 50 条
  • [21] Design of ATM congestion controller based on reinforcement learning method
    Li Xin
    Jing Yuan-Wei
    [J]. Proceedings of the 2007 Chinese Control and Decision Conference, 2007, : 673 - 676
  • [22] Reinforcement Learning Based Multi-agent LFC Design Concerning the Integration of Wind Farms
    Bevrani, H.
    Daneshfar, F.
    Daneshmand, P. R.
    Hiyama, T.
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON CONTROL APPLICATIONS, 2010, : 567 - 571
  • [23] Design of robot fuzzy logic controller based on reinforcement learning
    Duan, Yong
    Liu, Xin-Gang
    Xu, Xin-He
    [J]. Xitong Fangzhen Xuebao / Journal of System Simulation, 2006, 18 (06): : 1597 - 1600
  • [24] Opposition-based discrete action reinforcement learning automata algorithm case study: optimal design of a PID controller
    Pour, Fatemeh Mohseni
    Gharaveisi, Ali Akbar
    [J]. TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2013, 21 (06) : 1603 - 1614
  • [25] Combination continuous action reinforcement learning automata & PSO for design of PID controller for AVR system
    Hashemi, F.
    Mohammadi, M.
    [J]. International Journal of Engineering, Transactions A: Basics, 2015, 28 (01): : 54 - 61
  • [26] Combination of Continuous Action Reinforcement Learning Automata and PSO to Design a PID Controller for AVR System
    Hashemi, F.
    Mohammadi, M.
    [J]. INTERNATIONAL JOURNAL OF ENGINEERING, 2015, 28 (01): : 52 - 59
  • [27] PID controller design based on memductor
    Sanchez-Lopez, C.
    Carbajal-Gomez, V. H.
    Carrasco-Aguilar, M. A.
    Morales-Lopez, F. E.
    [J]. AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2019, 101 : 9 - 14
  • [28] Constrained Intelligent Frequency Control in an AC Microgrid: An Online Reinforcement Learning Based PID Tuning Approach
    Nosrati, K.
    Tepljakov, A.
    Petlenkov, E.
    Skiparev, V.
    Belikov, J.
    Levron, Y.
    [J]. 2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,
  • [29] Design of Reinforcement Learning based PI controller for nonlinear Multivariable System
    Kumar, Kranthi P.
    Detroja, Ketan P.
    [J]. 2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [30] Controller Design of Tracking WMR System Based on Deep Reinforcement Learning
    Lee, Chin-Tan
    Sung, Wen-Tsai
    [J]. ELECTRONICS, 2022, 11 (06)