Reinforcement learning based PID controller design for LFC in a microgrid

被引:18
|
作者
Esmaeili, Mehran [1 ]
Shayeghi, Hossein [1 ]
Nejad, Hamid Mohammad [1 ]
Younesi, Abdollah [1 ]
机构
[1] Univ Mohaghegh Ardabili, Tech Engn Dept, Ardebil, Iran
关键词
Design optimization; Control theory; Adaptive fuzzy logic control; Electrical power systems; Microgrid; Reinforcement learning; FREQUENCY CONTROL; ENERGY; SYSTEM;
D O I
10.1108/COMPEL-09-2016-0408
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Purpose - This paper aims to propose an improved reinforcement learning-based fuzzy-PID controller for load frequency control (LFC) of an island microgrid. Design/methodology/approach - To evaluate the performance of the proposed controller, three different types of controllers including optimal proportional-integral-derivative (PID) controller, optimal fuzzy PID controller and the proposed reinforcement learning-based fuzzy-PID controller are compared. Optimal PID controller and classic fuzzy-PID controller parameters are tuned using Non-dominated Sorting Genetic Algorithm-II algorithm to minimize overshoot, settling time and integral square error over a wide range of load variations. The simulations are carried out usingMATLAB/SIMULINK package. Findings - Simulation results indicated the superiority of the proposed reinforcement learning-based controller over fuzzy-PID and optimal-PID controllers in the same operational conditions. Originality/value - In this paper, an improved reinforcement learning-based fuzzy-PID controller is proposed for LFC of an island microgrid. The main advantage of the reinforcement learning-based controllers is their hardiness behavior along with uncertainties and parameters variations. Also, they do not need any knowledge about the system under control; thus, they can control any large system with high nonlinearities.
引用
收藏
页码:1287 / 1297
页数:11
相关论文
共 50 条
  • [41] GA based PID controller: Design and Optimization
    Inthiyaz, Syed
    Nalli, Rajesh
    Rakesh, T.
    Subbarao, K.
    Ahammad, Sk Hasane
    Rajesh, V
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT 2021), 2021, : 285 - 289
  • [42] Design of Digital PID Controller Based on FPGA
    Xie, Shi-kui
    Ji, Sheng-nan
    Wu, Jie-tao
    Li, Pei-gang
    Li, Chao-rong
    [J]. INTERNATIONAL CONFERENCE ON MATERIAL SCIENCE AND CIVIL ENGINEERING, MSCE 2016, 2016, : 375 - 380
  • [43] Design and synthesis of PID controller based on fuzzy
    Islam, M. D. Shabiul
    Amin, Nowshad
    Zaman, Mukter
    Bhuyan, M. S.
    [J]. PROCEEDINGS OF THE WSEAS INTERNATIONAL CONFERENCE ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING: SELECTED TOPICS ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING, 2007, : 310 - +
  • [44] Reinforcement Learning NN-based Controller Design for Aero-engine
    Zhang, Hong-Mei
    Liang, Yu-Ling
    Xu, Guang-Yan
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING, 2015, 17 : 138 - 145
  • [45] Q-value based genetic reinforcement learning for fuzzy controller design
    Juang, CF
    [J]. PROCEEDINGS OF THE 12TH IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1 AND 2, 2003, : 185 - 189
  • [46] MACS: Deep Reinforcement Learning based SDN Controller Synchronization Policy Design
    Zhang, Ziyao
    Ma, Liang
    Poularakis, Konstantinos
    Leung, Kin K.
    Tucker, Jeremy
    Swami, Ananthram
    [J]. 2019 IEEE 27TH INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (IEEE ICNP), 2019,
  • [47] Transient Controller Design Based on Reinforcement Learning for a Turbofan Engine with Actuator Dynamics
    Miao, Keqiang
    Wang, Xi
    Zhu, Meiyin
    Yang, Shubo
    Pei, Xitong
    Jiang, Zhen
    [J]. SYMMETRY-BASEL, 2022, 14 (04):
  • [48] A Neural Network Based Automatic Generation Controller Design through Reinforcement Learning
    Ahamed, Imthias T. P.
    Rao, Nagendra P. S.
    Sastry, P. S.
    [J]. INTERNATIONAL JOURNAL OF EMERGING ELECTRIC POWER SYSTEMS, 2006, 6 (01):
  • [49] Determination of control area and design of fuzzy rule-tuned PID controller for LFC of multimachine power system
    Biswas, Jyotirmoy
    Bera, Parthasarathi
    Chakrabarty, Krishnendu
    [J]. ELECTRIC POWER SYSTEMS RESEARCH, 2023, 221
  • [50] Application of Invasive Weed Optimization Algorithm to Optimally Design Multi-Staged PID Controller for LFC Analysis
    Patel, Nimai Charan
    Debnath, Manoj Kumar
    Sahu, Binod Kumar
    Dash, Subhransu Sekhar
    Bayindir, Ramazan
    [J]. INTERNATIONAL JOURNAL OF RENEWABLE ENERGY RESEARCH, 2019, 9 (01): : 470 - 479