Damping control by fusion of reinforcement learning and control Lyapunov functions

被引:1
|
作者
Glavic, Mevludin [1 ]
Ernst, Damien [1 ]
Wehenkel, Louis [1 ]
机构
[1] Univ Liege, Dept Comp Sci & Elect Engn, Sart Tilman B28, B-4000 Liege, Belgium
关键词
reinforcement learning; control Lyapunov functions; power system damping control;
D O I
10.1109/NAPS.2006.359598
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The main idea behind the concept, proposed in the paper, is the opportunity to make control systems with increased capabilities by synergetic fusion of the domain-specific knowledge and the methodologies from control theory and artificial intelligence. The particular approach considered combines Control Lyapunov Functions (CLF), a constructive control technique, and Reinforcement Learning (RL) in attempt to optimize a mix of system stability and performance. Two control schemes are proposed and the capabilities of the resulting controllers are illustrated on a control problem involving a Thyristor Controlled Series Capacitor (TCSC) for damping oscillations in a four-machine power system.
引用
下载
收藏
页码:361 / +
页数:2
相关论文
共 50 条
  • [1] Reinforcement Learning for Safe Robot Control using Control Lyapunov Barrier Functions
    Du, Desong
    Han, Shaohang
    Qi, Naiming
    Ammar, Haitham Bou
    Wang, Jun
    Pan, Wei
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9442 - 9448
  • [2] Reinforcement Learning for Safety-Critical Control under Model Uncertainty, using Control Lyapunov Functions and Control Barrier Functions
    Choi, Jason
    Castaneda, Fernando
    Tomlin, Claire J.
    Sreenath, Koushil
    ROBOTICS: SCIENCE AND SYSTEMS XVI, 2020,
  • [3] Construction of control Lyapunov functions for damping stabilization of control affine systems
    Hudon, N.
    Guay, M.
    SYSTEMS & CONTROL LETTERS, 2013, 62 (11) : 1009 - 1017
  • [4] Construction of Control Lyapunov Functions for Damping Stabilization of Control Affine Systems
    Hudon, N.
    Guay, M.
    PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 8008 - 8013
  • [5] Nonlinear Control System with Reinforcement Learning and Neural Networks Based Lyapunov Functions
    Rego, Rosana Cibely Batista
    Araujo, Fabio Meneghetti Ugulino de
    IEEE LATIN AMERICA TRANSACTIONS, 2021, 19 (08) : 1253 - 1260
  • [6] Inverse Reinforcement Learning: A Control Lyapunov Approach
    Tesfazgi, Samuel
    Lederer, Armin
    Hirche, Sandra
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 3627 - 3632
  • [7] Safe Learning for Control using Control Lyapunov Functions and Control Barrier Functions: A Review
    Anand, Akhil
    Seel, Katrine
    Gjaerum, Vilde
    Hakansson, Anne
    Robinson, Haakon
    Saad, Aya
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KSE 2021), 2021, 192 : 3987 - 3997
  • [8] Linguistic Lyapunov reinforcement learning control for robotic manipulators
    Kumar, Abhishek
    Sharma, Rajneesh
    NEUROCOMPUTING, 2018, 272 : 84 - 95
  • [9] Reinforcement Learning for Optimal Primary Frequency Control: A Lyapunov Approach
    Cui, Wenqi
    Jiang, Yan
    Zhang, Baosen
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (02) : 1676 - 1688
  • [10] Learning control lyapunov functions from counterexamples and demonstrations
    Ravanbakhsh, Hadi
    Sankaranarayanan, Sriram
    AUTONOMOUS ROBOTS, 2019, 43 (02) : 275 - 307