Model-Free Event-Triggered Optimal Consensus Control of Multiple Euler-Lagrange Systems via Reinforcement Learning

被引:30
|
作者
Wang, Saiwei [1 ]
Jin, Xin [1 ]
Mao, Shuai [1 ]
Vasilakos, Athanasios V. [2 ,3 ,4 ]
Tang, Yang [1 ]
机构
[1] East China Univ Sci & Technol, Minist Educ, Key Lab Adv Control & Optimizat Chem Proc, Shanghai 200237, Peoples R China
[2] Univ Technol Sydney, Sch Elect & Data Engn, Ultimo, NSW 2007, Australia
[3] Fuzhou Univ, Dept Comp Sci & Technol, Fuzhou 350116, Peoples R China
[4] Lulea Univ Technol, Dept Comp Sci Elect & Space Engn, S-97187 Lulea, Sweden
基金
中国国家自然科学基金;
关键词
Mathematical model; Neural networks; Reinforcement learning; System dynamics; Heuristic algorithms; Computational modeling; Protocols; Augmented system; Euler-Lagrange system; event-triggered control; reinforcement learning; TRACKING CONTROL; COORDINATION;
D O I
10.1109/TNSE.2020.3036604
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper develops a model-free approach to solve the event-triggered optimal consensus of multiple Euler-Lagrange systems (MELSs) via reinforcement learning (RL). Firstly, an augmented system is constructed by defining a pre-compensator to circumvent the dependence on system dynamics. Secondly, the Hamilton-Jacobi-Bellman (HJB) equations are applied to the deduction of the model-free event-triggered optimal controller. Thirdly, we present a policy iteration (PI) algorithm derived from RL, which converges to the optimal policy. Then, the value function of each agent is represented through a neural network to realize the PI algorithm. Moreover, the gradient descent method is used to update the neural network only at a series of discrete event-triggered instants. The specific form of the event-triggered condition is then proposed, and it is guaranteed that the closed-loop augmented system under the event-triggered mechanism is uniformly ultimately bounded (UUB). Meanwhile, the Zeno behavior is also eliminated. Finally, the validity of this approach is verified by a simulation example.
引用
收藏
页码:246 / 258
页数:13
相关论文
共 50 条
  • [1] OPTIMAL SYNCHRONIZATION CONTROL OF MULTIPLE EULER-LAGRANGE SYSTEMS VIA EVENT-TRIGGERED REINFORCEMENT LEARNING
    Xu, Yuan
    Jin, Xin
    Wang, Saiwei
    Tang, Yang
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2021, 14 (04): : 1495 - 1518
  • [2] Model-Free Optimal Consensus Control of Networked Euler-Lagrange Systems
    Zhang, Huaipin
    Park, Ju H.
    Zhao, Wei
    [J]. IEEE ACCESS, 2019, 7 : 100771 - 100779
  • [3] Distributed consensus for multiple Euler-Lagrange systems: An event-triggered approach
    HUANG Na
    DUAN ZhiSheng
    ZHAO Yu
    [J]. Science China Technological Sciences, 2016, (01) : 33 - 44
  • [4] Distributed consensus for multiple Euler-Lagrange systems: An event-triggered approach
    HUANG Na
    DUAN ZhiSheng
    ZHAO Yu
    [J]. Science China(Technological Sciences), 2016, 59 (01) : 33 - 44
  • [5] Distributed consensus for multiple Euler-Lagrange systems: An event-triggered approach
    Na Huang
    ZhiSheng Duan
    Yu Zhao
    [J]. Science China Technological Sciences, 2016, 59 : 33 - 44
  • [6] Leaderless Consensus for Multiple Euler-Lagrange Systems with Event-Triggered Communication
    Liu, Yen-Chen
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 2657 - 2662
  • [7] Distributed consensus for multiple Euler-Lagrange systems: An event-triggered approach
    Huang Na
    Duan ZhiSheng
    Zhao Yu
    [J]. SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2016, 59 (01) : 33 - 44
  • [8] Event-Triggered Consensus for Euler-Lagrange Systems with Communication Delay
    Dohmann, Pablo Budde Gen
    Hirche, Sandra
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 2777 - 2782
  • [9] EVENT-TRIGGERED CONSENSUS CONTROL FOR A CLASS OF UNCERTAIN MULTIPLE EULER-LAGRANGE SYSTEMS WITH ACTUATOR FAULTS
    Li, Jian
    Zhao, Wei
    Liang, Yuqi
    Wu, Zhaojing
    Zhao, Le
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2024, 17 (09): : 2839 - 2854
  • [10] Distributed Dynamic Event-triggered Consensus Control for Multiple Euler-Lagrange Systems under Digraphs
    Wei, Minfeng
    Zang, Yunge
    Zhang, Fengdi
    [J]. IFAC PAPERSONLINE, 2022, 55 (03): : 234 - 239