Graphical Minimax Game and On-Policy Reinforcement Learning for Consensus of Leaderless Multi-Agent Systems

被引：0
|
作者：
Dong, Wei [1 ]
Wang, Chunyan [1 ]
Li, Jinna [2 ,3 ]
Wang, Jianan [1 ]
机构：
[1] Beijing Inst Technol, Sch Aerosp Engn, Minist Educ, Key Lab Dynam & Control Flight Vehicle, Beijing 100081, Peoples R China
[2] Liaoning Shihua Univ, Sch Informat & Control Engn, Fushun 113001, Peoples R China
[3] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
来源：
2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA) | 2020年
基金：
中国国家自然科学基金;
关键词：
LINEAR-SYSTEMS; SYNCHRONIZATION; NETWORKS;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, we study the adaptive optimal consensus control of leaderless multi-agent systems (MASs) with heterogeneous dynamics. First, the consensus control problem is converted into a graphical minimax game problem and the corresponding algebraic Riccati equation (ARE) for each agent is obtained. Then, an on-policy reinforcement learning algorithm is proposed to online learn the optimal control policy without requiring the system dynamics. A certain rank condition is established to guarantee the convergence of the proposed online learning algorithm to the unique solution of the ARE. Finally, the effectiveness of the proposed algorithm is demonstrated through a numerical simulation.
引用
收藏
页码：606 / 611
页数：6
相关论文
共 50 条
  • [31] Uncertainty modified policy for multi-agent reinforcement learning
    Zhao, Xinyu
    Liu, Jianxiang
    Wu, Faguo
    Zhang, Xiao
    Wang, Guojian
    APPLIED INTELLIGENCE, 2024, 54 (22) : 12020 - 12034
  • [32] Nonlinear Filtering and Reinforcement Learning Based Consensus Achievement of Uncertain Multi-Agent Systems
    Borah, Kaustav Jyoti
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2024, 146 (03):
  • [33] Neuro-adaptive leaderless consensus of fractional-order multi-agent systems
    Mo, Lipo
    Yuan, Xiaolin
    Yu, Yongguang
    NEUROCOMPUTING, 2019, 339 : 17 - 25
  • [34] Event-triggered Consensus for Second-order Leaderless Multi-agent Systems
    Zhang, Xu
    Chen, Maoyin
    2013 25TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2013, : 4395 - 4399
  • [35] Distributed Robust Leaderless Consensus of Lipschitz Nonlinear Multi-agent Systems with Matching Uncertainties
    Li, Zhongkui
    Zhao, Yu
    Duan, Zhisheng
    26TH CHINESE CONTROL AND DECISION CONFERENCE (2014 CCDC), 2014, : 858 - 863
  • [36] Hierarchical Architecture for Multi-Agent Reinforcement Learning in Intelligent Game
    Li, Bin
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] Eavesdropping Game Based on Multi-Agent Deep Reinforcement Learning
    Guo, Delin
    Tang, Lan
    Yang, Lvxi
    Liang, Ying-Chang
    2022 IEEE 23RD INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATION (SPAWC), 2022,
  • [38] Eavesdropping Game Based on Multi-Agent Deep Reinforcement Learning
    Guo, Delin
    Tang, Lan
    Yang, Lvxi
    Liang, Ying-Chang
    IEEE Workshop on Signal Processing Advances in Wireless Communications, SPAWC, 2022, 2022-July
  • [39] Offline Multi-Agent Reinforcement Learning in Custom Game Scenario
    Shukla, Indu
    Wilson, William R.
    Henslee, Althea C.
    Dozier, Haley R.
    2023 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE, CSCI 2023, 2023, : 329 - 331
  • [40] A Multi-agent Reinforcement Learning Algorithm Based on Stackelberg Game
    Cheng, Chi
    Zhu, Zhangqing
    Xin, Bo
    Chen, Chunlin
    2017 6TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS (DDCLS), 2017, : 727 - 732
12345