A Multi-group Multi-agent System Based on Reinforcement Learning and Flocking

被引:4
|
作者
Wang, Gang [1 ]
Xiao, Jian [2 ,3 ]
Xue, Rui [4 ]
Yuan, Yongting [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Ctr Robot, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[3] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst Quzhou, Quzhou, Peoples R China
[4] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[5] 31435 Res Inst, Shenyang 110000, Peoples R China
基金
中国国家自然科学基金;
关键词
Distributed cooperative reinforcement learning; flocking; group confrontation; multi-group multi-agent system; SENSOR NETWORKS; MOBILE; ALGORITHMS; COVERAGE;
D O I
10.1007/s12555-021-0170-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present an inter-group confrontation and intra-group cooperation method for a predator group and prey group, and construct a multi-group multi-agent system. We model the motion of the prey group using the flocking control algorithm. The prey group can cooperatively avoid predators and maintain the integrity of the group after the predators have been detected. The autonomous decision-making of the predator group is implemented based on the distributed reinforcement learning algorithm. To efficiently share the learning experience among agents in the predator group, a distributed cooperative reinforcement learning algorithm with variable weights is proposed to accelerate the convergence of the learning algorithm. Simulations show the feasibility of this proposed method.
引用
收藏
页码:2364 / 2378
页数:15
相关论文
共 50 条
  • [1] A Multi-group Multi-agent System Based on Reinforcement Learning and Flocking
    Gang Wang
    Jian Xiao
    Rui Xue
    Yongting Yuan
    International Journal of Control, Automation and Systems, 2022, 20 : 2364 - 2378
  • [2] Multi-group hybrid impulsive flocking control of heterogenous multi-agent systems
    Liang, Zhanlue
    Liu, Xinzhi
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2022, 359 (18): : 10455 - 10482
  • [3] Multi-group coordination control of multi-agent system based on smoothing estimator
    Li, Rui
    Shi, Yingjing
    Song, Yongduan
    IET CONTROL THEORY AND APPLICATIONS, 2016, 10 (11): : 1224 - 1230
  • [4] A Conceptual Modeling of Flocking-regulated Multi-agent Reinforcement Learning
    Chen, C. S.
    Hou, Yaqing
    Ong, Y. S.
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 5256 - 5262
  • [5] Emergent Escape-based Flocking Behavior using Multi-Agent Reinforcement Learning
    Hahn, Carsten
    Phan, Thomy
    Gabor, Thomas
    Belzner, Lenz
    Linnhoff-Popien, Claudia
    ALIFE 2019: THE 2019 CONFERENCE ON ARTIFICIAL LIFE, 2019, : 598 - 605
  • [6] Group and Socially Aware Multi-Agent Reinforcement Learning
    Vallecha, Manav
    Kala, Rahul
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 73 - 78
  • [7] Multi-Agent Reinforcement Learning
    Stankovic, Milos
    2016 13TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2016, : 43 - 43
  • [8] Sample-Efficient Multi-Agent Reinforcement Learning with Demonstrations for Flocking Control
    Qiu, Yunbo
    Zhan, Yuzhu
    Jin, Yue
    Wang, Jian
    Zhang, Xudong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [9] Reinforcement learning based on multi-agent in RoboCup
    Zhang, W
    Li, JG
    Ruan, XG
    ADVANCES IN INTELLIGENT COMPUTING, PT 1, PROCEEDINGS, 2005, 3644 : 967 - 975
  • [10] Multi-Agent System with Multiple Group Modelling for Bird Flocking on GPU
    Hidayat, Rahmat
    Spataro, Davide
    De Giorgio, Elisa
    Spataro, William
    D'Ambrosio, Donato
    2016 24TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP), 2016, : 680 - 685