Decentralized Multi-Agent Exploration with Online-Learning of Gaussian Processes

被引:0
|
作者
Viseras, Alberto [1 ]
Wiedemann, Thomas [1 ]
Manss, Christoph [1 ]
Magel, Lukas [1 ]
Mueller, Joachim [1 ]
Shutin, Dmitriy [1 ]
Merino, Luis [2 ]
机构
[1] German Aerosp Ctr DLR, D-82234 Oberpfaffenhofen, Wessling, Germany
[2] Pablo Olavide Univ, Sch Engn, Crta Utrera km 1, Seville, Spain
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Exploration is a crucial problem in safety of life applications, such as search and rescue missions. Gaussian processes constitute an interesting underlying data model that leverages the spatial correlations of the process to be explored to reduce the required sampling of data. Furthermore, multi-agent approaches offer well known advantages for exploration. Previous decentralized multi-agent exploration algorithms that use Gaussian processes as underlying data model, have only been validated through simulations. However, the implementation of an exploration algorithm brings difficulties that were not tackle yet. In this work, we propose an exploration algorithm that deals with the following challenges: (i) which information to transmit to achieve multi-agent coordination; (ii) how to implement a light-weight collision avoidance; (iii) how to learn the data's model without prior information. We validate our algorithm with two experiments employing real robots. First, we explore the magnetic field intensity with a ground-based robot. Second, two quadcopters equipped with an ultrasound sensor explore a terrain profile. We show that our algorithm outperforms a meander and a random trajectory, as well as we are able to learn the data's model online while exploring.
引用
收藏
页码:4222 / 4229
页数:8
相关论文
共 50 条
  • [1] Collective Online Learning of Gaussian Processes in Massive Multi-Agent Systems
    Trong Nghia Hoang
    Quang Minh Hoang
    Low, Kian Hsiang
    How, Jonathan
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7850 - 7857
  • [2] Online Learning-based Formation Control of Multi-Agent Systems with Gaussian Processes
    Beckers, Thomas
    Hirche, Sandra
    Colombo, Leonardo
    [J]. 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 2197 - 2202
  • [3] Decentralized Exploration of a Structured Environment Based on Multi-agent Deep Reinforcement Learning
    He, Dingjie
    Feng, Dawei
    Jia, Hongda
    Liu, Hui
    [J]. 2020 IEEE 26TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2020, : 172 - 179
  • [4] Decentralized Trajectory Optimization for Multi-Agent Ergodic Exploration
    Gkouletsos, Dimitris
    Iannelli, Andrea
    Hudoba de Badyn, Mathias
    Lygeros, John
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6329 - 6336
  • [5] Decentralized learning multi-agent system for online machine shop scheduling problem
    Didden, Jeroen B. H. C.
    Dang, Quang-Vinh
    Adan, Ivo J. B. F.
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2023, 67 : 338 - 360
  • [6] Partially decentralized reinforcement learning in finite, multi-agent Markov decision processes
    Tilak, Omkar
    Mukhopadhyay, Snehasis
    [J]. AI COMMUNICATIONS, 2011, 24 (04) : 293 - 309
  • [7] Multi-agent Exploration with Reinforcement Learning
    Sygkounas, Alkis
    Tsipianitis, Dimitris
    Nikolakopoulos, George
    Bechlioulis, Charalampos P.
    [J]. 2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 630 - 635
  • [8] Decentralized Deterministic Multi-Agent Reinforcement Learning
    Grosnit, Antoine
    Cai, Desmond
    Wynter, Laura
    [J]. 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 1548 - 1553
  • [9] Decentralized Multi-agent Exploration with Limited Inter-agent Communications
    He, Hans J.
    Koppel, Alec
    Bedi, Amrit Singh
    Stilwell, Daniel J.
    Farhood, Mazen
    Biggs, Benjamin
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 5530 - 5536
  • [10] Multi-Agent Safe Planning with Gaussian Processes
    Zhu, Zheqing
    Biyik, Erdem
    Sadigh, Dorsa
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 6260 - 6267