Handling Realistic Noise in Multi-Agent Systems with Self-Supervised Learning and Curiosity

被引:0
|
作者
Szemenyei, Marton [1 ]
Reizinger, Patrik [1 ]
机构
[1] Budapest Univ Technol & Econ, Dept Control Engn & Informat Technol, Magyar Tudosok Krt 2, H-1117 Budapest, Hungary
关键词
deep reinforcement learning; multi-agent environment; autonomous driving; robot soccer; self-supervised learning;
D O I
10.2478/jaiscr-2022-0009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
(1)Most reinforcement learning benchmarks - especially in multi-agent tasks - do not go beyond observations with simple noise; nonetheless, real scenarios induce more elaborate vision pipeline failures: false sightings, misclassifications or occlusion. In this work, we propose a lightweight, 2D environment for robot soccer and autonomous driving that can emulate the above discrepancies. Besides establishing a benchmark for accessible multi-agent reinforcement learning research, our work addresses the challenges the simulator imposes. For handling realistic noise, we use self-supervised learning to enhance scene reconstruction and extend curiosity-driven learning to model longer horizons. Our extensive experiments show that the proposed methods achieve state-of-the-art performance, compared against actor-critic methods, ICM, and PPO.
引用
收藏
页码:135 / 148
页数:14
相关论文
共 50 条
  • [21] Causal Curiosity: RL Agents Discovering Self-supervised Experiments for Causal Representation Learning
    Sontakke, Sumedh A.
    Mehrjou, Arash
    Itti, Laurent
    Scholkopf, Bernhard
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] Contrastive Self-supervised Learning in Recommender Systems: A Survey
    Jing, Mengyuan
    Zhu, Yanmin
    Zang, Tianzi
    Wang, Ke
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (02)
  • [23] A sentinel approach to fault handling in Multi-Agent Systems
    Hägg, S
    [J]. MULTI-AGENT SYSTEMS: METHODOLOGIES AND APPLICATIONS, 1997, 1286 : 181 - 195
  • [24] Curiosity-driven multi-agent competitive and cooperative LDA learning
    Shimo, Naoki
    Pang, Shaoning
    Kasabov, Nikola
    Yamakawa, Takeshi
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2008, 4 (07): : 1537 - 1552
  • [25] Episodic Multi-agent Reinforcement Learning with Curiosity-driven Exploration
    Zheng, Lulu
    Chen, Jiarui
    Wang, Jianhao
    He, Jiamin
    Hu, Yujing
    Chen, Yingfeng
    Fan, Changjie
    Gao, Yang
    Zhang, Chongjie
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [26] Robust consensus of multi-agent systems with noise
    WANG Lin & LIU ZhiXin Institute of Systems Science
    [J]. Science China(Information Sciences), 2009, (05) : 824 - 834
  • [27] Robust consensus of multi-agent systems with noise
    Lin Wang
    ZhiXin Liu
    [J]. Science in China Series F: Information Sciences, 2009, 52 : 824 - 834
  • [28] Robust consensus of multi-agent systems with noise
    Wang Lin
    Liu Zhixin
    Guo Lei
    [J]. PROCEEDINGS OF THE 26TH CHINESE CONTROL CONFERENCE, VOL 6, 2007, : 737 - +
  • [29] Robust consensus of multi-agent systems with noise
    Wang Lin
    Liu ZhiXin
    [J]. SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2009, 52 (05): : 824 - 834
  • [30] A Fuzzy Curiosity-Driven Mechanism for Multi-Agent Reinforcement Learning
    Chen, Wenbai
    Shi, Haobin
    Li, Jingchen
    Hwang, Kao-Shing
    [J]. INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2021, 23 (05) : 1222 - 1233