Handling Realistic Noise in Multi-Agent Systems with Self-Supervised Learning and Curiosity

被引:0
|
作者
Szemenyei, Marton [1 ]
Reizinger, Patrik [1 ]
机构
[1] Budapest Univ Technol & Econ, Dept Control Engn & Informat Technol, Magyar Tudosok Krt 2, H-1117 Budapest, Hungary
关键词
deep reinforcement learning; multi-agent environment; autonomous driving; robot soccer; self-supervised learning;
D O I
10.2478/jaiscr-2022-0009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
(1)Most reinforcement learning benchmarks - especially in multi-agent tasks - do not go beyond observations with simple noise; nonetheless, real scenarios induce more elaborate vision pipeline failures: false sightings, misclassifications or occlusion. In this work, we propose a lightweight, 2D environment for robot soccer and autonomous driving that can emulate the above discrepancies. Besides establishing a benchmark for accessible multi-agent reinforcement learning research, our work addresses the challenges the simulator imposes. For handling realistic noise, we use self-supervised learning to enhance scene reconstruction and extend curiosity-driven learning to model longer horizons. Our extensive experiments show that the proposed methods achieve state-of-the-art performance, compared against actor-critic methods, ICM, and PPO.
引用
收藏
页码:135 / 148
页数:14
相关论文
共 50 条
  • [1] COMPETITIVE MULTI-AGENT REINFORCEMENT LEARNING WITH SELF-SUPERVISED REPRESENTATION
    Su, DiJia
    Lee, Jason D.
    Mulvey, John M.
    Poor, H. Vincent
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4098 - 4102
  • [2] Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning
    Chen, Yinda
    Huang, Wei
    Zhou, Shenglong
    Chen, Qi
    Xiong, Zhiwei
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 609 - 617
  • [3] Multi-Agent Driving Behavior Prediction across Different Scenarios with Self-Supervised Domain Knowledge
    Ma, Hengbo
    Sun, Yaofeng
    Li, Jiachen
    Tomizuka, Masayoshi
    [J]. 2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 3122 - 3129
  • [4] Self-Supervised Learning for Recommender Systems: A Survey
    Yu, Junliang
    Yin, Hongzhi
    Xia, Xin
    Chen, Tong
    Li, Jundong
    Huang, Zi
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (01) : 335 - 355
  • [5] Self-supervised learning for fair recommender systems
    Liu, Haifeng
    Lin, Hongfei
    Fan, Wenqi
    Ren, Yuqi
    Xu, Bo
    Zhang, Xiaokun
    Wen, Dongzhen
    Zhao, Nan
    Lin, Yuan
    Yang, Liang
    [J]. APPLIED SOFT COMPUTING, 2022, 125
  • [6] Self-Supervised Reinforcement Learning for Recommender Systems
    Xin, Xin
    Karatzoglou, Alexandros
    Arapakis, Ioannis
    Jose, Joemon M.
    [J]. PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 931 - 940
  • [7] Self-supervised learning for fair recommender systems
    Liu, Haifeng
    Lin, Hongfei
    Fan, Wenqi
    Ren, Yuqi
    Xu, Bo
    Zhang, Xiaokun
    Wen, Dongzhen
    Zhao, Nan
    Lin, Yuan
    Yang, Liang
    [J]. APPLIED SOFT COMPUTING, 2022, 125
  • [8] Supervised coverage control of multi-agent systems
    Atinc, Goekhan M.
    Stipanovic, Dusan M.
    Voulgaris, Petros G.
    [J]. AUTOMATICA, 2014, 50 (11) : 2936 - 2942
  • [10] Improving exception handling in multi-agent systems
    Souchon, F
    Dony, C
    Urtado, C
    Vauttier, S
    [J]. SOFTWARE ENGINEERING FOR MULTI-AGENT SYSTEMS II: RESEARCH ISSUES AND PRACTICAL APPLICATIONS, 2004, 2940 : 167 - 188