A Game-Theoretic Reinforcement Learning Approach for Adaptive Interaction at Intersections

被引:8
|
作者
Jin, Xinze [1 ]
Li, Kuo [1 ]
Jia, Qing-Shan [1 ]
Xia, Huaxia [2 ]
Bai, Yu [2 ]
Ren, Dongchun [2 ]
机构
[1] Tsinghua Univ, BNRist, Dept Automat, Beijing, Peoples R China
[2] Meituan Dianping Grp, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
MODELS;
D O I
10.1109/CAC51589.2020.9327245
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a hi-level algorithm for motion planning at intersections based on a scheme of reasoning game theory and heuristic reinforcement learning. In the upper level, a recurrent neural network is introduced to estimate the type of opponent agent. In the lower level, Q-networks are selectively connected to implement the game with different type. Then the ego agent could update its estimation step-by-step and conclude correspond action from historical joint state. The simulation results show that the hi-level controller improves pass times and collision avoidance performance.
引用
收藏
页码:4451 / 4456
页数:6
相关论文
共 50 条
  • [1] A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
    Lanctot, Marc
    Zambaldi, Vinicius
    Gruslys, Audrunas
    Lazaridou, Angeliki
    Tuyls, Karl
    Perolat, Julien
    Silver, David
    Graepel, Thore
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [2] Adaptive strategy optimization in game-theoretic paradigm using reinforcement learning
    Cheong, Kang Hao
    Zhao, Jie
    [J]. PHYSICAL REVIEW RESEARCH, 2024, 6 (03):
  • [3] Adaptive strategy optimization in game-theoretic paradigm using reinforcement learning
    Cheong, Kang Hao
    Zhao, Jie
    [J]. Physical Review Research, 6 (03):
  • [4] A Game-Theoretic Approach for Minimizing Delays in Autonomous Intersections
    Adkins, Robert P.
    Mount, David M.
    Zhang, Alice A.
    [J]. TRAFFIC AND GRANULAR FLOW '17, 2019, : 131 - 139
  • [5] On the role of reinforcement learning in experimental games: The cognitive game-theoretic approach
    Erev, I
    Roth, AE
    [J]. GAMES AND HUMAN BEHAVIOR: ESSAYS IN HONOR OF AMNON RAPOPORT, 1999, : 53 - 77
  • [6] A Game-theoretic Approach to Data Interaction
    McCamish, Ben
    Ghadakchi, Vahid
    Termehchy, Arash
    Touri, Behrouz
    Cotilla-Sanchez, Eduardo
    Huang, Liang
    Changpinyo, Soravit
    [J]. ACM TRANSACTIONS ON DATABASE SYSTEMS, 2020, 45 (01):
  • [7] Game-theoretic interaction among stochastic learning networks for adaptive load balancing
    Yeung, D.Y.
    Bekey, G.A.
    [J]. Neural Networks, 1988, 1 (1 SUPPL)
  • [8] A Game-theoretic Approach for Robust Federated Learning
    Tahanian, E.
    Amouei, M.
    Fateh, H.
    Rezvani, M.
    [J]. INTERNATIONAL JOURNAL OF ENGINEERING, 2021, 34 (04): : 832 - 842
  • [9] The Game-Theoretic Approach to Machine Learning and Adaptation
    Cesa-Bianchi, Nicolo
    [J]. ADAPTIVE AND INTELLIGENT SYSTEMS, 2011, 6943 : 1 - 1
  • [10] Game-Theoretic Inverse Reinforcement Learning: A Differential Pontryagin's Maximum Principle Approach
    Cao, Kun
    Xie, Lihua
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9506 - 9513