Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Autonomous Vehicles Collaboration at Unsignalized Intersections
    Zheng, Jian
    Zhu, Kun
    Wang, Ran
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1115 - 1120
  • [2] A Decision-Making Model for Autonomous Vehicles at Intersections Based on Hierarchical Reinforcement Learning
    Chen, Xue-Mei
    Xu, Shu-Yuan
    Wang, Zi-Jia
    Zheng, Xue-Long
    Han, Xin-Tong
    Liu, En-Hao
    [J]. UNMANNED SYSTEMS, 2024, 12 (04) : 641 - 652
  • [3] Driving Tasks Transfer Using Deep Reinforcement Learning for Decision-Making of Autonomous Vehicles in Unsignalized Intersection
    Shu, Hong
    Liu, Teng
    Mu, Xingyu
    Cao, Dongpu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (01) : 41 - 52
  • [4] Decision-Making for Autonomous Vehicles in Random Task Scenarios at Unsignalized Intersection Using Deep Reinforcement Learning
    Xiao, Wenxuan
    Yang, Yuyou
    Mu, Xinyu
    Xie, Yi
    Tang, Xiaolin
    Cao, Dongpu
    Liu, Teng
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 7812 - 7825
  • [5] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Guofa Li
    Shenglong Li
    Shen Li
    Yechen Qin
    Dongpu Cao
    Xingda Qu
    Bo Cheng
    [J]. Automotive Innovation, 2020, 3 : 374 - 385
  • [6] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Li, Guofa
    Li, Shenglong
    Li, Shen
    Qin, Yechen
    Cao, Dongpu
    Qu, Xingda
    Cheng, Bo
    [J]. AUTOMOTIVE INNOVATION, 2020, 3 (04) : 374 - 385
  • [7] Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles
    Yuan, Mingfeng
    Shan, Jinjun
    Mi, Kevin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 818 - 825
  • [8] Decision-Making Models Based on Meta-Reinforcement Learning for Intelligent Vehicles at Urban Intersections
    Xuemei Chen
    Jiahe Liu
    Zijia Wang
    Xintong Han
    Yufan Sun
    Xuelong Zheng
    [J]. Journal of Beijing Institute of Technology, 2022, (04) : 327 - 339
  • [9] Decision-Making Models Based on Meta-Reinforcement Learning for Intelligent Vehicles at Urban Intersections
    Chen X.
    Liu J.
    Wang Z.
    Han X.
    Sun Y.
    Zheng X.
    [J]. Journal of Beijing Institute of Technology (English Edition), 2022, 31 (04): : 327 - 339
  • [10] Decision-Making in Fallback Scenarios for Autonomous Vehicles: Deep Reinforcement Learning Approach
    Lee, Cheonghwa
    An, Dawn
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (22):