Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [31] A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Liu, Yan
    Zhou, Jinying
    [J]. INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024, : 1469 - 1483
  • [32] A novel deep reinforcement learning for POMDP-based autonomous ship collision decision-making
    Zhang, Xinyu
    Zheng, Kangjie
    Wang, Chengbo
    Chen, Jihong
    Qi, Huaiyuan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023,
  • [33] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Shen Li
    Keqi Shu
    Chaoyi Chen
    Dongpu Cao
    [J]. Chinese Journal of Mechanical Engineering, 2021, (05) : 42 - 59
  • [34] Autonomous Decision-Making for Aerobraking via Parallel Randomized Deep Reinforcement Learning
    Falcone, Giusy
    Putnam, Zachary R. R.
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 3055 - 3070
  • [35] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Shen Li
    Keqi Shu
    Chaoyi Chen
    Dongpu Cao
    [J]. Chinese Journal of Mechanical Engineering, 2021, 34
  • [36] Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning
    Zhang, Xinyu
    Wang, Chengbo
    Liu, Yuanchang
    Chen, Xiang
    [J]. SENSORS, 2019, 19 (18)
  • [37] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Li, Shen
    Shu, Keqi
    Chen, Chaoyi
    Cao, Dongpu
    [J]. CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2021, 34 (01)
  • [38] Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning
    Isele, David
    Rahimi, Reza
    Cosgun, Akansel
    Subramanian, Kaushik
    Fujimura, Kikuo
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 2034 - 2039
  • [39] Human-Guided Deep Reinforcement Learning for Optimal Decision Making of Autonomous Vehicles
    Wu, Jingda
    Yang, Haohan
    Yang, Lie
    Huang, Yi
    He, Xiangkun
    Lv, Chen
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024,
  • [40] Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehicles
    Pruekprasert, Sasinee
    Zhang, Xiaoyi
    Dubut, Jeremy
    Huang, Chao
    Kishida, Masako
    [J]. 2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 2299 - 2304