Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [21] Interactive Decision-making and Planning for Autonomous Driving vehicles in Unsignalized Intersection
    Xu, Can
    Zhao, Wanzhong
    Li, Lin
    Zhang, Ruijun
    Wang, Chunyan
    Chen, Feng
    [J]. Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2023, 59 (14): : 202 - 212
  • [22] A Safety-Enhanced Reinforcement Learning-Based Decision-Making and Motion Planning Method for Left-Turning at Unsignalized Intersections for Automated Vehicles
    Zhang, Lei
    Cheng, Shuhui
    Wang, Zhenpo
    Liu, Jizheng
    Wang, Mingqiang
    [J]. IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 16375 - 16388
  • [23] A Decision-Making Model for Autonomous Vehicles at Urban Intersections Based on Conflict Resolution
    Wang, Zi-jia
    Chen, Xue-mei
    Wang, Pin
    Li, Meng-xi
    Ou, Yang-jia-xin
    Zhang, Han
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2021, 2021
  • [24] A Decision-making model for autonomous vehicles at urban intersections based on conflict resolution
    [J]. Chen, Xue-mei (chenxue781@126.com), 1600, Hindawi Limited (2021):
  • [25] A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
    Li, Ke
    Zhang, Kun
    Zhang, Zhenchong
    Liu, Zekun
    Hua, Shuai
    He, Jianliang
    [J]. SENSORS, 2021, 21 (06)
  • [26] A Reinforcement Learning based Decision-making System with Aggressive Driving Behavior Consideration for Autonomous Vehicles
    Kang, Liuwang
    Shen, Haiying
    [J]. 2021 18TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2021,
  • [27] Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making
    Al-Sharman, Mohammad
    Dempster, Rowan
    Daoud, Mohamed A.
    Nasr, Mahmoud
    Rayside, Derek
    Melek, William
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12345 - 12356
  • [28] Joint Optimization of Sensing, Decision-Making and Motion-Controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach
    Chen, Longquan
    He, Ying
    Wang, Qiang
    Pan, Weike
    Ming, Zhong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4642 - 4654
  • [29] An Integrated Lateral and Longitudinal Decision-Making Model for Autonomous Driving Based on Deep Reinforcement Learning
    Cui, Jianxun
    Zhao, Boyuan
    Qu, Mingcheng
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2023, 2023
  • [30] An Integrated Model for Autonomous Speed and Lane Change Decision-Making Based on Deep Reinforcement Learning
    Peng, Jiankun
    Zhang, Siyu
    Zhou, Yang
    Li, Zhibin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 21848 - 21860