Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning

被引:3
|
作者
Xu, Shu-Yuan [1 ,2 ]
Chen, Xue-Mei [1 ,2 ]
Wang, Zi-Jia [1 ,2 ]
Hu, Yu-Hui [1 ,2 ]
Han, Xin-Tong [2 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, South ZhongGuanCun St, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Adv Technol Res Inst, 8366 Haitang Rd, Jinan 250300, Peoples R China
关键词
CROSSING BEHAVIOR;
D O I
10.1109/ICARM54641.2022.9959664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Decision making at unsignalized intersections is a critical challenge for autonomous vehicles. Navigating through urban intersections requires determining the intentions of other traffic participants. Solving this complex decision-making problem with traditional methods is difficult. To eliminate conflicts at intersections, this paper introduces several deep reinforcement learning algorithms. This research modeled the behavior of drivers at these intersections. Using this, reward functions were designed, and a meta exploration deep deterministic policy gradient was reorganized. Finally, a novel time twin delayed deep deterministic policy gradient algorithm was developed that considered prediction factors. The Carla-Gym simulation platform was used to build an unsignalized intersection model. The experimental results show that the improved deep reinforcement learning method performed better for navigating autonomous vehicles through unsignalized urban intersections.
引用
收藏
页码:672 / 677
页数:6
相关论文
共 50 条
  • [41] Autonomous Decision-Making for Aerobraking via Parallel Randomized Deep Reinforcement Learning
    Falcone, Giusy
    Putnam, Zachary R. R.
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 3055 - 3070
  • [42] Planning and Decision-making for Connected Autonomous Vehicles at Road Intersections: A Review
    Li, Shen
    Shu, Keqi
    Chen, Chaoyi
    Cao, Dongpu
    CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2021, 34 (01)
  • [43] Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning
    Zhang, Xinyu
    Wang, Chengbo
    Liu, Yuanchang
    Chen, Xiang
    SENSORS, 2019, 19 (18)
  • [44] Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning
    Isele, David
    Rahimi, Reza
    Cosgun, Akansel
    Subramanian, Kaushik
    Fujimura, Kikuo
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 2034 - 2039
  • [45] Human-Guided Deep Reinforcement Learning for Optimal Decision Making of Autonomous Vehicles
    Wu, Jingda
    Yang, Haohan
    Yang, Lie
    Huang, Yi
    He, Xiangkun
    Lv, Chen
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, : 1 - 15
  • [46] Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehicles
    Pruekprasert, Sasinee
    Zhang, Xiaoyi
    Dubut, Jeremy
    Huang, Chao
    Kishida, Masako
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 2299 - 2304
  • [47] Optimized IoT Based Decision Making For Autonomous Vehicles In Intersections
    Sahba, Amin
    Sahba, Ramin
    Rad, Paul
    Jamshidi, Mo
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 203 - 206
  • [48] Reinforcement Learning Based Overtaking Decision-Making for Highway Autonomous Driving
    Li, Xin
    Xu, Xin
    Zuo, Lei
    2015 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2015, : 336 - 342
  • [49] Review of Autonomous Driving Decision-Making Research Based on Reinforcement Learning
    Jin L.
    Han G.
    Xie X.
    Guo B.
    Liu G.
    Zhu W.
    Qiche Gongcheng/Automotive Engineering, 2023, 45 (04): : 527 - 540
  • [50] Design of Unsignalized Roundabouts Driving Policy of Autonomous Vehicles Using Deep Reinforcement Learning
    Wang, Zengrong
    Liu, Xujin
    Wu, Zhifei
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (02):