Deep reinforcement learning augmented decision⁃making model for intelligent driving vehicles

被引:0
|
作者
Tian Y.-T. [1 ]
Ji Y.-S. [1 ]
Chang H. [1 ]
Xie B. [1 ]
机构
[1] College of Communication Engineering, Jilin University, Changchun
关键词
decision making planning; deep reinforcement learning; intelligent driving; snow and ice pavement; vehicle engineering;
D O I
10.13229/j.cnki.jdxbgxb20221441
中图分类号
学科分类号
摘要
A deep reinforcement learning agent based on Deep Q-Network (DQN) algorithm was constructed to solve the problem that the state machine decision model cannot effectively deal with the rich context information and the influence of uncertain factors in the snow and ice environment. The motion planner was used to augment the agent,and the rule-based decision planning module and the deep reinforcement learning model were integrated together to build the DQN-planner model,so as to improve the convergence speed and driving ability of the reinforcement learning agent. Finally,the driving ability of DQN model and DQN-planner on ice and snow road with low adhesion coefficient is compared based on CARLA simulation platform,and the training process and verification results are analyzed respectively. © 2023 Editorial Board of Jilin University. All rights reserved.
引用
收藏
页码:682 / 692
页数:10
相关论文
共 18 条
  • [1] Wang Zhe, Yang Bai-ting, Liu Xin, Et al., Discriminant analysis of driving decisions based on fuzzy clustering, Journal of Jilin University(Engineering and Technology Edition), 45, 5, pp. 1414-1419, (2015)
  • [2] Montemerlo M, Becker J, Bhat S, Et al., Junior: the stanford entry in the urban challenge, Journal of Field Robotics, 25, 9, pp. 569-597, (2008)
  • [3] Urmson C, Baker C, Dolan J, Et al., Autonomous driving in traffic: boss and the urban challenge, The AI Magazine, 30, 2, pp. 17-28, (2009)
  • [4] Li Hong-hui, Xi Yi-kun, Lu Hai-liang, Et al., Improved C4. 5 algorithm based on k-means, Journal of Computational Methods in Sciences and Engineering, 20, 1, pp. 177-189, (2020)
  • [5] Du Ming-bo, Research on behavioral decision making and motion planning methods of autonomous vehicle based on human driving behavior, (2016)
  • [6] Cao Xuan-hao, Motion control and decision planning for car following and lane changing of autonomous vehicle, (2022)
  • [7] Isele D, Rahimi R, Cosgun A, Et al., Navigating occluded intersections with autonomous vehicles using deep reinforcement learning, 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 2034-2039, (2018)
  • [8] Li L Z, Ota K, Dong M X, Et al., Humanlike driving: empirical decision-making system for autonomous vehicles, IEEE Transactions on Vehicular Technology, 67, 8, pp. 6814-6823, (2018)
  • [9] Gao Zhen-hai, Sun Tian-jun, He Lei, Et al., Causal reasoning decision-making for vehicle longitudinal automatic driving, Journal of Jilin University(Engineering and Technology Edition), 49, 5, pp. 1392-1404, (2019)
  • [10] Barto A G, Mahadevan S., Recent advances in hierarchical reinforcement learning, Discrete Event Dynamic Systems, 13, 1, pp. 41-77, (2003)