A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

被引:1
|
作者
Liu, Teng [1 ,2 ,3 ,4 ]
Yang, Yuyou [5 ]
Xiao, Wenxuan [5 ]
Tang, Xiaolin [5 ]
Yin, Mingzhu [1 ,2 ,3 ,4 ]
机构
[1] Chongqing Univ Three Gorges Hosp, Chongqing Univ, Clin Res Ctr, Wanzhou, Chongqing 404000, Peoples R China
[2] Chongqing Univ, Three Gorges Hosp, Translat Med Res Ctr, Chongqing 404000, Peoples R China
[3] Chongqing Univ, Three Gorges Hosp, Clin Pathol Ctr, Chongqing 404000, Peoples R China
[4] Chongqing Univ, Three Gorges Hosp, Canc Early Detect & Treatment Ctr, Chongqing 404000, Peoples R China
[5] Chongqing Univ, Coll Mech & Vehicle Engn, Chongqing 400044, Peoples R China
关键词
Decision-making; deep reinforcement learning; autonomous vehicles; DQL; double DQL; dueling DQL; PR-DQL; ENERGY MANAGEMENT; HYBRID;
D O I
10.1109/ACCESS.2024.3358424
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In application, advanced autonomous driving technologies still face numerous challenges. Deep Reinforcement Learning (DRL) has emerged as a widespread and effective approach to address artificial intelligence challenges, due to its substantial potential for autonomous learning and self-improvement. In this study, four DRL algorithms-Deep Q-Learning (DQN), along with its enhanced algorithm, Double DQL, Dueling DQL, and Priority Replay DQL(PR-DQN), are employed to address decision-making challenges for autonomous vehicles on highways, with a comprehensive comparative analysis conducted. The decision-making model is constructed as a Markov Decision Process, guided by specially designed reward functions, enabling the target vehicle to learn safe and efficient decision-making strategies through multiple environmental explorations. Through the analysis and discussion of a series of experimental results, the feasibility of DRL-based decision strategies is demonstrated. Finally, through comparing the experimental outcomes of different algorithms, the connection between autonomous driving results and the inherent learning features of these DRL technologies is analyzed.
引用
收藏
页码:24090 / 24103
页数:14
相关论文
共 50 条
  • [1] A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Liu, Yan
    Zhou, Jinying
    [J]. INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024, : 1469 - 1483
  • [2] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Guofa Li
    Shenglong Li
    Shen Li
    Yechen Qin
    Dongpu Cao
    Xingda Qu
    Bo Cheng
    [J]. Automotive Innovation, 2020, 3 : 374 - 385
  • [3] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Li, Guofa
    Li, Shenglong
    Li, Shen
    Qin, Yechen
    Cao, Dongpu
    Qu, Xingda
    Cheng, Bo
    [J]. AUTOMOTIVE INNOVATION, 2020, 3 (04) : 374 - 385
  • [4] Decision-making for Connected and Automated Vehicles in Chanllenging Traffic Conditions Using Imitation and Deep Reinforcement Learning
    Hu, Jinchao
    Li, Xu
    Hu, Weiming
    Xu, Qimin
    Hu, Yue
    [J]. INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2023, 24 (06) : 1589 - 1602
  • [5] Decision-making for Connected and Automated Vehicles in Chanllenging Traffic Conditions Using Imitation and Deep Reinforcement Learning
    Jinchao Hu
    Xu Li
    Weiming Hu
    Qimin Xu
    Yue Hu
    [J]. International Journal of Automotive Technology, 2023, 24 : 1589 - 1602
  • [6] Robust Multiagent Reinforcement Learning toward Coordinated Decision-Making of Automated Vehicles
    He, Xiangkun
    Chen, Hao
    Lv, Chen
    [J]. SAE INTERNATIONAL JOURNAL OF VEHICLE DYNAMICS STABILITY AND NVH, 2023, 7 (04): : 475 - 488
  • [7] Decision-Making Strategy on Highway for Autonomous Vehicles Using Deep Reinforcement Learning
    Liao, Jiangdong
    Liu, Teng
    Tang, Xiaolin
    Mu, Xingyu
    Huang, Bing
    Cao, Dongpu
    [J]. IEEE ACCESS, 2020, 8 (08): : 177804 - 177814
  • [8] Decision-Making in Fallback Scenarios for Autonomous Vehicles: Deep Reinforcement Learning Approach
    Lee, Cheonghwa
    An, Dawn
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [9] Efficient Deep Reinforcement Learning-Enabled Recommendation
    Pang, Guangyao
    Wang, Xiaoming
    Wang, Liang
    Hao, Fei
    Lin, Yaguang
    Wan, Pengfei
    Min, Geyong
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (02): : 871 - 886
  • [10] A Deep Reinforcement Learning Decision-Making Approach for Adaptive Cruise Control in Autonomous Vehicles
    Ghraizi, Dany
    Talj, Reine
    Francis, Clovis
    [J]. 2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 71 - 78