A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

被引:1
|
作者
Liu, Teng [1 ,2 ,3 ,4 ]
Yang, Yuyou [5 ]
Xiao, Wenxuan [5 ]
Tang, Xiaolin [5 ]
Yin, Mingzhu [1 ,2 ,3 ,4 ]
机构
[1] Chongqing Univ Three Gorges Hosp, Chongqing Univ, Clin Res Ctr, Wanzhou, Chongqing 404000, Peoples R China
[2] Chongqing Univ, Three Gorges Hosp, Translat Med Res Ctr, Chongqing 404000, Peoples R China
[3] Chongqing Univ, Three Gorges Hosp, Clin Pathol Ctr, Chongqing 404000, Peoples R China
[4] Chongqing Univ, Three Gorges Hosp, Canc Early Detect & Treatment Ctr, Chongqing 404000, Peoples R China
[5] Chongqing Univ, Coll Mech & Vehicle Engn, Chongqing 400044, Peoples R China
关键词
Decision-making; deep reinforcement learning; autonomous vehicles; DQL; double DQL; dueling DQL; PR-DQL; ENERGY MANAGEMENT; HYBRID;
D O I
10.1109/ACCESS.2024.3358424
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In application, advanced autonomous driving technologies still face numerous challenges. Deep Reinforcement Learning (DRL) has emerged as a widespread and effective approach to address artificial intelligence challenges, due to its substantial potential for autonomous learning and self-improvement. In this study, four DRL algorithms-Deep Q-Learning (DQN), along with its enhanced algorithm, Double DQL, Dueling DQL, and Priority Replay DQL(PR-DQN), are employed to address decision-making challenges for autonomous vehicles on highways, with a comprehensive comparative analysis conducted. The decision-making model is constructed as a Markov Decision Process, guided by specially designed reward functions, enabling the target vehicle to learn safe and efficient decision-making strategies through multiple environmental explorations. Through the analysis and discussion of a series of experimental results, the feasibility of DRL-based decision strategies is demonstrated. Finally, through comparing the experimental outcomes of different algorithms, the connection between autonomous driving results and the inherent learning features of these DRL technologies is analyzed.
引用
收藏
页码:24090 / 24103
页数:14
相关论文
共 50 条
  • [31] Research on Autonomous Decision-Making of UCAV Based on Deep Reinforcement Learning
    Wang, Linxiang
    Wei, Hongtao
    [J]. 2022 3RD INFORMATION COMMUNICATION TECHNOLOGIES CONFERENCE (ICTC 2022), 2022, : 122 - 126
  • [32] Benchmarking Lane-changing Decision-making for Deep Reinforcement Learning
    Wang, Junjie
    Zhang, Qichao
    Zhao, Dongbin
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND ARTIFICIAL INTELLIGENCE, ICRAI 2021, 2021, : 26 - 32
  • [33] A Decision-Making Approach for Complex Unsignalized Intersection by Deep Reinforcement Learning
    Li, Shanke
    Peng, Kun
    Hui, Fei
    Li, Ziqi
    Wei, Cheng
    Wang, Wenbo
    [J]. IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 16134 - 16147
  • [34] Joint Optimization of Sensing, Decision-Making and Motion-Controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach
    Chen, Longquan
    He, Ying
    Wang, Qiang
    Pan, Weike
    Ming, Zhong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4642 - 4654
  • [35] A Rear Anti-Collision Decision-Making Methodology Based on Deep Reinforcement Learning for Autonomous Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Song, Xiang
    Dong, Xuan
    Kong, Dong
    Xu, Qimin
    Ren, Chunxiao
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (16) : 16370 - 16380
  • [36] Deep reinforcement learning augmented decision⁃making model for intelligent driving vehicles
    Tian Y.-T.
    Ji Y.-S.
    Chang H.
    Xie B.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (03): : 682 - 692
  • [37] A deep reinforcement learning-enabled dynamic redeployment system for mobile ambulances
    Ji, Shenggong
    Zheng, Yu
    Wang, Zhaoyuan
    Li, Tianrui
    [J]. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3 (01):
  • [38] Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning
    Hoel, Carl-Johan
    Wolff, Krister
    Laine, Leo
    [J]. 2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 2148 - 2155
  • [39] Review of Research on Decision-making and Planning for Automated Vehicles
    Zhu B.
    Jia S.-Z.
    Zhao J.
    Han J.-Y.
    Zhang P.-X.
    Song D.-J.
    [J]. Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2024, 37 (01): : 215 - 240
  • [40] Edge-enhanced Graph Attention Network for driving decision-making of autonomous vehicles via Deep Reinforcement Learning
    Qiang, Yuchuan
    Wang, Xiaolan
    Liu, Xintian
    Wang, Yansong
    Zhang, Weiwei
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024,