Driving Decisions for Autonomous Vehicles in Intersection Environments: Deep Reinforcement Learning Approaches with Risk Assessment

被引:1
|
作者
Yu, Wangpengfei [1 ]
Qian, Yubin [1 ]
Xu, Jiejie [1 ]
Sun, Hongtao [1 ]
Wang, Junxiang [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Mech & Automot Engn, Shanghai 201620, Peoples R China
来源
WORLD ELECTRIC VEHICLE JOURNAL | 2023年 / 14卷 / 04期
关键词
intelligent vehicle; decision-making; driving safety; deep reinforcement learning; risk assessment; SITUATION ASSESSMENT;
D O I
10.3390/wevj14040079
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Intersection scenarios are one of the most complex and high-risk traffic scenarios. Therefore, it is important to propose a vehicle driving decision algorithm for intersection scenarios. Most of the related studies have focused on considering explicit collision risks while lacking consideration for potential driving risks. Therefore, this study proposes a deep-reinforcement-learning-based driving decision algorithm to address these problems. In this study, a non-deterministic vehicle driving risk assessment method is proposed for intersection scenarios and introduced into a learning-based intelligent driving decision algorithm. In addition, this study proposes an attention network based on state information. In this study, a typical intersection scenario was constructed using simulation software, and experiments were conducted. The experimental results show that the algorithm proposed in this paper can effectively derive a driving strategy with both driving efficiency and driving safety in the intersection driving scenario. It is also demonstrated that the attentional neural network designed in this study helps intelligent vehicles to perceive the surrounding environment more accurately, improves the performance of intelligent vehicles, as well as accelerates the convergence speed.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Intersection Crossing for Autonomous Vehicles based on Deep Reinforcement Learning
    Chen, Wei-Lun
    Lee, Kwan-Hung
    Hsiung, Pao-Ann
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [2] Tactical driving decisions of unmanned ground vehicles in complex highway environments: A deep reinforcement learning approach
    Wang, Huanjie
    Yuan, Shihua
    Guo, Mengyu
    Chan, Ching-Yao
    Li, Xueyuan
    Lan, Wei
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2021, 235 (04) : 1113 - 1127
  • [3] Driving Tasks Transfer Using Deep Reinforcement Learning for Decision-Making of Autonomous Vehicles in Unsignalized Intersection
    Shu, Hong
    Liu, Teng
    Mu, Xingyu
    Cao, Dongpu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (01) : 41 - 52
  • [4] Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning
    Qi, Xiao
    Ye, Yingjun
    Sun, Jian
    [J]. CICTP 2019: TRANSPORTATION IN CHINA-CONNECTING THE WORLD, 2019, : 5853 - 5864
  • [5] A Comprehensive Survey on the Application of Deep and Reinforcement Learning Approaches in Autonomous Driving
    Ben Elallid, Badr
    Benamar, Nabil
    Hafid, Abdelhakim Senhaji
    Rachidi, Tajjeeddine
    Mrani, Nabil
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (09) : 7366 - 7390
  • [6] A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios
    Liu, Yuqi
    Zhang, Qichao
    Zhao, Dongbin
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [7] Deep reinforcement-learning-based driving policy for autonomous road vehicles
    Makantasis, Konstantinos
    Kontorinaki, Maria
    Nikolos, Ioannis
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (01) : 13 - 24
  • [8] Decision making of autonomous vehicles in lane change scenarios: Deep reinforcement learning approaches with risk awareness
    Li, Guofa
    Yang, Yifan
    Li, Shen
    Qu, Xingda
    Lyu, Nengchao
    Li, Shengbo Eben
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2022, 134
  • [9] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [10] Design of Unsignalized Roundabouts Driving Policy of Autonomous Vehicles Using Deep Reinforcement Learning
    Wang, Zengrong
    Liu, Xujin
    Wu, Zhifei
    [J]. WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (02):