Intelligent Safety Decision-Making for Autonomous Vehicle in Highway Environment

被引:0
|
作者
Jiang, Zhenyu [1 ]
Wang, Zhongli [1 ,2 ]
Cui, Xin [3 ]
Zheng, Chaochao [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Informat Engn, Beijing, Peoples R China
[2] Beijing Engn Res Ctr EMC&GNSS Technol Rail Transp, Beijing 100044, Peoples R China
[3] China Railway Electrificat Bur Grp Co Ltd, Beijing 100036, Peoples R China
关键词
Decision-making; Deep reinforcement learning; Lyapunov function; Safety threshold; Reward function;
D O I
10.1007/978-3-030-89092-6_64
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Safe driving policies is the key technology to realize the adaptive cruise control of autonomous vehicle in highway environment. In this paper, the reinforcement learning method is applied to autonomous driving's decision-making. To solve the problem that present reinforcement learning methods are difficult to deal with the randomness and uncertainty in driving environment, a model-free method for analyzing the Lyapunov stability and H infinity performance is applied to Actor-Critic algorithm to improve the stability and robustness of reinforcement learning. The safety of taking an action is judged by setting a safety threshold, thus improving the safety of behavioral decisions. Our method also designs a set of reward functions to better meet the safety and efficiency of driving decisions in the highway environment. The results show that the method can provide safe driving strategies for driverless vehicles in both normal road conditions and environments with unexpected situations, enabling the vehicles to drive safely.
引用
收藏
页码:702 / 713
页数:12
相关论文
共 50 条
  • [21] Assurance levels for decision making in autonomous intelligent systems and their safety
    Fourastier, Yannick
    Baron, Claude
    Thomas, Carsten
    Esteban, Philippe
    [J]. 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS, SERVICES AND TECHNOLOGIES (DESSERT): IOT, BIG DATA AND AI FOR A SAFE & SECURE WORLD AND INDUSTRY 4.0, 2020, : 475 - 483
  • [22] Foraging Theory for Autonomous Vehicle Decision-making System Design
    Burton W. Andrews
    Kevin M. Passino
    Thomas A. Waite
    [J]. Journal of Intelligent and Robotic Systems, 2007, 49 : 39 - 65
  • [23] Foraging theory for autonomous vehicle decision-making system design
    Andrews, Burton W.
    Passino, Kevin M.
    Waite, Thomas A.
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2007, 49 (01) : 39 - 65
  • [24] Ethical decision-making responsibility in Canadian autonomous vehicle policies
    Mokrian, Kiana
    Schuelke-Leech, Beth-Anne
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON TECHNOLOGY AND SOCIETY (ISTAS21): TECHNOLOGICAL STEWARDSHIP & RESPONSIBLE INNOVATION, 2021,
  • [25] Highway Traffic Modeling and Decision Making for Autonomous Vehicle Using Reinforcement Learning
    You, Changxi
    Lu, Jianbo
    Filev, Dimitar
    Tsiotras, Panagiotis
    [J]. 2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1227 - 1232
  • [26] Path Planning and Decision Making for Autonomous Vehicle in Urban Environment
    Fu, Mengyin
    Song, Wenjie
    Yang, Yi
    Wang, Meiling
    [J]. 2015 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, : 686 - 692
  • [27] Research on robust decision making for intelligent connected vehicle at highway on-ramp
    Fang, Huazhen
    Liu, Li
    Gu, Qing
    Xiao, Xiaofeng
    Meng, Yu
    [J]. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 2024,
  • [28] Driving decision-making analysis of car-following for autonomous vehicle under complex urban environment
    陈雪梅
    金敏
    苗一松
    张强
    [J]. Journal of Central South University, 2017, 24 (06) : 1476 - 1482
  • [29] Decision-Making Strategy on Highway for Autonomous Vehicles Using Deep Reinforcement Learning
    Liao, Jiangdong
    Liu, Teng
    Tang, Xiaolin
    Mu, Xingyu
    Huang, Bing
    Cao, Dongpu
    [J]. IEEE ACCESS, 2020, 8 : 177804 - 177814
  • [30] Driving Decision-making Analysis Of Car-following For Autonomous Vehicle Under Complex Urban Environment
    Chen, Xue-Mei
    Miao, Yi-Song
    [J]. PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2016, : 315 - 319