Intelligent Safety Decision-Making for Autonomous Vehicle in Highway Environment

被引:0
|
作者
Jiang, Zhenyu [1 ]
Wang, Zhongli [1 ,2 ]
Cui, Xin [3 ]
Zheng, Chaochao [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Informat Engn, Beijing, Peoples R China
[2] Beijing Engn Res Ctr EMC&GNSS Technol Rail Transp, Beijing 100044, Peoples R China
[3] China Railway Electrificat Bur Grp Co Ltd, Beijing 100036, Peoples R China
关键词
Decision-making; Deep reinforcement learning; Lyapunov function; Safety threshold; Reward function;
D O I
10.1007/978-3-030-89092-6_64
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Safe driving policies is the key technology to realize the adaptive cruise control of autonomous vehicle in highway environment. In this paper, the reinforcement learning method is applied to autonomous driving's decision-making. To solve the problem that present reinforcement learning methods are difficult to deal with the randomness and uncertainty in driving environment, a model-free method for analyzing the Lyapunov stability and H infinity performance is applied to Actor-Critic algorithm to improve the stability and robustness of reinforcement learning. The safety of taking an action is judged by setting a safety threshold, thus improving the safety of behavioral decisions. Our method also designs a set of reward functions to better meet the safety and efficiency of driving decisions in the highway environment. The results show that the method can provide safe driving strategies for driverless vehicles in both normal road conditions and environments with unexpected situations, enabling the vehicles to drive safely.
引用
收藏
页码:702 / 713
页数:12
相关论文
共 50 条
  • [1] Intelligent, In-Vehicle Autonomous Decision-Making Functionality for Driving Style Reconfigurations
    Panagiotopoulos, Ilias
    Dimitrakopoulos, George
    [J]. ELECTRONICS, 2023, 12 (06)
  • [2] ENVIRONMENT - NEW PROMINENCE IN HIGHWAY DECISION-MAKING
    ROSANDER, GE
    [J]. JOURNAL OF SOIL AND WATER CONSERVATION, 1972, 27 (03): : 121 - &
  • [3] Towards Robust Decision-Making for Autonomous Driving on Highway
    Yang, Kai
    Tang, Xiaolin
    Qiu, Sen
    Jin, Shufeng
    Wei, Zichun
    Wang, Hong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (09) : 11251 - 11263
  • [4] Spatial Attention for Autonomous Decision-making in Highway Scene
    Zhang, Shuwei
    Wu, Yutian
    Ogai, Harutoshi
    [J]. 2020 59TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2020, : 1435 - 1440
  • [5] INTELLIGENT DECISION-MAKING SYSTEM FOR AUTONOMOUS ROBOTS
    Kowalczuk, Zdzislaw
    Czubenko, Michal
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2011, 21 (04) : 671 - 684
  • [6] Behavior Decision-making Method for Autonomous Vehicle
    Yang, Run
    Liu, Hang
    Yang, Cheng
    Zhou, Mingliang
    Cen, Ming
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 772 - 778
  • [7] An Intelligent Lane-Changing Behavior Prediction and Decision-Making Strategy for an Autonomous Vehicle
    Wang, Weida
    Qie, Tianqi
    Yang, Chao
    Liu, Wenjie
    Xiang, Changle
    Huang, Kun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (03) : 2927 - 2937
  • [8] Multi-level Bayesian decision-making for safe and flexible autonomous navigation in highway environment
    Iberraken, Dimia
    Adouane, Lounis
    Denis, Dieumet
    [J]. 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 3984 - 3990
  • [9] Analysing the Safety of Decision-Making in Autonomous Systems
    Osborne, Matt
    Hawkins, Richard
    McDermid, John
    [J]. COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2022, 2022, 13414 : 3 - 16
  • [10] Highway Operation Safety Management Decision-Making Model
    Zhang Huili
    Sun Hailong
    Kang Yongzheng
    [J]. INNOVATIVE COMPUTING AND INFORMATION, ICCIC 2011, PT I, 2011, 231 : 161 - 165