A DECISION-MAKING METHOD FOR AUTONOMOUS VEHICLES BASED ON SIMULATION AND REINFORCEMENT LEARNING

被引:0
|
作者
Zheng, Rui [1 ]
Liu, Chunming [1 ]
Guo, Qi [1 ]
机构
[1] Natl Univ Def Technol, Coll Mechatron & Automat, Changsha 410073, Hunan, Peoples R China
关键词
Autonomous Vehicles; Reinforcement learning; Markov Decision Process; Autonomous driving; Decision-making; SYSTEM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are still some problems need to be solved though there are a lot of achievements in the field of automatic driving. One of those problems is the difficulty of designing a decision-making system for complex traffic conditions. In recent years, reinforcement learning (RL) shows the potential in solving sequential decision optimization problems, which can be modeled as Markov decision processes (MDPs). In this paper, we establish a 14-DOF dynamic model of an autonomous vehicle and use RL to build a decision-making system for autonomous driving based on simulation. The decision-making process of the vehicle is modeled as an MDP, and the performance of the MDP is improved using an approximate RL. At last, we show the efficiency of the proposed method by simulation in a highway environment.
引用
收藏
页码:362 / 369
页数:8
相关论文
共 50 条
  • [1] A Decision-Making Model for Autonomous Vehicles at Intersections Based on Hierarchical Reinforcement Learning
    Chen, Xue-Mei
    Xu, Shu-Yuan
    Wang, Zi-Jia
    Zheng, Xue-Long
    Han, Xin-Tong
    Liu, En-Hao
    [J]. UNMANNED SYSTEMS, 2024, 12 (04) : 641 - 652
  • [2] Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles
    Yuan, Mingfeng
    Shan, Jinjun
    Mi, Kevin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 818 - 825
  • [3] Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning
    Xu, Shu-Yuan
    Chen, Xue-Mei
    Wang, Zi-Jia
    Hu, Yu-Hui
    Han, Xin-Tong
    [J]. 2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 672 - 677
  • [4] A Decision-making Method for Longitudinal Autonomous Driving Based on Inverse Reinforcement Learning
    Gao Z.
    Yan X.
    Gao F.
    [J]. Qiche Gongcheng/Automotive Engineering, 2022, 44 (07): : 969 - 975
  • [5] Research on decision-making of autonomous vehicle following based on reinforcement learning method
    Gao, Hongbo
    Shi, Guanya
    Wang, Kelong
    Xie, Guotao
    Liu, Yuchao
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2019, 46 (03): : 444 - 452
  • [6] A Reinforcement Learning based Decision-making System with Aggressive Driving Behavior Consideration for Autonomous Vehicles
    Kang, Liuwang
    Shen, Haiying
    [J]. 2021 18TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON), 2021,
  • [7] Decision-Making in Fallback Scenarios for Autonomous Vehicles: Deep Reinforcement Learning Approach
    Lee, Cheonghwa
    An, Dawn
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [8] Decision-Making Strategy on Highway for Autonomous Vehicles Using Deep Reinforcement Learning
    Liao, Jiangdong
    Liu, Teng
    Tang, Xiaolin
    Mu, Xingyu
    Huang, Bing
    Cao, Dongpu
    [J]. IEEE ACCESS, 2020, 8 (08): : 177804 - 177814
  • [9] An Autonomous Attack Decision-Making Method Based on Hierarchical Virtual Bayesian Reinforcement Learning
    Wang, Dinghan
    Zhang, Jiandong
    Yang, Qiming
    Liu, Jieling
    Shi, Guoqing
    Zhang, Yaozhong
    [J]. IEEE Transactions on Aerospace and Electronic Systems, 2024, 60 (05) : 7075 - 7088
  • [10] An actor-critic based learning method for decision-making and planning of autonomous vehicles
    XU Can
    ZHAO WanZhong
    CHEN QingYun
    WANG ChunYan
    [J]. Science China Technological Sciences, 2021, 64 (05) : 984 - 994