Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

被引:1
|
作者
Chen, Ting [1 ]
Chen, Youjing [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Tu, Huizhao [2 ]
Li, Siyu [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd, Traff Engn Minist Educ, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
self-driving vehicles; latent states; variational autoencoder; deep reinforcement learning; INFORMATION; MODEL;
D O I
10.3390/s22249943
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the rapid development of artificial intelligent technology, the deep learning method is widely applied to predict human driving intentions due to its relative accuracy of prediction, which is one of critical links for security guarantee in the distributed, mixed driving scenario. In order to sense the intention of human-driven vehicles and reduce the self-driving collision avoidance rate, an improved intention prediction method for human-driving vehicles based on unsupervised, deep inverse reinforcement learning is proposed. Firstly, a contrast discriminator module was proposed to extract richer features. Then, the residual module was created to overcome the drawbacks of gradient disappearance and network degradation with the increase in network layers. Furthermore, the dropout layer was generated to prevent the over-fitting phenomenon in the whole training process of the GRU network, so as to improve the generalization ability of the network model. Finally, abundant experiments were conducted on datasets to evaluate our proposed method. The pass rate of self-driving vehicles with conservative driver probabilities of p = 0.25, p = 0.4, and p = 0.6 improved by a maximum of 8%, 10%, and 3%, compared with the classical method LSTM and VAE + RNN. It indicates that the prediction results of our proposed method fit more with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] COLREGs-abiding hybrid collision avoidance algorithm based on deep reinforcement learning for USVs
    Xu, Xinli
    Lu, Yu
    Liu, Gang
    Cai, Peng
    Zhang, Weidong
    OCEAN ENGINEERING, 2022, 247
  • [42] An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics
    Sun, Zhe
    Fan, Yunsheng
    Wang, Guofeng
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (04)
  • [43] Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs
    Zhao, Yu
    Guo, Jifeng
    Bai, Chengchao
    Zheng, Hongxing
    COMPLEXITY, 2021, 2021
  • [44] A Disturbance Activation Approach to Collision Avoidance Autonomous Driving
    Jond, Hossein B.
    Platos, Jan
    2019 5TH IRANIAN CONFERENCE ON SIGNAL PROCESSING AND INTELLIGENT SYSTEMS (ICSPIS 2019), 2019,
  • [45] A 'Cognitive Driving Framework' for Collision Avoidance in Autonomous Vehicles
    Hamlet, Alan J.
    Crane, Carl D.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2015, 6 (05) : 117 - 124
  • [46] Collision Avoidance in On-Road Environment for Autonomous Driving
    Noh, Samyeul
    Han, Woo-Yong
    2014 14TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2014), 2014, : 884 - 889
  • [47] A Study on an Enhanced Autonomous Driving Simulation Model Based on Reinforcement Learning Using a Collision Prevention Model
    Kim, Jong-Hoon
    Huh, Jun-Ho
    Jung, Se-Hoon
    Sim, Chun-Bo
    ELECTRONICS, 2021, 10 (18)
  • [48] Autonomous highway driving using reinforcement learning with safety check system based on time-to-collision
    Xiaotong Nie
    Yupeng Liang
    Kazuhiro Ohkura
    Artificial Life and Robotics, 2023, 28 : 158 - 165
  • [49] Autonomous highway driving using reinforcement learning with safety check system based on time-to-collision
    Nie, Xiaotong
    Liang, Yupeng
    Ohkura, Kazuhiro
    ARTIFICIAL LIFE AND ROBOTICS, 2023, 28 (01) : 158 - 165
  • [50] An Aircraft Collision Avoidance Method Based on Deep Reinforcement Learning
    Liu, Zuocheng
    Neretin, Evgeny
    Gao, Xiaoguang
    Wan, Kaifang
    2024 9TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS ENGINEERING, ICCRE 2024, 2024, : 241 - 246