Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

被引:1
|
作者
Chen, Ting [1 ]
Chen, Youjing [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Tu, Huizhao [2 ]
Li, Siyu [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd, Traff Engn Minist Educ, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
self-driving vehicles; latent states; variational autoencoder; deep reinforcement learning; INFORMATION; MODEL;
D O I
10.3390/s22249943
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the rapid development of artificial intelligent technology, the deep learning method is widely applied to predict human driving intentions due to its relative accuracy of prediction, which is one of critical links for security guarantee in the distributed, mixed driving scenario. In order to sense the intention of human-driven vehicles and reduce the self-driving collision avoidance rate, an improved intention prediction method for human-driving vehicles based on unsupervised, deep inverse reinforcement learning is proposed. Firstly, a contrast discriminator module was proposed to extract richer features. Then, the residual module was created to overcome the drawbacks of gradient disappearance and network degradation with the increase in network layers. Furthermore, the dropout layer was generated to prevent the over-fitting phenomenon in the whole training process of the GRU network, so as to improve the generalization ability of the network model. Finally, abundant experiments were conducted on datasets to evaluate our proposed method. The pass rate of self-driving vehicles with conservative driver probabilities of p = 0.25, p = 0.4, and p = 0.6 improved by a maximum of 8%, 10%, and 3%, compared with the classical method LSTM and VAE + RNN. It indicates that the prediction results of our proposed method fit more with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Soft collision avoidance based car following algorithm for autonomous driving with reinforcement learning
    Zheng, Yuqi
    Yan, Ruidong
    Jia, Bin
    Jiang, Rui
    Zheng, Shiteng
    Physica A: Statistical Mechanics and its Applications, 2024, 654
  • [2] A Reinforcement Learning approach for pedestrian collision avoidance and trajectory tracking in autonomous driving systems
    Russo, Luigi
    Terlizzi, Mario
    Tipaldi, Massimo
    Glielmo, Luigi
    5TH CONFERENCE ON CONTROL AND FAULT-TOLERANT SYSTEMS (SYSTOL 2021), 2021, : 44 - 49
  • [3] Deep reinforcement learning based collision avoidance system for autonomous ships
    Wang, Yong
    Xu, Haixiang
    Feng, Hui
    He, Jianhua
    Yang, Haojie
    Li, Fen
    Yang, Zhen
    OCEAN ENGINEERING, 2024, 292
  • [4] Deep reinforcement learning-based collision avoidance for an autonomous ship
    Chun, Do-Hyun
    Roh, Myung-Il
    Lee, Hye-Won
    Ha, Jisang
    Yu, Donghun
    OCEAN ENGINEERING, 2021, 234
  • [5] A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios
    Liu, Yuqi
    Zhang, Qichao
    Zhao, Dongbin
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [6] Deep Reinforcement Learning for Collision Avoidance of Autonomous Vehicle
    Tseng, Hsiao-Ting
    Hsieh, Chen-Chiung
    Lin, Wei-Ting
    Lin, Jyun-Ting
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
  • [7] Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety
    Chen, Haochong
    Cao, Xincheng
    Guvenc, Levent
    Aksun-Guvenc, Bilin
    ELECTRONICS, 2024, 13 (10)
  • [8] Autonomous Driving Learning Preference of Collision Avoidance Maneuvers
    Nagahama, Akihito
    Saito, Takahiro
    Wada, Takahiro
    Sonoda, Kohei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (09) : 5624 - 5634
  • [9] Research on autonomous collision avoidance of merchant ship based on inverse reinforcement learning
    Zheng, Mao
    Xie, Shuo
    Chu, Xiumin
    Zhu, Tianquan
    Tian, Guohao
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (06)
  • [10] Perception for collision avoidance and autonomous driving
    Aufrère, R
    Gowdy, J
    Mertz, C
    Thorpe, C
    Wang, CC
    Yata, T
    MECHATRONICS, 2003, 13 (10) : 1149 - 1161