Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

被引:1
|
作者
Chen, Ting [1 ]
Chen, Youjing [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Tu, Huizhao [2 ]
Li, Siyu [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd, Traff Engn Minist Educ, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
self-driving vehicles; latent states; variational autoencoder; deep reinforcement learning; INFORMATION; MODEL;
D O I
10.3390/s22249943
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the rapid development of artificial intelligent technology, the deep learning method is widely applied to predict human driving intentions due to its relative accuracy of prediction, which is one of critical links for security guarantee in the distributed, mixed driving scenario. In order to sense the intention of human-driven vehicles and reduce the self-driving collision avoidance rate, an improved intention prediction method for human-driving vehicles based on unsupervised, deep inverse reinforcement learning is proposed. Firstly, a contrast discriminator module was proposed to extract richer features. Then, the residual module was created to overcome the drawbacks of gradient disappearance and network degradation with the increase in network layers. Furthermore, the dropout layer was generated to prevent the over-fitting phenomenon in the whole training process of the GRU network, so as to improve the generalization ability of the network model. Finally, abundant experiments were conducted on datasets to evaluate our proposed method. The pass rate of self-driving vehicles with conservative driver probabilities of p = 0.25, p = 0.4, and p = 0.6 improved by a maximum of 8%, 10%, and 3%, compared with the classical method LSTM and VAE + RNN. It indicates that the prediction results of our proposed method fit more with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Intent-based Deep Reinforcement Learning for Multi-agent Informative Path Planning
    Yang, Tianze
    Cao, Yuhong
    Sartoretti, Guillaume
    2023 INTERNATIONAL SYMPOSIUM ON MULTI-ROBOT AND MULTI-AGENT SYSTEMS, MRS, 2023, : 71 - 77
  • [32] Autonomous Obstacle Avoidance Algorithm for Unmanned Aerial Vehicles Based on Deep Reinforcement Learning
    Gao, Yuan
    Ren, Ling
    Shi, Tianwei
    Xu, Teng
    Ding, Jianbang
    ENGINEERING LETTERS, 2024, 32 (03) : 650 - 660
  • [33] Intent-based multi-agent reinforcement learning for service assurance in cellular networks
    Perepu, Satheesh K.
    Martins, Jean P.
    Souza, Ricardo S.
    Dey, Kaushik
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2879 - 2884
  • [34] Intersection Collision Avoidance: From Driver Alerts to Vehicle Control
    Maile, M.
    Chen, Q.
    Brown, G.
    Delgrossi, L.
    2015 IEEE 81ST VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2015,
  • [35] LossLeaP: Learning to Predict for Intent-Based Networking
    Collet, Alan
    Banchs, Albert
    Fiore, Marco
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, : 2138 - 2147
  • [36] Static and Dynamic Collision Avoidance for Autonomous Robot Navigation in Diverse Scenarios based on Deep Reinforcement Learning
    Pico, Nabih
    Lee, Beomjoon
    Montero, Estrella
    Tadese, Meseret
    Auh, Eugene
    Doh, Myeongyun
    Moon, Hyungpil
    2023 20TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR, 2023, : 281 - 286
  • [37] Method for collision avoidance based on deep reinforcement learning with path-speed control for an autonomous ship
    Chun, Do-Hyun
    Roh, Myung-Il
    Lee, Hye-Won
    Yu, Donghun
    INTERNATIONAL JOURNAL OF NAVAL ARCHITECTURE AND OCEAN ENGINEERING, 2024, 16
  • [38] Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm
    Ashraf, Nesma M.
    Mostafa, Reham R.
    Sakr, Rasha H.
    Rashad, M. Z.
    PLOS ONE, 2021, 16 (06):
  • [39] Intersection Crossing for Autonomous Vehicles based on Deep Reinforcement Learning
    Chen, Wei-Lun
    Lee, Kwan-Hung
    Hsiung, Pao-Ann
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [40] Intersection collision risk evaluation and active collision avoidance strategies for autonomous vehicles
    Zhang, Jian
    Chen, Ning
    Chen, Yandong
    Wang, Peng
    Zhang, Yong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024,