Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:0
|
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Steering control in autonomous vehicles using deep reinforcement learning
    [J]. Peng, Jia (jiapeng1018@163.com), 2018, Beijing University of Posts and Telecommunications (25):
  • [42] Reinforcement learning: The application to autonomous biomimetic underwater vehicles control
    Magalhaes, J.
    Damas, B.
    Lobo, V.
    [J]. 4TH INTERNATIONAL SCIENTIFIC CONFERENCE SEA-CONF 2018, 2018, 172
  • [43] A Control Strategy of Autonomous Vehicles based on Deep Reinforcement Learning
    Xia, Wei
    Li, Huiyun
    Li, Baopu
    [J]. PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2016, : 198 - 201
  • [44] Deep reinforcement learning based control for Autonomous Vehicles in CARLA
    Óscar Pérez-Gil
    Rafael Barea
    Elena López-Guillén
    Luis M. Bergasa
    Carlos Gómez-Huélamo
    Rodrigo Gutiérrez
    Alejandro Díaz-Díaz
    [J]. Multimedia Tools and Applications, 2022, 81 : 3553 - 3576
  • [45] Guidance and control of autonomous surface underwater vehicles for target tracking in ocean environment by deep reinforcement learning
    Song, Dalei
    Gan, Wenhao
    Yao, Peng
    Zang, Wenchuan
    Zhang, Zhixuan
    Qu, Xiuqing
    [J]. OCEAN ENGINEERING, 2022, 250
  • [46] Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles
    Zhang, Qingrui
    Pan, Wei
    Reppa, Vasso
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8770 - 8781
  • [47] Deep Reinforcement Learning for Autonomous Dynamic Skid Steer Vehicle Trajectory Tracking
    Srikonda, Sandeep
    Norris, William Robert
    Nottage, Dustin
    Soylemezoglu, Ahmet
    [J]. ROBOTICS, 2022, 11 (05)
  • [48] Supervised reinforcement learning based trajectory tracking control for autonomous vehicles András Mihály Van Tan Vu" Trong Tu Do
    Mihaly, Andras
    Vu, Van Tan
    Do, Trong Tu
    Gaspar, Peter
    [J]. IFAC PAPERSONLINE, 2024, 58 (10): : 140 - 145
  • [49] Trajectory Tracking Control of Autonomous Vehicles Based on an Improved Sliding Mode Control Scheme
    Ma, Baosen
    Pei, Wenhui
    Zhang, Qi
    [J]. ELECTRONICS, 2023, 12 (12)
  • [50] Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning
    Bayerlein, Harald
    de Kerret, Paul
    Gesbert, David
    [J]. 2018 IEEE 19TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2018, : 945 - 949