Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:0
|
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Sampling Rate Selection for Trajectory Tracking Control of Autonomous Vehicles
    Li, Mengyang
    Wang, Yafei
    Zhou, Zhisong
    Yin, Chengliang
    [J]. 2019 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2019,
  • [22] Immersion and Invariance Control for Reference Trajectory Tracking of Autonomous Vehicles
    Tagne, Gilles
    Talj, Reine
    Charara, Ali
    [J]. 2013 16TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS - (ITSC), 2013, : 2322 - 2328
  • [23] Continuous Control of Autonomous Vehicles using Plan-assisted Deep Reinforcement Learning
    Dwivedi, Tanay
    Betz, Tobias
    Sauerbeck, Florian
    Manivannan, P., V
    Lienkamp, Markus
    [J]. 2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 244 - 250
  • [24] Fast Trajectory Tracking Control of Underactuated Autonomous Underwater Vehicles
    Qiao, Lei
    Zhang, Weidong
    [J]. 2018 IEEE 8TH INTERNATIONAL CONFERENCE ON UNDERWATER SYSTEM TECHNOLOGY: THEORY AND APPLICATIONS (USYS), 2018,
  • [25] Trajectory tracking for autonomous vehicles: An integrated approach to guidance and control
    Kaminer, I
    Pascoal, A
    Hallberg, E
    Silvestre, C
    [J]. JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 1998, 21 (01) : 29 - 38
  • [26] Obstacle Avoidance Trajectory Planning and Trajectory Tracking Control for Autonomous Underwater Vehicles
    Chu, Zhenzhong
    Zhu, Daqi
    [J]. 2018 13TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2018, : 450 - 454
  • [27] Predictive trajectory planning for autonomous vehicles at intersections using reinforcement learning
    Zhang, Ethan
    Zhang, Ruixuan
    Masoud, Neda
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 149
  • [28] Predictive Control via Augmented Lagrange Function for Autonomous Vehicles Trajectory Tracking with Dynamic Quantization
    Yu, Zhaojin
    Tang, Xiaoming
    Lv, Xiao
    Cao, Yongzhen
    Yang, Yang
    [J]. CONTROL ENGINEERING AND APPLIED INFORMATICS, 2024, 26 (02): : 14 - 24
  • [29] Fault Tolerant Control for Autonomous Surface Vehicles via Model Reference Reinforcement Learning
    Zhang, Qingrui
    Zhang, Xinyu
    Zhu, Bo
    Reppa, Vasso
    [J]. 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 1536 - 1541
  • [30] Trajectory Tracking for Autonomous Vehicles Using Robust Model Predictive Control
    Shen, Dan
    Chen, Yaobin
    Li, Lingxi
    Hu, Jianghai
    [J]. IFAC PAPERSONLINE, 2024, 58 (10): : 94 - 101