Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:0
|
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Linear Parameter Varying and Reinforcement Learning Approaches for Trajectory Tracking Controller of Autonomous Vehicles
    Mihály, András
    Vu, Van Tan
    Do, Trong Tu
    Thinh, Kieu Duc
    Van Vinh, Nguyen
    Gáspár, Péter
    [J]. Periodica Polytechnica Transportation Engineering, 2025, 53 (01): : 94 - 102
  • [2] Trajectory tracking algorithm for autonomous vehicles using adaptive reinforcement learning
    De Paula, Mariano
    Acosta, Gerardo G.
    [J]. OCEANS 2015 - MTS/IEEE WASHINGTON, 2015,
  • [3] Trajectory tracking control of vectored thruster autonomous underwater vehicles based on deep reinforcement learning
    Liu, Tao
    Zhao, Jintao
    Hu, Yuli
    Huang, Junhao
    [J]. SHIPS AND OFFSHORE STRUCTURES, 2024,
  • [4] Adaptive Fuzzy Control of Autonomous Surface Vehicles for Fast Accurate Trajectory Tracking
    Zhang, Xuefeng
    Su, Shun-Feng
    Chen, Yang-Quan
    [J]. INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2023, 25 (06) : 2411 - 2422
  • [5] Adaptive Fuzzy Control of Autonomous Surface Vehicles for Fast Accurate Trajectory Tracking
    Xuefeng Zhang
    Shun-Feng Su
    Yang-Quan Chen
    [J]. International Journal of Fuzzy Systems, 2023, 25 : 2411 - 2422
  • [6] Fast and Accurate Trajectory Tracking for Unmanned Aerial Vehicles based on Deep Reinforcement Learning
    Li, Yilan
    Li, Hongjia
    Li, Zhe
    Fang, Haowen
    Sanyal, Amit K.
    Wang, Yanzhi
    Qiu, Qinru
    [J]. 2019 IEEE 25TH INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS (RTCSA 2019), 2019,
  • [7] Lateral Trajectory Tracking Control for Autonomous Vehicles
    Rathgeber, Christian
    Winkler, Franz
    Odenthal, Dirk
    Mueller, Steffen
    [J]. 2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, : 1024 - 1029
  • [8] Encapsulated trajectory tracking control for autonomous vehicles
    Tobias Homolla
    Hermann Winner
    [J]. Automotive and Engine Technology, 2022, 7 (3-4) : 295 - 306
  • [9] Formation cooperative trajectory tracking control for unmanned aerial vehicles via differential game and reinforcement learning
    Wang, Xiaoheng
    Xiao, Zhihe
    Ren, Ziming
    Dong, Chunzhu
    Tian, Xuan Dan
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2024,
  • [10] Trajectory tracking control for underactuated autonomous vehicles via adaptive dynamic programming
    Han, Xiumei
    Zhao, Xudong
    Xu, Xiaolu
    Mei, Congli
    Xing, Wei
    Wang, Xinwei
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (01): : 474 - 488