Predictive cruise control of connected and autonomous vehicles via reinforcement learning

被引:16
|
作者
Gao, Weinan [1 ]
Odekunle, Adedapo [1 ]
Chen, Yunfeng [2 ]
Jiang, Zhong-Ping [3 ]
机构
[1] Georgia Southern Univ, Allen E Paulson Coll Engn & Comp, Dept Elect & Comp Engn, Statesboro, GA 30460 USA
[2] Purdue Univ, Purdue Polytech Inst, Dept Construct Management Technol, W Lafayette, IN 47907 USA
[3] NYU, Tandon Sch Engn, Dept Elect & Comp Engn, Brooklyn, NY 11201 USA
来源
IET CONTROL THEORY AND APPLICATIONS | 2019年 / 13卷 / 17期
关键词
road vehicles; optimal control; adaptive control; learning (artificial intelligence); predictive control; velocity control; distributed control; road traffic control; mobile robots; acceleration control; reinforcement learning; autonomous vehicle; data-driven adaptive optimal control algorithm; vehicle safety; passenger comfort; predictive cruise control; connected vehicles; distributed optimal controllers; suboptimal control; velocity regulation; headway regulation; acceleration regulation; TIME MULTIAGENT SYSTEMS; OUTPUT REGULATION; CONSENSUS;
D O I
10.1049/iet-cta.2018.6031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predictive cruise control concerns designing controllers for autonomous vehicles using the broadcasted information from the traffic lights such that the idle time around the intersection can be reduced. This study proposes a novel adaptive optimal control approach based on reinforcement learning to solve the predictive cruise control problem of a platoon of connected and autonomous vehicles. First, the reference velocity is determined for each autonomous vehicle in the platoon. Second, a data-driven adaptive optimal control algorithm is developed to estimate the gains of the desired distributed optimal controllers without the exact knowledge of system dynamics. The obtained controller is able to regulate the headway, velocity, and acceleration of each vehicle in a suboptimal sense. The goal of trip time reduction is achieved without compromising vehicle safety and passenger comfort. Numerical simulations are presented to validate the efficacy of the proposed methodology.
引用
收藏
页码:2849 / 2855
页数:7
相关论文
共 50 条
  • [1] Delay-feedback predictive cruise control of autonomous and connected vehicles
    He D.-F.
    Luo J.
    Shu X.-X.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2021, 51 (01): : 349 - 357
  • [2] Learning Model Predictive Control for Connected Autonomous Vehicles
    Jafarzadeh, Hassan
    Fleming, Cody
    [J]. 2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 2336 - 2343
  • [3] Predictive Cruise Control of Connected and Autonomous Vehicles : An Adaptive Dynamic Programming Approach
    Odekunle, Adedapo
    Gao, Weinan
    Anayor, Chikamso
    Wang, Xi
    Chen, Yunfeng
    [J]. IEEE SOUTHEASTCON 2018, 2018,
  • [4] Reinforcement Learning-Based Predictive Control for Autonomous Electrified Vehicles
    Liu, Teng
    Yang, Chao
    Hu, Chuanzheng
    Wang, Hong
    Li, Li
    Cao, Dongpu
    Wang, Fei-Yue
    [J]. 2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 185 - 190
  • [5] Platoon control of connected autonomous vehicles: A distributed reinforcement learning method by consensus
    Liu, Bo
    Ding, Zhengtao
    Lv, Chen
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 15241 - 15246
  • [6] Freeway Congestion Management With Reinforcement Learning Headway Control of Connected and Autonomous Vehicles
    Elmorshedy, Lina
    Smirnov, Ilia
    Abdulhai, Baher
    [J]. TRANSPORTATION RESEARCH RECORD, 2023, 2677 (07) : 340 - 358
  • [7] A Deep Reinforcement Learning Decision-Making Approach for Adaptive Cruise Control in Autonomous Vehicles
    Ghraizi, Dany
    Talj, Reine
    Francis, Clovis
    [J]. 2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 71 - 78
  • [8] Autonomous Predictive Modeling via Reinforcement Learning
    Khurana, Udayan
    Samulowitz, Horst
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 3285 - 3288
  • [9] Gaussian learning-based fuzzy predictive cruise control for improving safety and economy of connected vehicles
    He, Defeng
    Peng, Binbin
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (05) : 346 - 355
  • [10] Cooperative Adaptive Cruise Control of Connected and Autonomous Vehicles Subject to Input Saturation
    Gao, Weinan
    Rios-Gutierrez, Fernando
    Tong, Weitian
    Chen, Lei
    [J]. 2017 IEEE 8TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS AND MOBILE COMMUNICATION CONFERENCE (UEMCON), 2017,