Joint Optimizing High-Speed Cruise Control and Multi-Hop Communication in Platoons: A Reinforcement Learning Approach

被引:0
|
作者
Hu, Wenbo [1 ]
Wang, Hongfeng [1 ]
Wang, Junwei [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle dynamics; Resource management; Adaptation models; Heuristic algorithms; Optimization; Vehicle-to-everything; Cruise control; Cooperative adaptive cruise control; autonomous vehicle; communication resource allocation; reinforcement learning; RESOURCE-ALLOCATION; NONLINEAR-SYSTEMS; STRING STABILITY; COMPENSATION; EFFICIENT; DESIGN; MODEL;
D O I
10.1109/TITS.2024.3428570
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
A platoon is a group of vehicles traveling in the same direction at a reasonable speed while maintaining a reasonable and safe distance. Robust model predictive control addresses vehicle stability, but evolving communication topology is a significant challenge for high-speed autonomous vehicles. A multi-hop communication model is proposed to improve communication quality within power and channel constraints, considering the Doppler effect and changes in vehicle spacing due to high speeds. This paper uses a Markov decision process to model communication and designs a reward function in reinforcement learning to enhance communication quality while reducing power usage. The efficiency of the learning process is enhanced by narrowing the search range for the signal transmission power of vehicles, informed by the characteristics of the communication model. The proposed model and algorithm's effectiveness and feasibility are confirmed through thorough simulations.
引用
收藏
页码:18396 / 18407
页数:12
相关论文
共 50 条
  • [21] Autonomous Vehicle Platoons in Urban Road Networks: A Joint Distributed Reinforcement Learning and Model Predictive Control Approach
    D'Alfonso, Luigi
    Giannini, Francesco
    Franze, Giuseppe
    Fedele, Giuseppe
    Pupo, Francesco
    Fortino, Giancarlo
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (01) : 141 - 156
  • [22] Reinforcement Learning-based Multi-hop Intelligent Route Selection for Vehicle-to-Vehicle Visible Light Communication
    Yin, Rong-rong
    Jia, Kuan-kuan
    Qin, Hao
    Zhai, Meng-fa
    Ma, Shao-ying
    He, Ming-qi
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1189 - 1194
  • [23] UAV path selection in multi-hop cooperative UAV-based networks: A deep reinforcement learning approach
    Pattepu, Sunil
    Datta, Amlan
    RESULTS IN ENGINEERING, 2025, 25
  • [24] High-Speed Concurrent Transmission Scheme for Full Duplex Multi-Hop Relay Assisted mmWave WPAN Networks
    Chang, Wenson
    Wu, Chien-Wen
    IEEE ACCESS, 2019, 7 : 162192 - 162205
  • [25] Coordinated cruise control for high-speed train movements based on a multi-agent model
    Li, Shukai
    Yang, Lixing
    Gao, Ziyou
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2015, 56 : 281 - 292
  • [26] Eco-cooperative adaptive cruise control for platoons in mixed traffic using single-agent and multi-agent reinforcement learning
    Yang, Zhiwei
    Zheng, Zuduo
    Kim, Jiwon
    Rakha, Hesham
    TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2025, 142
  • [27] Joint Communication Scheduling and Velocity Control in Multi-UAV-Assisted Sensor Networks: A Deep Reinforcement Learning Approach
    Emami, Yousef
    Wei, Bo
    Li, Kai
    Ni, Wei
    Tovar, Eduardo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 10986 - 10998
  • [28] A Policy-based Reinforcement Learning Approach for High-speed Railway Timetable Rescheduling
    Wang, Yin
    Lv, Yisheng
    Zhou, Jianying
    Yuan, Zhiming
    Zhang, Qi
    Zhou, Min
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 2362 - 2367
  • [29] A Deep Reinforcement Learning Approach to High-speed Train Timetable Rescheduling under Disturbances
    Ning, Lingbin
    Li, Yidong
    Zhou, Min
    Song, Haifeng
    Dong, Hairong
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 3469 - 3474
  • [30] Deep Reinforcement Learning Based Active Pantograph Control Strategy in High-Speed Railway
    Wang, Hui
    Han, Zhiwei
    Liu, Zhigang
    Wu, Yanbo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (01) : 227 - 238