Joint Optimizing High-Speed Cruise Control and Multi-Hop Communication in Platoons: A Reinforcement Learning Approach

被引:0
|
作者
Hu, Wenbo [1 ]
Wang, Hongfeng [1 ]
Wang, Junwei [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle dynamics; Resource management; Adaptation models; Heuristic algorithms; Optimization; Vehicle-to-everything; Cruise control; Cooperative adaptive cruise control; autonomous vehicle; communication resource allocation; reinforcement learning; RESOURCE-ALLOCATION; NONLINEAR-SYSTEMS; STRING STABILITY; COMPENSATION; EFFICIENT; DESIGN; MODEL;
D O I
10.1109/TITS.2024.3428570
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
A platoon is a group of vehicles traveling in the same direction at a reasonable speed while maintaining a reasonable and safe distance. Robust model predictive control addresses vehicle stability, but evolving communication topology is a significant challenge for high-speed autonomous vehicles. A multi-hop communication model is proposed to improve communication quality within power and channel constraints, considering the Doppler effect and changes in vehicle spacing due to high speeds. This paper uses a Markov decision process to model communication and designs a reward function in reinforcement learning to enhance communication quality while reducing power usage. The efficiency of the learning process is enhanced by narrowing the search range for the signal transmission power of vehicles, informed by the characteristics of the communication model. The proposed model and algorithm's effectiveness and feasibility are confirmed through thorough simulations.
引用
收藏
页码:18396 / 18407
页数:12
相关论文
共 50 条
  • [41] Improving the Congestion Control Performance for Mobile Networks in High-Speed Railway via Deep Reinforcement Learning
    Cui, Laizhong
    Yuan, Zuxian
    Ming, Zhongxing
    Yang, Shu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (06) : 5864 - 5875
  • [42] Optimizing the Post-Disaster Control of Islanded Microgrid: A Multi-Agent Deep Reinforcement Learning Approach
    Nie, Huanhuan
    Chen, Ying
    Xia, Yue
    Huang, Shaowei
    Liu, Bingqian
    IEEE ACCESS, 2020, 8 : 153455 - 153469
  • [43] Hierarchical Deep Reinforcement Learning for Self-Powered Monitoring and Communication Integrated System in High-Speed Railway Networks
    Ling, Zhuang
    Hu, Fengye
    Liu, Tanda
    Jia, Ziye
    Han, Zhu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) : 6336 - 6349
  • [44] Penetration Strategy for High-Speed Unmanned Aerial Vehicles: A Memory-Based Deep Reinforcement Learning Approach
    Zhang, Xiaojie
    Guo, Hang
    Yan, Tian
    Wang, Xiaoming
    Sun, Wendi
    Fu, Wenxing
    Yan, Jie
    DRONES, 2024, 8 (07)
  • [45] Nash Q-Learning Multi-Agent Flow Control for High-Speed Networks
    Jing, Yuanwei
    Li, Xin
    Dimirovski, Georgi M.
    Zheng, Yan
    Zhang, Siying
    2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 3304 - +
  • [46] A Reinforcement Learning-Based Pantograph Control Strategy for Improving Current Collection Quality in High-Speed Railways
    Wang, Hui
    Han, Zhiwei
    Liu, Wenqiang
    Wu, Yanbo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 5915 - 5928
  • [47] Model-Based Data-Efficient Reinforcement Learning for Active Pantograph Control in High-Speed Railways
    Wang, Hui
    Liu, Zhigang
    Wang, Xufan
    Meng, Xiangyu
    Wu, Yanbo
    Han, Zhiwei
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (02): : 2701 - 2712
  • [48] Spectrum Management in High-Speed Railway Cooperative Cognitive Radio Network Based on Multi-agent Reinforcement Learning
    Wang, Cheng
    Wu, Qingting
    Tang, Ziwen
    Sheng, Jie
    Wu, Cheng
    Wang, Yiming
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 702 - 707
  • [49] Optimizing Multi-coil Integrated High-speed On/Off Valves for Enhanced Dynamic Performance with Voltage Control Strategies
    Huang, Shuai
    Zhou, Hua
    Applied Computational Electromagnetics Society Journal, 2024, 39 (11): : 1019 - 1034
  • [50] Contrastive Learning-Based Bayes-Adaptive Meta-Reinforcement Learning for Active Pantograph Control in High-Speed Railways
    Wang, Hui
    Han, Zhiwei
    Wang, Xufan
    Wu, Yanbo
    Liu, Zhigang
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (01): : 2045 - 2056