Impact of federated deep learning on vehicle-based speed control in mixed traffic flows

被引:0
|
作者
Greguric, Martin [1 ]
Vrbanic, Filip [1 ]
Ivanjko, Edouard [1 ]
机构
[1] Univ Zagreb, Fac Transport & Traff Sci, Vukelieeva St, HR-10000 Zagreb, Croatia
关键词
Connected and automated vehicles; Federated learning; Actor-critic learning; Intelligent speed adaptation; Mixed traffic flows; INTERSECTIONS; COOPERATION; STABILITY;
D O I
10.1016/j.jpdc.2023.104812
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This study investigates the application of Federated Learning (FL) in an environment of mixed traffic flow with Connected and Automated Vehicles (CAVs). The focus of this study is set on the CAV cruise control speed adjustment which is enforced by the Intelligent Speed Adaptation (ISA) system. It is modelled as an Actor-Critic-based learning architecture with the goal of computing the vehicle speed based on the data of the nearby vehicles. Some CAVs achieve poor travel time performance in comparison to others. Thus, the proposed FL framework selects periodically best-performing CAVs which are local clients in the context of FL. The updated global model is computed based on the weighted averaging of the best-performing models of clients. The use case environment is modelled as a simulation of a synthetic motorway with an induced capacity drop in the form of a work-zone under moderate and high traffic demand. It is shown that the FL framework can stabilise the individual client learning convergence and reduce their travel time compared to the local learning approach. The overall motorway throughput is also increased by the proposed FL framework. This indicates that the global model of FL can utilise the optimal ratio between generalisation and bias towards the most effective control policy of individual speed control. Results show that those effects are more prominent under moderate traffic demand.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Reinforcement Learning Based Variable Speed Limit Control for Mixed Traffic Flows
    Vrbanic, Filip
    Ivanjko, Edouard
    Mandzuka, Sadko
    Miletic, Mladen
    2021 29TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2021, : 560 - 565
  • [2] Reinforcement Learning Based Variable Speed Limit Control for Mixed Traffic Flows Using Speed Transition Matrices for State Estimation
    Vrbanic, Filip
    Tisljaric, Leo
    Majstorovic, Zeljko
    Ivanjko, Edouard
    2022 30TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2022, : 1093 - 1098
  • [3] Variable Speed Limit Control for Mixed Traffic Flow on Highways Based on Deep-Reinforcement Learning
    Gao, Heyao
    Jia, Hongfei
    Wu, Ruiyi
    Huang, Qiuyang
    Tian, Jingjing
    Liu, Chao
    Wang, Xiaochao
    JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2024, 150 (03)
  • [4] Connected Vehicle-Based Traffic Signal Coordination
    Li, Wan
    Ban, Xuegang
    ENGINEERING, 2020, 6 (12) : 1463 - 1472
  • [5] Vehicle-Based Evolutionary Travel Time Estimation with Deep Meta Learning
    Wang, Chenxing
    Zhao, Fang
    Luo, Haiyong
    Fang, Yuchen
    Zhang, Haichao
    Xiong, Haoyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT IX, 2024, 15024 : 246 - 262
  • [6] Federated deep reinforcement learning-based urban traffic signal optimal control
    Li, Mi
    Pan, Xiaolong
    Liu, Chuhui
    Li, Zirui
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [7] Deep Learning Techniques for Vehicle Trajectory Extraction in Mixed Traffic
    Rohan Dhatbale
    Bhargava Rama Chilukuri
    Journal of Big Data Analytics in Transportation, 2021, 3 (2): : 141 - 157
  • [8] Connected automated vehicle cooperative control with a deep reinforcement learning approach in a mixed traffic environment
    Shi, Haotian
    Zhou, Yang
    Wu, Keshu
    Wang, Xin
    Lin, Yangxin
    Ran, Bin
    Transportation Research Part C: Emerging Technologies, 2021, 133
  • [9] Connected automated vehicle cooperative control with a deep reinforcement learning approach in a mixed traffic environment
    Shi, Haotian
    Zhou, Yang
    Wu, Keshu
    Wang, Xin
    Lin, Yangxin
    Ran, Bin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 133
  • [10] Traffic Impact Analysis of a Deep Reinforcement Learning-based Multi-lane Freeway Vehicle Control
    Kataoka, Yuta
    Yang, Hao
    Keshavamurthy, Shalini
    Nishitani, Ippei
    Oguchi, Kentaro
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,