Impact of federated deep learning on vehicle-based speed control in mixed traffic flows

被引:0
|
作者
Greguric, Martin [1 ]
Vrbanic, Filip [1 ]
Ivanjko, Edouard [1 ]
机构
[1] Univ Zagreb, Fac Transport & Traff Sci, Vukelieeva St, HR-10000 Zagreb, Croatia
关键词
Connected and automated vehicles; Federated learning; Actor-critic learning; Intelligent speed adaptation; Mixed traffic flows; INTERSECTIONS; COOPERATION; STABILITY;
D O I
10.1016/j.jpdc.2023.104812
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This study investigates the application of Federated Learning (FL) in an environment of mixed traffic flow with Connected and Automated Vehicles (CAVs). The focus of this study is set on the CAV cruise control speed adjustment which is enforced by the Intelligent Speed Adaptation (ISA) system. It is modelled as an Actor-Critic-based learning architecture with the goal of computing the vehicle speed based on the data of the nearby vehicles. Some CAVs achieve poor travel time performance in comparison to others. Thus, the proposed FL framework selects periodically best-performing CAVs which are local clients in the context of FL. The updated global model is computed based on the weighted averaging of the best-performing models of clients. The use case environment is modelled as a simulation of a synthetic motorway with an induced capacity drop in the form of a work-zone under moderate and high traffic demand. It is shown that the FL framework can stabilise the individual client learning convergence and reduce their travel time compared to the local learning approach. The overall motorway throughput is also increased by the proposed FL framework. This indicates that the global model of FL can utilise the optimal ratio between generalisation and bias towards the most effective control policy of individual speed control. Results show that those effects are more prominent under moderate traffic demand.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Edge-Based Federated Deep Reinforcement Learning for IoT Traffic Management
    Jarwan, Abdallah
    Ibnkahla, Mohamed
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (05) : 3799 - 3813
  • [22] Traffic Control Recognition with Speed-Profiles: A Deep Learning Approach
    Cheng, Hao
    Zourlidou, Stefania
    Sester, Monika
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (11)
  • [23] The vehicle speed strategy with double traffic lights based on reinforcement learning
    Chen, Kaixuan
    Wu, Guangqiang
    Peng, Shang
    Zeng, Xiang
    Ju, Lijuan
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2023, 9 (03) : 250 - 271
  • [24] Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-based Deep Reinforcement Learning Approach
    Zhang, Zhengyang
    Zhou, Bin
    Zhang, Bugao
    Cheng, Ping
    Lee, Der-Horng
    Hu, Simon
    2024 FORUM FOR INNOVATIVE SUSTAINABLE TRANSPORTATION SYSTEMS, FISTS, 2024,
  • [25] Connected Vehicle-Based Adaptive Signal Control and Applications
    Feng, Yiheng
    Zamanipour, Mehdi
    Head, K. Larry
    Khoshmagham, Shayan
    TRANSPORTATION RESEARCH RECORD, 2016, (2558) : 11 - 19
  • [26] Modeling and robust adaptive iterative learning control of a vehicle-based flexible manipulator with uncertainties
    Xing, Xueyan
    Liu, Jinkun
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2019, 29 (08) : 2385 - 2405
  • [27] Deep Learning for Vehicle Speed Prediction
    Yan, Mei
    Li, Menglin
    He, Hongwen
    Peng, Jiankun
    CLEANER ENERGY FOR CLEANER CITIES, 2018, 152 : 618 - 623
  • [28] Altruistic cooperative adaptive cruise control of mixed traffic platoon based on deep reinforcement learning
    Lu, Sikai
    Cai, Yingfeng
    Chen, Long
    Wang, Hai
    Sun, Xiaoqiang
    Gao, Hongbo
    IET INTELLIGENT TRANSPORT SYSTEMS, 2023, 17 (10) : 1951 - 1963
  • [29] A Hybrid Control Model for Platoons at Mixed-Traffic Freeways Based on Deep Reinforcement Learning
    Li, Han
    Zhou, Xiangkai
    Liu, Sheng
    Wang, Tao
    You, Linlin
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT II, 2025, 15202 : 349 - 362
  • [30] Routing Control Optimization for Autonomous Vehicles in Mixed Traffic Flow Based on Deep Reinforcement Learning
    Moon, Sungwon
    Koo, Seolwon
    Lim, Yujin
    Joo, Hyunjin
    APPLIED SCIENCES-BASEL, 2024, 14 (05):