Reinforcement Learning-Based Adaptive Optimal Control Model for Signal Light in Intelligent Transportation Systems

被引:0
|
作者
Hu, Xiaomin [1 ]
He, Yuanyuan [1 ]
机构
[1] Xian Traff Engn Inst, Xian 710300, Shaanxi, Peoples R China
关键词
Reinforcement learning; ideal management fuzzy logic; deep learning; intelligent traffic signal system (ITS); dynamic traffic light control;
D O I
10.1142/S021812662550046X
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Day-to-day mobility among the population has increased with economic growth. Smart cities are renovated with advanced technologies to admire modern life in which intelligent transportation becomes highly focused. Because the traffic signal control systems are fixed at a constant time. They split the traffic signal into predetermined intervals and function inefficiently; they result in long wait times, waste fuel and increased carbon emissions. This research study introduces a novel technique for traffic light management to reduce the uncertainties in the system. A dynamic and intelligent traffic light adaptive optimal management system (DITLAOCS) is implemented in this research. It does this by modifying the traffic signal duration in run time and using real-time traffic data as input. Furthermore, the proposed DITLAOCS executes based on three modes: fairness mode (FM), priority mode (PM) and emergent mode (EM). In fairness mode (FM), all vehicles are prioritized equally, while vehicles in different categories receive varying priority levels. Emergency vehicles, on the other hand, receive the highest priority. Furthermore, a fuzzy inference method based on traffic data is shown to choose one mode out of three (FM, PM and EM). This model uses deep reinforcement learning to switch traffic lights in three different phases (red, green and yellow). We evaluated and accurately simulated DITLAOCS on the Shaanxi city map in China using Simulation of Urban MObility (SUMO), an open-source simulator. The simulation results illustrate the efficiency of DITLAOCS when compared to other cutting-edge algorithms on several performance measures.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] A reinforcement learning-based scheme for adaptive optimal control of linear stochastic systems
    Wong, Wee Chin
    Lee, Jay H.
    2008 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2008, : 57 - 62
  • [2] Reinforcement Learning-Based Adaptive Optimal Control for Nonlinear Systems With Asymmetric Hysteresis
    Zheng, Licheng
    Liu, Zhi
    Wang, Yaonan
    Chen, C. L. Philip
    Zhang, Yun
    Wu, Zongze
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 15800 - 15809
  • [3] Fuzzy Inference Enabled Deep Reinforcement Learning-Based Traffic Light Control for Intelligent Transportation System
    Kumar, Neetesh
    Rahman, Syed Shameerur
    Dhakad, Navin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) : 4919 - 4928
  • [4] A reinforcement learning-based scheme for direct adaptive optimal control of linear stochastic systems
    Wong, Wee Chin
    Lee, Jay H.
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2010, 31 (04): : 365 - 374
  • [5] Reinforcement Learning-Based Adaptive Optimal Control for Partially Unknown Systems Using Differentiator
    Guo, Xinxin
    Yan, Weisheng
    Cui, Rongxin
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 1039 - 1044
  • [6] Traffic Signal Control System Based on Intelligent Transportation System and Reinforcement Learning
    Hurtado-Gomez, Julian
    David Romo, Juan
    Salazar-Cabrera, Ricardo
    Pachon de la Cruz, Alvaro
    Molina, Juan Manuel Madrid
    ELECTRONICS, 2021, 10 (19)
  • [7] Reinforcement learning based adaptive control method for traffic lights in intelligent transportation
    Huang, Zhongyi
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 106 : 381 - 391
  • [8] Reinforcement learning-based optimal control of uncertain nonlinear systems
    Garcia, Miguel
    Dong, Wenjie
    INTERNATIONAL JOURNAL OF CONTROL, 2024, 97 (12) : 2839 - 2850
  • [9] Reinforcement learning-based adaptive optimal output feedback control for nonlinear systems with output quantization
    Jin, Yitong
    Wang, Fang
    Lai, Guanyu
    Zhang, Xueyi
    NONLINEAR DYNAMICS, 2024, : 7029 - 7045
  • [10] Reinforcement Learning-Based Adaptive Optimal Exponential Tracking Control of Linear Systems With Unknown Dynamics
    Chen, Ci
    Modares, Hamidreza
    Xie, Kan
    Lewis, Frank L.
    Wan, Yan
    Xie, Shengli
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (11) : 4423 - 4438