A Reinforcement Learning-Based Distributed Control Scheme for Cooperative Intersection Traffic Control

被引:4
|
作者
Guzman, Jose A. [1 ]
Pizarro, German [1 ]
Nunez, Felipe [1 ]
机构
[1] Pontificia Univ Catolica Chile, Dept Elect Engn, Santiago 7820436, Chile
关键词
Predictive models; Detectors; Real-time systems; Data models; Urban areas; Graph neural networks; Decentralized control; Reinforcement learning; cyber-physical systems; intersection control; distributed control;
D O I
10.1109/ACCESS.2023.3283218
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traffic congestion is a major source of discomfort and economic losses in urban environments. Recently, the proliferation of traffic detectors and the advances in algorithms to efficiently process data have enabled taking a data-driven approach to mitigate congestion. In this context, this work proposes a reinforcement learning (RL) based distributed control scheme that exploits cooperation among intersections. Specifically, a RL controller is synthesized, which manipulates traffic signals using information from neighboring intersections in the form of an embedding obtained from a traffic prediction application. Simulation results using SUMO show that the proposed scheme outperforms classical techniques in terms of waiting time and other key performance indices.
引用
收藏
页码:57037 / 57045
页数:9
相关论文
共 50 条
  • [1] A deep reinforcement learning-based cooperative approach formulti-intersection traffic signal control
    Haddad, Tarek Amine
    Hedjazi, Djalal
    Aouag, Sofiane
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
  • [2] Distributed Highway Control: A Cooperative Reinforcement Learning-Based Approach
    Kovari, Balint
    Knab, Istvan Gellert
    Esztergar-Kiss, Domokos
    Aradi, Szilard
    Becsi, Tamas
    [J]. IEEE ACCESS, 2024, 12 : 104463 - 104472
  • [3] Cooperative Multi-Intersection Traffic Signal Control Based on Deep Reinforcement Learning
    Huang, Rui
    Hu, Jianming
    Huo, Yusen
    Pei, Xin
    [J]. CICTP 2019: TRANSPORTATION IN CHINA-CONNECTING THE WORLD, 2019, : 2959 - 2970
  • [4] Cooperative Control for Multi-Intersection Traffic Signal Based on Deep Reinforcement Learning and Imitation Learning
    Huo, Yusen
    Tao, Qinghua
    Hu, Jianming
    [J]. IEEE ACCESS, 2020, 8 : 199573 - 199585
  • [5] Deep Reinforcement Learning-based Traffic Signal Control
    Ruan, Junyun
    Tang, Jinzhuo
    Gao, Ge
    Shi, Tianyu
    Khamis, Alaa
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON SMART MOBILITY, SM, 2023, : 21 - 26
  • [6] Distributed Cooperative Reinforcement Learning-Based Traffic Signal Control That Integrates V2X Networks' Dynamic Clustering
    Liu, Weirong
    Qin, Gaorong
    He, Yun
    Jiang, Fei
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (10) : 8667 - 8681
  • [7] Reinforcement Learning-Based Traffic Control: Mitigating the Adverse Impacts of Control Transitions
    Alms, Robert
    Noulis, Aristeidis
    Mintsis, Evangelos
    Luecken, Leonhard
    Wagner, Peter
    [J]. IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 3 : 187 - 198
  • [8] Reinforcement Learning-based Multiple Camera Collaboration Control Scheme
    Kim, Dongchil
    Yang, Chang Mo
    [J]. 2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 414 - 416
  • [9] A Novel Reinforcement Learning-Based Cooperative Traffic Signal System Through Max-Pressure Control
    Boukerche, Azzedine
    Zhong, Dunhao
    Sun, Peng
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 1187 - 1198
  • [10] Research on Cooperative Control of Traffic Signals based on Deep Reinforcement Learning
    Fan, Lingling
    Yang, Yusong
    Ji, Honghai
    Xiong, Shuangshuang
    [J]. 2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1608 - 1612