PyTSC: A Unified Platform for Multi-Agent Reinforcement Learning in Traffic Signal Control

被引:0
|
作者
Bokade, Rohit [1 ]
Jin, Xiaoning [1 ]
机构
[1] Northeastern Univ, Dept Mech & Ind Engn, Boston, MA 02115 USA
关键词
Multi-Agent Reinforcement Learning (MARL); Traffic Signal Control (TSC); intelligent transportation systems (ITSs); urban traffic management;
D O I
10.3390/s25051302
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Multi-Agent Reinforcement Learning (MARL) presents a promising approach for addressing the complexity of Traffic Signal Control (TSC) in urban environments. However, existing platforms for MARL-based TSC research face challenges such as slow simulation speeds and convoluted, difficult-to-maintain codebases. To address these limitations, we introduce PyTSC, a robust and flexible simulation environment that facilitates the training and evaluation of MARL algorithms for TSC. PyTSC integrates multiple simulators, such as SUMO and CityFlow, and offers a streamlined API, enabling researchers to explore a broad spectrum of MARL approaches efficiently. PyTSC accelerates experimentation and provides new opportunities for advancing intelligent traffic management systems in real-world applications.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Multi-Agent Meta-Reinforcement Learning with Coordination and Reward Shaping for Traffic Signal Control
    Du, Xin
    Wang, Jiahai
    Chen, Siyuan
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT II, 2023, 13936 : 349 - 360
  • [32] Traffic signal control using a cooperative EWMA-based multi-agent reinforcement learning
    Qiao, Zhimin
    Ke, Liangjun
    Wang, Xiaoqiang
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4483 - 4498
  • [33] Multi-agent broad reinforcement learning for intelligent traffic light control
    Zhu, Ruijie
    Li, Lulu
    Wu, Shuning
    Lv, Pei
    Li, Yafei
    Xu, Mingliang
    INFORMATION SCIENCES, 2023, 619 : 509 - 525
  • [34] Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control
    Yisha Li
    Ya Zhang
    Xinde Li
    Changyin Sun
    IEEE/CAAJournalofAutomaticaSinica, 2024, 11 (09) : 1987 - 1998
  • [35] Multi-agent Deep Reinforcement Learning collaborative Traffic Signal Control method considering intersection heterogeneity
    Bie, Yiming
    Ji, Yuting
    Ma, Dongfang
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 164
  • [36] Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control
    Bokade, Rohit
    Jin, Xiaoning
    Amato, Christopher
    IEEE ACCESS, 2023, 11 : 47646 - 47658
  • [37] Fairness-aware multi-agent reinforcement learning and visual perception for adaptive traffic signal control
    FANG Wanqing
    ZHAO Xintian
    ZHANG Chengwei
    Optoelectronics Letters, 2024, 20 (12) : 764 - 768
  • [38] Multi-agent Deep Reinforcement Learning with Spatio-Temporal Feature Fusion for Traffic Signal Control
    Du, Xin
    Wang, Jiahai
    Chen, Siyuan
    Liu, Zhiyue
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: APPLIED DATA SCIENCE TRACK, PT IV, 2021, 12978 : 470 - 485
  • [39] Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning
    Li, Zhenning
    Yu, Hao
    Zhang, Guohui
    Dong, Shangjia
    Xu, Cheng-Zhong
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 125
  • [40] Regional Multi-Agent Cooperative Reinforcement Learning for City-Level Traffic Grid Signal Control
    Li, Yisha
    Zhang, Ya
    Li, Xinde
    Sun, Changyin
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (09) : 1987 - 1998