Context-Aware Multiagent Broad Reinforcement Learning for Mixed Pedestrian-Vehicle Adaptive Traffic Light Control

被引:19
|
作者
Zhu, Ruijie [1 ]
Wu, Shuning [1 ]
Li, Lulu [1 ]
Lv, Ping [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou 450001, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2022年 / 9卷 / 20期
基金
美国国家科学基金会; 中国博士后科学基金;
关键词
Reinforcement learning; Smart transportation; Smart cities; Internet of Things; Learning systems; Training; Roads; Broad reinforcement learning (BRL); context-aware; deep reinforcement learning (DRL); multiagent; smart transportation; traffic light control; SYSTEM; NETWORKING; INTERNET; THINGS; STATE; EDGE;
D O I
10.1109/JIOT.2022.3167029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Efficient traffic light control is a critical part of realizing smart transportation. In particular, deep reinforcement learning (DRL) algorithms that use deep neural networks (DNNs) have superior autonomous decision-making ability. Most existing work has applied DRL to control traffic lights intelligently. In this article, we propose a novel context-aware multiagent broad reinforcement learning (CAMABRL) approach based on broad reinforcement learning (BRL) for mixed pedestrian-vehicle adaptive traffic light control (ATLC). CAMABRL exploits the broad learning system (BLS) established in a flat network structure to make decisions instead of a deep network structure. Unlike previous works that consider the attributes of vehicles, CAMABRL also takes the states of pedestrians waiting at the intersection into consideration. Combining with the context-aware mechanism that utilizes the states of adjacent agents and potential state information captured by the long short-term memory (LSTM) network, agents can make farsighted decisions to alleviate traffic congestion. The experimental results show that CAMABRL is superior to several state-of-the-art multiagent reinforcement learning (MARL) methods.
引用
收藏
页码:19694 / 19705
页数:12
相关论文
共 39 条
  • [1] Context-Aware Multiagent Broad Reinforcement Learning for Mixed Pedestrian-Vehicle Adaptive Traffic Light Control
    Zhengzhou University, School of Computer and Artificial Intelligence, Zhengzhou
    450001, China
    [J]. IEEE Internet Things J., 1600, 20 (19694-19705):
  • [2] Multiagent modeling of pedestrian-vehicle conflicts using Adversarial Inverse Reinforcement Learning
    Nasernejad, Payam
    Sayed, Tarek
    Alsaleh, Rushdi
    [J]. TRANSPORTMETRICA A-TRANSPORT SCIENCE, 2023, 19 (03)
  • [3] Traffic Light Scheduling for Pedestrian-Vehicle Mixed-Flow Networks
    Zhang, Yi
    Gao, Kaizhou
    Zhang, Yicheng
    Su, Rong
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (04) : 1468 - 1483
  • [4] Adaptive Broad Deep Reinforcement Learning for Intelligent Traffic Light Control
    Zhu, Ruijie
    Wu, Shuning
    Li, Lulu
    Ding, Wenting
    Lv, Ping
    Sui, Luyao
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28496 - 28507
  • [5] Context-Aware Adaptive Route Mutation Scheme: A Reinforcement Learning Approach
    Xu, Changqiao
    Zhang, Tao
    Kuang, Xiaohui
    Zhou, Zan
    Yu, Shui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (17): : 13528 - 13541
  • [6] Dynamics Generalisation in Reinforcement Learning via Adaptive Context-Aware Policies
    Beukman, Michael
    Jarvis, Devon
    Klein, Richard
    James, Steven
    Rosman, Benjamin
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] Intelligent vehicle pedestrian light (IVPL): A deep reinforcement learning approach for traffic signal control
    Yazdani, Mobin
    Sarvi, Majid
    Bagloee, Saeed Asadi
    Nassir, Neema
    Price, Jeff
    Parineh, Hossein
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 149
  • [8] Context-Aware Intelligent Traffic Light Control through Secure Messaging
    Ozkul, Mukremin
    Capuni, Ilir
    Domnori, Elton
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2018,
  • [10] Context-aware pub/sub control method using reinforcement learning
    Kim, Joohyun
    Hong, Seohee
    Hong, Sengphil
    Kim, Jaehoon
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (15):