Q-learning for adaptive traffic signal control based on delay minimization strategy

被引:26
|
作者
Lu Shoufeng [1 ,2 ]
Liu Ximin [1 ]
Dai Shiqiang [2 ]
机构
[1] Changsha Univ Sci & Technol, Traff & Transportat Coll, Chsangsha, Hunan, Peoples R China
[2] Shanghai Univ, Shanghai Inst Appl Math & Mech, Shanghai 200041, Peoples R China
关键词
D O I
10.1109/ICNSC.2008.4525304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The goal of the paper is to test the performance of Q-learning for adaptive traffic signal control. For Q-learning algorithm, the state is total delay of the intersection, and the action is phase green time change. The relationship between phase green time change and action space is discussed. The performance between Q-learning and fixed cycle signal setting for isolated intersection is compared. The computation results show that Q-learning for traffic signal control can achieve lesser delay for variable traffic condition.
引用
收藏
页码:687 / +
页数:2
相关论文
共 50 条
  • [1] Incremental Multistep Q-learning for Adaptive Traffic Signal Control Based on Delay Minimization Strategy
    Lu, Shoufeng
    Liu, Ximin
    Dai, Shiqiang
    [J]. 2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 2854 - +
  • [2] Adaptive Traffic Signal Control with Deep Recurrent Q-learning
    Zeng, Jinghong
    Hu, Jianming
    Zhang, Yi
    [J]. 2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1215 - 1220
  • [3] Adaptive and Coordinated Traffic Signal Control Based on Q-Learning and MULTIBAND Model
    Lu, Shoufeng
    Liu, Ximin
    Dai, Shiqiang
    [J]. 2008 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2008, : 446 - +
  • [4] Evaluating Action Durations for Adaptive Traffic Signal Control Based On Deep Q-Learning
    Celtek, Seyit Alperen
    Durdu, Akif
    Ali, Muzamil Eltejani Mohammed
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2021, 19 (03) : 557 - 571
  • [5] Evaluating Action Durations for Adaptive Traffic Signal Control Based On Deep Q-Learning
    Seyit Alperen CELTEK
    Akif DURDU
    Muzamil Eltejani Mohammed ALI
    [J]. International Journal of Intelligent Transportation Systems Research, 2021, 19 : 557 - 571
  • [6] Hybrid control based on Q-learning for urban traffic signal
    School of Electronic Information and Control Engineering, Beijing University of Technology, Beijing 100022, China
    [J]. Xitong Fangzhen Xuebao, 2006, 10 (2889-2894):
  • [7] Discharge control policy based on density and speed for deep Q-learning adaptive traffic signal
    Ahmed, Muaid Abdulkareem Alnazir
    Khoo, Hooi Ling
    Ng, Oon-Ee
    [J]. TRANSPORTMETRICA B-TRANSPORT DYNAMICS, 2023, 11 (01) : 1707 - 1726
  • [8] Asynchronous n-step Q-learning adaptive traffic signal control
    Genders, Wade
    Razavi, Saiedeh
    [J]. JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 23 (04) : 319 - 331
  • [9] Traffic Signal Control: a Double Q-learning Approach
    Agafonov, Anton
    Myasnikov, Vladislav
    [J]. PROCEEDINGS OF THE 2021 16TH CONFERENCE ON COMPUTER SCIENCE AND INTELLIGENCE SYSTEMS (FEDCSIS), 2021, : 365 - 369
  • [10] A Robust Adaptive Traffic Signal Control Algorithm Using Q-Learning under Mixed Traffic Flow
    Wei, Zibin
    Peng, Tao
    Wei, Sijia
    [J]. SUSTAINABILITY, 2022, 14 (10)