Reinforcement Learning method with Dynamic Learning Rate for Real-Time Route Guidance based on SUMO

被引:1
|
作者
Li, Yuzhen [1 ]
Tang, Jiawen [2 ]
Zhao, Han [1 ]
Luo, Ruikang [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
[2] Changsha Univ Sci Technol, Sch Phys Elect Sci, Changsha, Peoples R China
关键词
D O I
10.1109/ICARCV57592.2022.10004227
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing number of vehicles and dynamic changes in traffic situations make real-time route planning strongly necessary. The route-guiding method is supposed to cope with dynamic traffic situations. In addition, the ability to adapt to the second fastest route is very important when traffic congestion suddenly occurs on the fastest path. This paper proposes a method of using reinforcement learning to solve dynamic route planning problems, and the adaptation from a static learning rate to a dynamic learning rate enhances the capability to deal with emergent congestion. Meanwhile, the waiting time before each traffic light also is considered as a reward factor in the proposed algorithm. Contrast experiments have been conducted on the simulation network by SUMO, which has demonstrated well that our proposed method has better performance than other methods.
引用
下载
收藏
页码:820 / 824
页数:5
相关论文
共 50 条
  • [31] Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Time
    Geng, Yuanzhe
    Liu, Erwu
    Wang, Rui
    Liu, Yiming
    Rao, Weixiong
    Feng, Shaojun
    Dong, Zhao
    Fu, Zhiren
    Chen, Yanfen
    2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [32] Control Delay in Reinforcement Learning for Real-Time Dynamic Systems: A Memoryless Approach
    Schuitema, Erik
    Busoniu, Lucian
    Babuska, Robert
    Jonker, Pieter
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 3226 - 3231
  • [33] Real-Time Dynamic Gesture Recognition Method Based on Gaze Guidance
    Zhang, Binbin
    Li, Weiqing
    Su, Zhiyong
    IEEE Access, 2024, 12 : 161084 - 161095
  • [34] Dynamic route planning method based on deep reinforcement learning and velocity obstacle
    Lou Mengmeng
    Yang Xiaofei
    Xiang Zhengrong
    Wang Qi
    Hu Jiabao
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 627 - 632
  • [35] Integration of Adaptive Control and Reinforcement Learning for Real-Time Control and Learning
    Annaswamy, Anuradha M.
    Guha, Anubhav
    Cui, Yingnan
    Tang, Sunbochen
    Fisher, Peter A.
    Gaudio, Joseph E.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (12) : 7740 - 7755
  • [36] Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning
    Unagar, Ajaykumar
    Tian, Yuan
    Chao, Manuel Arias
    Fink, Olga
    ENERGIES, 2021, 14 (05)
  • [37] REAL-TIME BATCHING IN JOB SHOPS BASED ON SIMULATION AND REINFORCEMENT LEARNING
    Zhang, Tao
    Xie, Shufang
    Rose, Oliver
    2018 WINTER SIMULATION CONFERENCE (WSC), 2018, : 3331 - 3339
  • [38] Hybrid DVFS Scheduling for Real-Time Systems Based on Reinforcement Learning
    Muhammad, Fakhruddin
    ul Islam, Mahbub
    Lin, Man
    IEEE SYSTEMS JOURNAL, 2017, 11 (02): : 931 - 940
  • [39] Real-Time Dynamic SLAM Algorithm Based on Deep Learning
    Su, Peng
    Luo, Suyun
    Huang, Xiaoci
    IEEE ACCESS, 2022, 10 : 87754 - 87766
  • [40] Real-time model calibration with deep reinforcement learning
    Tian, Yuan
    Chao, Manuel Arias
    Kulkarni, Chetan
    Goebel, Kai
    Fink, Olga
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 165