Reinforcement Learning method with Dynamic Learning Rate for Real-Time Route Guidance based on SUMO

被引:1
|
作者
Li, Yuzhen [1 ]
Tang, Jiawen [2 ]
Zhao, Han [1 ]
Luo, Ruikang [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
[2] Changsha Univ Sci Technol, Sch Phys Elect Sci, Changsha, Peoples R China
关键词
D O I
10.1109/ICARCV57592.2022.10004227
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing number of vehicles and dynamic changes in traffic situations make real-time route planning strongly necessary. The route-guiding method is supposed to cope with dynamic traffic situations. In addition, the ability to adapt to the second fastest route is very important when traffic congestion suddenly occurs on the fastest path. This paper proposes a method of using reinforcement learning to solve dynamic route planning problems, and the adaptation from a static learning rate to a dynamic learning rate enhances the capability to deal with emergent congestion. Meanwhile, the waiting time before each traffic light also is considered as a reward factor in the proposed algorithm. Contrast experiments have been conducted on the simulation network by SUMO, which has demonstrated well that our proposed method has better performance than other methods.
引用
收藏
页码:820 / 824
页数:5
相关论文
共 50 条
  • [41] Experience Replay for Real-Time Reinforcement Learning Control
    Adam, Sander
    Busoniu, Lucian
    Babuska, Robert
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (02): : 201 - 212
  • [42] Real-Time Bidding by Reinforcement Learning in Display Advertising
    Cai, Han
    Ren, Kan
    Zhang, Weinan
    Malialis, Kleanthis
    Wang, Jun
    Yu, Yong
    Guo, Defeng
    WSDM'17: PROCEEDINGS OF THE TENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2017, : 661 - 670
  • [43] Real-Time Lane Configuration with Coordinated Reinforcement Learning
    Gunarathna, Udesh
    Xie, Hairuo
    Tanin, Egemen
    Karunasekara, Shanika
    Borovica-Gajic, Renata
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE TRACK, ECML PKDD 2020, PT IV, 2021, 12460 : 291 - 307
  • [44] Multiobjective route guidance systems based on real-time information
    Zhou, Zheng
    Zhang, Xuedan
    Dong, Yuhan
    ENERGY SCIENCE AND APPLIED TECHNOLOGY (ESAT 2016), 2016, : 565 - 568
  • [45] Deep reinforcement learning algorithm for dynamic flow shop real-time scheduling problem
    Yang Y.-Y.
    Hu R.
    Qian B.
    Zhang C.-S.
    Jin H.-P.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (06): : 1047 - 1055
  • [46] Real-Time Scheduling of Operational Time for Smart Home Appliances Based on Reinforcement Learning
    Khan, Murad
    Seo, Junho
    Kim, Dongkyun
    IEEE ACCESS, 2020, 8 : 116520 - 116534
  • [47] Dynamic pricing with real-time demand learning
    Lin, Kyle Y.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2006, 174 (01) : 522 - 538
  • [48] Reinforcement learning and digital twin-based real-time scheduling method in intelligent manufacturing systems
    Zhang, Lixiang
    Yan, Yan
    Hu, Yaoguang
    Ren, Weibo
    IFAC PAPERSONLINE, 2022, 55 (10): : 359 - 364
  • [49] Effective strategies for complex skill real-time learning using reinforcement learning
    Wei, YZ
    Zhao, MY
    2003 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS, INTELLIGENT SYSTEMS AND SIGNAL PROCESSING, VOLS 1 AND 2, PROCEEDINGS, 2003, : 388 - 392
  • [50] Real-Time Video Emotion Recognition Based on Reinforcement Learning and Domain Knowledge
    Zhang, Ke
    Li, Yuanqing
    Wang, Jingyu
    Cambria, Erik
    Li, Xuelong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1034 - 1047