Reinforcement Learning-based approach for dynamic vehicle routing problem with stochastic demand

被引:1
|
作者
Zhou, Chenhao [1 ]
Ma, Jingxin [1 ]
Douge, Louis [2 ]
Chew, Ek Peng [2 ]
Lee, Loo Hay [2 ]
机构
[1] Northwestern Polytech Univ, Sch Management, Xian, Peoples R China
[2] Natl Univ Singapore, Dept Ind Syst Engn & Management, Singapore, Singapore
关键词
Dynamic vehicle routing problem; Stochastic demand; Single courier; Supervised learning; Reinforcement learning; GO;
D O I
10.1016/j.cie.2023.109443
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper studies a dynamic vehicle routing problem under stochastic demands, drawn from a real-world situation. Specifically, a single courier must accomplish two kinds of tasks: deliveries known at the beginning of the operation and pickups that appear throughout the daily operation with specific patterns. The objective is to maximise the rewards obtained from serving both types of customers during a limited period. Our contribution lies in using the neural network and historical couriers' decisions to learn a base policy that captures human experience for better decision making. The reinforcement learning framework is then used to make the base policy explore new scenarios through simulations and further train the base policy with newly generated data. We show that our approach allows the serving of an average of 12% and 8% more customers under some conditions than the nearest-neighbour policy in high density area and low density area, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Reinforcement Learning Approach to Stochastic Vehicle Routing Problem With Correlated Demands
    Iklassov, Zangir
    Sobirov, Ikboljon
    Solozabal, Ruben
    Takac, Martin
    [J]. IEEE ACCESS, 2023, 11 : 87958 - 87969
  • [2] Reinforcement Learning for Solving Stochastic Vehicle Routing Problem
    Iklassov, Zangir
    Sobirov, Ikboljon
    Solozabal, Ruben
    Takac, Martin
    [J]. ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [3] Opportunities for reinforcement learning in stochastic dynamic vehicle routing
    Hildebrandt, Florentin D.
    Thomas, Barrett W.
    Ulmer, Marlin W.
    [J]. COMPUTERS & OPERATIONS RESEARCH, 2023, 150
  • [4] A Hybrid Reinforcement Learning-Based Model for the Vehicle Routing Problem in Transportation Logistics
    Phiboonbanakit, Thananut
    Horanont, Teerayut
    Huynh, Van-Nam
    Supnithi, Thepchai
    [J]. IEEE ACCESS, 2021, 9 : 163325 - 163347
  • [5] Dynamic stochastic electric vehicle routing with safe reinforcement learning
    Basso, Rafael
    Kulcsar, Balazs
    Sanchez-Diaz, Ivan
    Qu, Xiaobo
    [J]. TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2022, 157
  • [6] Vehicle routing problem with stochastic demand
    Song, Shi-jun
    Jiao, Jian-ling
    [J]. Proceedings of the Second International Conference on Game Theory and Applications, 2007, : 174 - 179
  • [7] A novel reinforcement learning-based hyper-heuristic for heterogeneous vehicle routing problem
    Qin, Wei
    Zhuang, Zilong
    Huang, Zizhao
    Huang, Haozhe
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 156
  • [8] Deep reinforcement learning for the dynamic and uncertain vehicle routing problem
    Pan, Weixu
    Liu, Shi Qiang
    [J]. APPLIED INTELLIGENCE, 2023, 53 (01) : 405 - 422
  • [9] Deep reinforcement learning for the dynamic and uncertain vehicle routing problem
    Weixu Pan
    Shi Qiang Liu
    [J]. Applied Intelligence, 2023, 53 : 405 - 422
  • [10] A deep reinforcement learning-based approach for the home delivery and installation routing problem
    Qiu, Huaxin
    Wang, Sutong
    Yin, Yunqiang
    Wang, Dujuan
    Wang, Yanzhang
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2022, 244