Reinforcement Learning-Based Dynamic Order Recommendation for On-Demand Food Delivery

被引:3
|
作者
Wang, Xing [1 ]
Wang, Ling [1 ]
Dong, Chenxin [2 ]
Ren, Hao [3 ]
Xing, Ke [3 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100080, Peoples R China
[2] Qingdao Hengxing Univ Sci & Technol, Sch Mech & Automot Engn, Qingdao 266100, Peoples R China
[3] Meituan, Beijing 100015, Peoples R China
基金
中国国家自然科学基金;
关键词
on-demand food delivery; order recommendation; reinforcement learning; actor-critic network; long short term memory;
D O I
10.26599/TST.2023.9010041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
On-demand food delivery (OFD) is gaining more and more popularity in modern society. As a kernel order assignment manner in OFD scenario, order recommendation directly influences the delivery efficiency of the platform and the delivery experience of riders. This paper addresses the dynamism of the order recommendation problem and proposes a reinforcement learning solution method. An actor-critic network based on long short term memory (LSTM) unit is designed to deal with the order-grabbing conflict between different riders. Besides, three rider sequencing rules are accordingly proposed to match different time steps of the LSTM unit with different riders. To test the performance of the proposed method, extensive experiments are conducted based on real data from Meituan delivery platform. The results demonstrate that the proposed reinforcement learning based order recommendation method can significantly increase the number of grabbed orders and reduce the number of order-grabbing conflicts, resulting in better delivery efficiency and experience for the platform and riders.
引用
收藏
页码:356 / 367
页数:12
相关论文
共 50 条
  • [31] On-demand food delivery: investigating the economic performances
    Seghezzi, Arianna
    Mangiaracina, Riccardo
    [J]. INTERNATIONAL JOURNAL OF RETAIL & DISTRIBUTION MANAGEMENT, 2021, 49 (04) : 531 - 549
  • [32] An Imitation Learning-Enhanced Iterated Matching Algorithm for On-Demand Food Delivery
    Chen, Jing-Fang
    Wang, Ling
    Ren, Hao
    Pan, Jize
    Wang, Shengyao
    Zheng, Jie
    Wang, Xing
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 18603 - 18619
  • [33] A novel on-demand charging strategy based on swarm reinforcement learning in WRSNs
    Wei, Zhen
    Li, Meng
    Wei, Zhenchun
    Cheng, Lei
    Lyu, Zengwei
    Liu, Fei
    [J]. IEEE Access, 2020, 8 : 84258 - 84271
  • [34] Towards a Reinforcement Learning-based Exploratory Search for Mashup Tag Recommendation
    Anarfi, Ricahrd
    Kwapong, Benjamin
    Fletcher, Kenneth K.
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SMART DATA SERVICES (SMDS 2021), 2021, : 8 - 17
  • [35] Dynamic service contracting for on-demand asset delivery
    Zhao, Xiaohui
    Angelov, Samuil
    Grefen, Paul
    [J]. ELECTRONIC COMMERCE RESEARCH, 2014, 14 (04) : 661 - 682
  • [36] Dynamic service contracting for on-demand asset delivery
    Xiaohui Zhao
    Samuil Angelov
    Paul Grefen
    [J]. Electronic Commerce Research, 2014, 14 : 661 - 682
  • [37] Reinforcement learning-based optimised control for a class of second-order nonlinear dynamic systems
    Li, Bin
    Yang, Xue
    Zhou, Ranran
    Wen, Guoxing
    [J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2022, 53 (15) : 3154 - 3164
  • [38] Learning to Bundle Proactively for On-Demand Meal Delivery
    Li, Chengbo
    Zhu, Lin
    Fu, Guangyuan
    Du, Longzhi
    Zhao, Canhua
    Ma, Tianlun
    Ye, Chang
    Lee, Pei
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3898 - 3905
  • [39] Cross-Region Courier Displacement for On-Demand Delivery With Multi-Agent Reinforcement Learning
    Wang, Shuai
    Hu, Shijie
    Guo, Baoshen
    Wang, Guang
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (05) : 1321 - 1333
  • [40] InTune: Reinforcement Learning-based Data Pipeline Optimization for Deep Recommendation Models
    Nagrecha, Kabir
    Liu, Lingyi
    Delgado, Pablo
    Padmanabhan, Prasanna
    [J]. PROCEEDINGS OF THE 17TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2023, 2023, : 430 - 442