Reinforcement Learning-Based Dynamic Order Recommendation for On-Demand Food Delivery

被引:3
|
作者
Wang, Xing [1 ]
Wang, Ling [1 ]
Dong, Chenxin [2 ]
Ren, Hao [3 ]
Xing, Ke [3 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100080, Peoples R China
[2] Qingdao Hengxing Univ Sci & Technol, Sch Mech & Automot Engn, Qingdao 266100, Peoples R China
[3] Meituan, Beijing 100015, Peoples R China
基金
中国国家自然科学基金;
关键词
on-demand food delivery; order recommendation; reinforcement learning; actor-critic network; long short term memory;
D O I
10.26599/TST.2023.9010041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
On-demand food delivery (OFD) is gaining more and more popularity in modern society. As a kernel order assignment manner in OFD scenario, order recommendation directly influences the delivery efficiency of the platform and the delivery experience of riders. This paper addresses the dynamism of the order recommendation problem and proposes a reinforcement learning solution method. An actor-critic network based on long short term memory (LSTM) unit is designed to deal with the order-grabbing conflict between different riders. Besides, three rider sequencing rules are accordingly proposed to match different time steps of the LSTM unit with different riders. To test the performance of the proposed method, extensive experiments are conducted based on real data from Meituan delivery platform. The results demonstrate that the proposed reinforcement learning based order recommendation method can significantly increase the number of grabbed orders and reduce the number of order-grabbing conflicts, resulting in better delivery efficiency and experience for the platform and riders.
引用
收藏
页码:356 / 367
页数:12
相关论文
共 50 条
  • [1] A Matching Algorithm with Reinforcement Learning and Decoupling Strategy for Order Dispatching in On-Demand Food Delivery
    Chen, Jingfang
    Wang, Ling
    Pan, Zixiao
    Wu, Yuting
    Zheng, Jie
    Ding, Xuetao
    [J]. TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (02) : 386 - 399
  • [2] An Online Deep Reinforcement Learning-Based Order Recommendation Framework for Rider-Centered Food Delivery System
    Wang, Xing
    Wang, Ling
    Dong, Chenxin
    Ren, Hao
    Xing, Ke
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) : 5640 - 5654
  • [3] A reinforcement learning-based metaheuristic algorithm for on-demand ride-pooling
    Bochenina, Klavdiya
    Ruotsalainen, Laura
    [J]. 2024 INTERNATIONAL CONFERENCE ON INTELLIGENT ENVIRONMENTS, IE 2024, 2024, : 117 - 123
  • [4] Demand-responsive rebalancing zone generation for reinforcement learning-based on-demand mobility
    Castagna, Alberto
    Gueriau, Maxime
    Vizzari, Giuseppe
    Dusparic, Ivana
    [J]. AI COMMUNICATIONS, 2021, 34 (01) : 73 - 88
  • [5] Reinforcement Learning-Based News Recommendation System
    Aboutorab, Hamed
    Hussain, Omar K.
    Saberi, Morteza
    Hussain, Farookh Khadeer
    Prior, Daniel
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (06) : 4493 - 4502
  • [6] A deep reinforcement learning-based on-demand charging algorithm for wireless rechargeable sensor networks
    Cao, Xianbo
    Xu, Wenzheng
    Liu, Xuxun
    Peng, Jian
    Liu, Tang
    [J]. AD HOC NETWORKS, 2021, 110
  • [7] Order Fulfillment Cycle Time Estimation for On-Demand Food Delivery
    Zhu, Lin
    Yu, Wei
    Zhou, Kairong
    Wang, Xing
    Feng, Wenxing
    Wang, Pengyu
    Chen, Ning
    Lee, Pei
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 2571 - 2580
  • [8] Crowdsourced on-demand food delivery: An order batching and assignment algorithm
    Simoni, Michele D.
    Winkenbach, Matthias
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 149
  • [9] Time-Constrained Actor-Critic Reinforcement Learning for Concurrent Order Dispatch in On-Demand Delivery
    Wang, Shuai
    Guo, Baoshen
    Ding, Yi
    Wang, Guang
    He, Suining
    Zhang, Desheng
    He, Tian
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (08) : 8175 - 8192
  • [10] Order Dispatching via GNN-Based Optimization Algorithm for On-Demand Food Delivery
    Chen, Jing-Fang
    Wang, Ling
    Liang, Yile
    Yu, Yang
    Feng, Jie
    Zhao, Jiuxia
    Ding, Xuetao
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13147 - 13162