Operating Electric Vehicle Fleet for Ride-Hailing Services With Reinforcement Learning

被引:78
|
作者
Shi, Jie [1 ]
Gao, Yuanqi [1 ]
Wang, Wei [1 ]
Yu, Nanpeng [1 ]
Ioannou, Petros A. [2 ]
机构
[1] Univ Calif Riverside, Dept Elect & Comp Engn, Riverside, CA 92501 USA
[2] Univ Southern Calif, Dept Elect Engn, Los Angeles, CA 90007 USA
关键词
Assignment problem; electric vehicle; reinforcement learning; ride-hailing services; ROUTING PROBLEM;
D O I
10.1109/TITS.2019.2947408
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Providing ride-hailing services with electric vehicles can help reduce greenhouse gas emissions and solve the last mile problem. This paper develops a reinforcement learning based algorithm to operate a community owned electric vehicle fleet, which provides ride-hailing services to local residents. The goals of operating the electric vehicle fleet are to minimize customer waiting time, electricity cost, and operational costs of the vehicles. A novel framework characterized by decentralized learning and centralized decision making is proposed to solve the electric vehicle fleet dispatch problem. The decentralized learning process allows the individual vehicles to share their operating experiences and deep neural network model for state-value function estimation, which mitigates the curse of dimensionality of state and action domains. The centralized decision making framework converts the vehicle fleet coordination problem into a linear assignment problem, which has polynomial time complexity. Numerical study results show that the proposed approach outperforms the benchmark algorithms in terms of societal cost reduction.
引用
收藏
页码:4822 / 4834
页数:13
相关论文
共 50 条
  • [1] Ride-Hailing Service aware Electric Taxi Fleet Management using Reinforcement Learning
    Silva, Paul
    Han, Young Joo
    Kim, Young-Chon
    Kang, Dong-Ki
    [J]. 2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 427 - 432
  • [2] Equilibrium Inverse Reinforcement Learning for Ride-hailing Vehicle Network
    Oda, Takuma
    [J]. PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 2281 - 2290
  • [3] Reinforcement Learning from Optimization Proxy for Ride-Hailing Vehicle Relocation
    Yuan, Enpeng
    Chen, Wenbo
    Van Hentenryck, Pascal
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 75 : 985 - 1002
  • [4] Reinforcement Learning from Optimization Proxy for Ride-Hailing Vehicle Relocation
    Yuan E.
    Chen W.
    Van Hentenryck P.
    [J]. Journal of Artificial Intelligence Research, 2022, 75 : 985 - 1002
  • [5] A framework for integrated dispatching and charging management of an autonomous electric vehicle ride-hailing fleet
    Yi, Zonggen
    Smart, John
    [J]. TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2021, 95
  • [6] Scalable Deep Reinforcement Learning for Ride-Hailing
    Feng, Jiekun
    Gluzman, Mark
    Dai, J. G.
    [J]. 2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 3743 - 3748
  • [7] Scalable Deep Reinforcement Learning for Ride-Hailing
    Feng, Jiekun
    Gluzman, Mark
    Dai, J. G.
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (06): : 2060 - 2065
  • [8] Optimizing matching time intervals for ride-hailing services using reinforcement learning
    Qin, Guoyang
    Luo, Qi
    Yin, Yafeng
    Sun, Jian
    Ye, Jieping
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 129
  • [9] Vehicle Relocation for Ride-Hailing
    Kim, Joon-Seok
    Pfoser, Dieter
    Zulfe, Andreas
    [J]. 2020 IEEE 7TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA 2020), 2020, : 589 - 598
  • [10] Real-world ride-hailing vehicle repositioning using deep reinforcement learning
    Jiao, Yan
    Tang, Xiaocheng
    Qin, Zhiwei
    Li, Shuaiji
    Zhang, Fan
    Zhu, Hongtu
    Ye, Jieping
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 130