Operating Electric Vehicle Fleet for Ride-Hailing Services With Reinforcement Learning

被引:78
|
作者
Shi, Jie [1 ]
Gao, Yuanqi [1 ]
Wang, Wei [1 ]
Yu, Nanpeng [1 ]
Ioannou, Petros A. [2 ]
机构
[1] Univ Calif Riverside, Dept Elect & Comp Engn, Riverside, CA 92501 USA
[2] Univ Southern Calif, Dept Elect Engn, Los Angeles, CA 90007 USA
关键词
Assignment problem; electric vehicle; reinforcement learning; ride-hailing services; ROUTING PROBLEM;
D O I
10.1109/TITS.2019.2947408
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Providing ride-hailing services with electric vehicles can help reduce greenhouse gas emissions and solve the last mile problem. This paper develops a reinforcement learning based algorithm to operate a community owned electric vehicle fleet, which provides ride-hailing services to local residents. The goals of operating the electric vehicle fleet are to minimize customer waiting time, electricity cost, and operational costs of the vehicles. A novel framework characterized by decentralized learning and centralized decision making is proposed to solve the electric vehicle fleet dispatch problem. The decentralized learning process allows the individual vehicles to share their operating experiences and deep neural network model for state-value function estimation, which mitigates the curse of dimensionality of state and action domains. The centralized decision making framework converts the vehicle fleet coordination problem into a linear assignment problem, which has polynomial time complexity. Numerical study results show that the proposed approach outperforms the benchmark algorithms in terms of societal cost reduction.
引用
收藏
页码:4822 / 4834
页数:13
相关论文
共 50 条
  • [31] A Reinforcement Learning and Prediction-Based Lookahead Policy for Vehicle Repositioning in Online Ride-Hailing Systems
    Wei, Honghao
    Yang, Zixian
    Liu, Xin
    Qin, Zhiwei
    Tang, Xiaocheng
    Ying, Lei
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 1846 - 1856
  • [32] The impact of ride-hailing on vehicle miles traveled
    Henao, Alejandro
    Marshall, Wesley E.
    [J]. TRANSPORTATION, 2019, 46 (06) : 2173 - 2194
  • [33] The impact of ride-hailing on vehicle miles traveled
    Alejandro Henao
    Wesley E. Marshall
    [J]. Transportation, 2019, 46 : 2173 - 2194
  • [34] Coordinated Ride-hailing Order Scheduling and Charging for Autonomous Electric Vehicles Based on Deep Reinforcement Learning
    Zhang, Jinxi
    Kong, Lingming
    Zhang, Hongcai
    [J]. 2023 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA, I&CPS ASIA, 2023, : 2038 - 2044
  • [35] Evidence for Acceptance of Ride-Hailing Services in Iran
    Akbari, Morteza
    Amiri, Nader Seyyed
    Zuniga, Miguel Angel
    Padash, Hamid
    Shakiba, Hodjat
    [J]. TRANSPORTATION RESEARCH RECORD, 2020, 2674 (11) : 289 - 303
  • [36] Ride-hailing services and vehicle ownership: evidence from Indian metropolitan cities
    Krishna, B. Ajay
    [J]. JOURNAL OF INDIAN BUSINESS RESEARCH, 2024, 16 (01) : 84 - 97
  • [37] Risk-Aware Operation Modeling for Ride-Hailing Fleet in Order Grabbing Mode: A Distributional Reinforcement Learning Approach
    Sun, Yimeng
    Ding, Zhaohao
    Hu, Zechun
    Lee, Wei-Jen
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2023, 14 (05) : 3913 - 3926
  • [38] Acceptability, energy consumption, and costs of electric vehicle for ride-hailing drivers in Beijing
    Tu, Wei
    Santi, Paolo
    Zhao, Tianhong
    He, Xiaoyi
    Li, Qingquan
    Dong, Lei
    Wallington, Timothy J.
    Ratti, Carlo
    [J]. APPLIED ENERGY, 2019, 250 : 147 - 160
  • [39] Learn to Earn: Enabling Coordination Within a Ride-Hailing Fleet
    Chaudhari, Harshal A.
    Byers, John W.
    Terzi, Evimaria
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 1127 - 1136
  • [40] Infrastructure planning for ride-hailing services using shared autonomous electric vehicles
    Paudel, Diwas
    Das, Tapas K.
    [J]. INTERNATIONAL JOURNAL OF SUSTAINABLE TRANSPORTATION, 2023, 17 (10) : 1139 - 1154