PROLIFIC: Deep Reinforcement Learning for Efficient EV Fleet Scheduling and Charging

被引:2
|
作者
Ma, Junchi [1 ]
Zhang, Yuan [1 ]
Duan, Zongtao [1 ]
Tang, Lei [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710061, Peoples R China
关键词
electric vehicles; charging scheduling; reinforcement learning; ride-hailing services; charging stations; OPERATIONS; ALGORITHM; VEHICLES;
D O I
10.3390/su151813553
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Electric vehicles (EVs) are becoming increasingly popular in ride-hailing services, but their slow charging speed negatively affects service efficiency. To address this challenge, we propose PROLIFIC, a deep reinforcement learning-based approach for efficient EV scheduling and charging in ride-hailing services. The objective of PROLIFIC is to minimize passenger waiting time and charging time cost. PROLIFIC formulates the EV scheduling problem as a Markov decision process and integrates a distributed charging scheduling management model and a centralized order dispatching model. By using a distributed deep Q-network, the agents can share charging and EV supply information to make efficient interactions between charging and dispatch decisions. This approach reduces the curse of dimensionality problem and improves the training efficiency of the neural network. The proposed approach is validated in three typical scenarios with different spatiotemporal distribution characteristics of passenger order, and the results demonstrate that PROLIFIC significantly reduces the passenger waiting time and charging time cost in all three scenarios compared to baseline algorithms.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) : 2427 - 2439
  • [2] CASA: cost-effective EV charging scheduling based on deep reinforcement learning
    Zhang, Ao
    Liu, Qingzhi
    Liu, Jinwei
    Cheng, Long
    [J]. NEURAL COMPUTING & APPLICATIONS, 2024, 36 (15): : 8355 - 8370
  • [3] CASA: cost-effective EV charging scheduling based on deep reinforcement learning
    Ao Zhang
    Qingzhi Liu
    Jinwei Liu
    Long Cheng
    [J]. Neural Computing and Applications, 2024, 36 : 8355 - 8370
  • [4] Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid
    Park, Keonwoo
    Moon, Ilkyeong
    [J]. APPLIED ENERGY, 2022, 328
  • [5] Reinforcement Learning based Scheduling for Cooperative EV-to-EV Dynamic Wireless Charging
    Yan, Li
    Shen, Haiying
    Kang, Liuwang
    Zhao, Juanjuan
    Xu, Chengzhong
    [J]. 2020 IEEE 17TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2020), 2020, : 401 - 409
  • [6] Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
    Wan, Zhiqiang
    Li, Hepeng
    He, Haibo
    Prokhorov, Danil
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (05) : 5246 - 5257
  • [7] Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
    Vandael, Stijn
    Claessens, Bert
    Ernst, Damien
    Holvoet, Tom
    Deconinck, Geert
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (04) : 1795 - 1805
  • [8] Dynamic Pricing for EV Charging Stations: A Deep Reinforcement Learning Approach
    Zhao, Zhonghao
    Lee, Carman K. M.
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (02) : 2456 - 2468
  • [9] A Reinforcement Learning Approach for EV Charging Station Dynamic Pricing and Scheduling Control
    Wang, Shuoyao
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    [J]. 2018 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2018,
  • [10] Reinforcement Learning Based EV Charging Scheduling: A Novel Action Space Representation
    Qian, Kun
    Adam, Rebecca
    Brehm, Robert
    [J]. 2021 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT ASIA), 2021,