Model improvement and scheduling optimization for multi-vehicle charging planning in IoV

Intelligent electric vehicles (EV) can transmit their location, driving status and other information to Intelligent Transportation Systems (ITS) through the Internet of vehicles (IoV) communication. Among them, the optimization of EV charging planning has great significance in finding a suitable charging station (CS) for users. However, the constraints of State-of-Charge (SOC) and driving direction are incomplete in current planning mod-els. Meanwhile, the existing scheduling policy based on Deep Reinforcement Learning (DRL) suffers from slow convergence due to the fixed average change rate of the reward function. This paper establishes a comprehensive EV charging planning model (CCPM) and presents an efficient multi-vehicle scheduling algorithm (EMVSA). Firstly, CCPM calculates the travel time under the SOC constraints to ensure that CS is reachable and takes into account the direction constraint by minimizing the distance of the selected CS to the user's destination. Secondly, a novel reward shaping method, which gradually increases the average change rate of the reward function, is presented and proved theoretically to accelerate the convergence of EMVSA. On the real city road network data, experimental results show that CCPM can guarantee the reasonability of CS selection and direction, and that the convergence speed of EMVSA is significantly increased to get the optimal scheduling result.& COPY; 2023 Elsevier B.V. All rights reserved.