Development of improved reinforcement learning smart charging strategy for electric vehicle fleet

被引:24
|
作者
Sultanuddin, S. J. [1 ]
Vibin, R. [2 ]
Kumar, A. Rajesh [3 ]
Behera, Nihar Ranjan [4 ]
Pasha, M. Jahir [5 ]
Baseer, K. K. [6 ]
机构
[1] Measi Inst Informat Technol, Chennai, India
[2] CMS Coll Engn & Technol, Elect & Elect Engn, Coimbatore, Tamil Nadu, India
[3] NSN Coll Engn & Technol, Comp Sci & Engn, Karur, Tamil Nadu, India
[4] Swiss Sch Business & Management Geneva, Ave Morgines 12, CH-1213 Petit Lancy, Switzerland
[5] G Pullaiah Coll Engn & Technol, Dept Comp Sci & Engn, Kurnool, Andhra Pradesh, India
[6] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Sch Comp, Tirupati, Andhra Pradesh, India
关键词
Electric vehicle; Smart charging; Reinforcement learning; Power grid; Optimization;
D O I
10.1016/j.est.2023.106987
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to its environmental and energy sustainability, electric vehicles (EV) have emerged as the preferred option in the current transportation system. Uncontrolled EV charging, however, can raise consumers; charging costs and overwhelm the grid. Smart charging coordination systems are required to prevent the grid overload caused by charging too many electric vehicles at once. In light of the baseload that is present in the power grid, this research suggests an improved reinforcement learning charging management system. An optimization method, however, requires some knowledge in advance, such as the time the vehicle departs and how much energy it will need when it arrives at the charging station. Therefore, under realistic operating conditions, our improved Reinforcement Learning method with Double Deep Q-learning approach provides an adjustable, scalable, and flexible strategy for an electric car fleet. Our proposed approach provides fair value which solves the over-estimation action value problem in deep Q-learning. Then, a number of different charging strategies are compared to the Reinforcement Learning algorithm. The proposed Reinforcement Learning technique minimizes the variance of the overall load by 68 % when compared to an uncontrolled charging strategy.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Sizing of Fast Charging Infrastructure Site for Commercial Electric Vehicle Fleet Considering Smart Charge Management
    Mohamed, Ahmed A. S.
    Ingalalli, Aravind
    Rehman, Waqas Ur
    Bhavaraju, Vijay
    2024 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE AND EXPO, ITEC 2024, 2024,
  • [42] An Online Reinforcement Learning Approach for Dynamic Pricing of Electric Vehicle Charging Stations
    Moghaddam, Valeh
    Yazdani, Amirmehdi
    Wang, Hai
    Parlevliet, David
    Shahnia, Farhad
    IEEE ACCESS, 2020, 8 : 130305 - 130313
  • [43] Electric vehicle charging design: The factored action based reinforcement learning approach
    Truong, Van Binh
    Le, Long Bao
    APPLIED ENERGY, 2024, 359
  • [44] A Dynamic Pricing System for Electric Vehicle Charging Management Using Reinforcement Learning
    Narayanan, Ajay
    Krishna, Aakash
    Misra, Prasant
    Vasan, Arun
    Sarangan, Venkatesh
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2022, 14 (06) : 122 - 134
  • [45] Charging Strategies to Minimize the Energy Cost for an Electric Vehicle Fleet
    Van-Linh Nguyen
    Tuan Tran-Quoc
    Bacha, Seddik
    Ngoc-An Luu
    2014 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE EUROPE (ISGT EUROPE), 2014,
  • [46] A transfer learning method for electric vehicles charging strategy based on deep reinforcement learning
    Wang, Kang
    Wang, Haixin
    Yang, Zihao
    Feng, Jiawei
    Li, Yanzhen
    Yang, Junyou
    Chen, Zhe
    APPLIED ENERGY, 2023, 343
  • [47] Charging Strategies to Minimize the Peak Load for an Electric Vehicle Fleet
    Van-Linh Nguyen
    Tuan Tran-Quoc
    Bacha, Seddik
    Be Nguyen
    IECON 2014 - 40TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2014, : 3522 - 3528
  • [48] European electric vehicle fleet: driving and charging data analysis
    Corchero, C.
    Gonzalez-Villafranca, S.
    Sanmarti, M.
    2014 IEEE INTERNATIONAL ELECTRIC VEHICLE CONFERENCE (IEVC), 2014,
  • [49] Adaptive Charging Networks: A Framework for Smart Electric Vehicle Charging
    Lee, Zachary J.
    Lee, George
    Lee, Ted
    Jin, Cheng
    Lee, Rand
    Low, Zhi
    Chang, Daniel
    Ortega, Christine
    Low, Steven H.
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (05) : 4339 - 4350
  • [50] Electric Vehicle Charging Modes, Technologies and Applications of Smart Charging
    Ahmad, Afaq
    Khalid, Muhammad
    Ullah, Zahid
    Ahmad, Naveed
    Aljaidi, Mohammad
    Malik, Faheem Ahmed
    Manzoor, Umar
    ENERGIES, 2022, 15 (24)