Development of improved reinforcement learning smart charging strategy for electric vehicle fleet

被引:24
|
作者
Sultanuddin, S. J. [1 ]
Vibin, R. [2 ]
Kumar, A. Rajesh [3 ]
Behera, Nihar Ranjan [4 ]
Pasha, M. Jahir [5 ]
Baseer, K. K. [6 ]
机构
[1] Measi Inst Informat Technol, Chennai, India
[2] CMS Coll Engn & Technol, Elect & Elect Engn, Coimbatore, Tamil Nadu, India
[3] NSN Coll Engn & Technol, Comp Sci & Engn, Karur, Tamil Nadu, India
[4] Swiss Sch Business & Management Geneva, Ave Morgines 12, CH-1213 Petit Lancy, Switzerland
[5] G Pullaiah Coll Engn & Technol, Dept Comp Sci & Engn, Kurnool, Andhra Pradesh, India
[6] Mohan Babu Univ, Erstwhile Sree Vidyanikethan Engn Coll, Sch Comp, Tirupati, Andhra Pradesh, India
关键词
Electric vehicle; Smart charging; Reinforcement learning; Power grid; Optimization;
D O I
10.1016/j.est.2023.106987
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to its environmental and energy sustainability, electric vehicles (EV) have emerged as the preferred option in the current transportation system. Uncontrolled EV charging, however, can raise consumers; charging costs and overwhelm the grid. Smart charging coordination systems are required to prevent the grid overload caused by charging too many electric vehicles at once. In light of the baseload that is present in the power grid, this research suggests an improved reinforcement learning charging management system. An optimization method, however, requires some knowledge in advance, such as the time the vehicle departs and how much energy it will need when it arrives at the charging station. Therefore, under realistic operating conditions, our improved Reinforcement Learning method with Double Deep Q-learning approach provides an adjustable, scalable, and flexible strategy for an electric car fleet. Our proposed approach provides fair value which solves the over-estimation action value problem in deep Q-learning. Then, a number of different charging strategies are compared to the Reinforcement Learning algorithm. The proposed Reinforcement Learning technique minimizes the variance of the overall load by 68 % when compared to an uncontrolled charging strategy.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Fleet Optimization of Smart Electric Motorcycle System Using Deep Reinforcement Learning
    Anchuen, Patikorn
    Uthansakul, Peerapong
    Uthansakul, Monthippa
    Poochaya, Settawit
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 1925 - 1943
  • [32] Daily electric vehicle charging dataset for training reinforcement learning algorithms
    Gholizadeh, Nastaran
    Musilek, Petr
    DATA IN BRIEF, 2024, 55
  • [33] Electric vehicle charging navigation method based on hierarchical reinforcement learning
    Zhan H.
    Jiang C.
    Su Q.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2022, 42 (10): : 264 - 272
  • [34] Modeling and Data Analysis of Electric Vehicle Fleet Charging
    Kucuksari, Sadik
    Erdogan, Nuh
    2022 IEEE/AIAA TRANSPORTATION ELECTRIFICATION CONFERENCE AND ELECTRIC AIRCRAFT TECHNOLOGIES SYMPOSIUM (ITEC+EATS 2022), 2022, : 1139 - 1143
  • [35] Electric vehicle smart charging navigation
    Su, Shu
    Sun, Jinwen
    Lin, Xiangning
    Li, Xianshan
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2013, 33 (SUPPL): : 59 - 67
  • [36] Smart Electric Vehicle Charging System
    Ferreira, Joao C.
    Monteiro, Vitor
    Afonso, Joao L.
    Silva, Alberto
    2011 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2011, : 758 - 763
  • [37] Orderly charging strategy of electric vehicle based on improved PSO algorithm
    Du, Wenyi
    Ma, Juan
    Yin, Wanjun
    ENERGY, 2023, 271
  • [38] Smart Charging Strategy for Li-ion Battery Pack of an Electric Vehicle
    Chandrasekaran, N.
    Sharma, Shrivatsal
    Basu, Suman
    2019 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE (ITEC-INDIA), 2019,
  • [39] Smart electric vehicle charging management for smart cities
    Vaidya, Binod
    Mouftah, Hussein T.
    IET SMART CITIES, 2020, 2 (01) : 4 - 13
  • [40] Charging powers of the electric vehicle fleet: Evolution and implications at commercial charging sites
    Simolin, Toni
    Rauma, Kalle
    Viri, Riku
    Makinen, Johanna
    Rautiainen, Antti
    Jarventausta, Pertti
    APPLIED ENERGY, 2021, 303