Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

被引:3
|
作者
Chen, Hao [1 ,2 ]
Guo, Gang [1 ]
Tang, Bangbei [3 ]
Hu, Guo [2 ]
Tang, Xiaolin [1 ]
Liu, Teng [1 ]
机构
[1] Chongqing Univ, Dept Automot Engn, Chongqing 400044, Peoples R China
[2] Chongqing Normal Univ, Dept Prod Design, Chongqing 401331, Peoples R China
[3] Chongqing Univ Arts & Sci, Sch Intelligent Mfg Engn, Chongqing 402160, Peoples R China
关键词
Transfer learning; Deep reinforcement learning; Proximal policy optimization; Energy management; Hybrid electric vehicle; Real-world driving cycles;
D O I
10.1016/j.egyr.2023.09.087
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problemsolving capabilities of deep reinforcement learning (DRL), this paper proposes a real-time EMS via incorporating the DRL method and transfer learning (TL). The related EMSs are derived from and evaluated on the real-world collected driving cycle dataset from Transportation Secure Data Center (TSDC). The concrete DRL algorithm is proximal policy optimization (PPO) belonging to the policy gradient (PG) techniques. For specification, many source driving cycles are utilized for training the parameters of deep networks based on PPO. The learned parameters are transformed into the target driving cycles under the TL framework. The EMSs related to the target driving cycles are estimated and compared in different training conditions. Simulation results indicate that the presented transfer DRL-based EMS could effectively reduce the time consumption and guarantee the control performance. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2680 / 2692
页数:13
相关论文
共 50 条
  • [11] Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Liu, Teng
    Qin, Yechen
    Cao, Dongpu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 9922 - 9934
  • [12] Intelligent energy management strategy for hybrid electric vehicles using reinforcement learning
    Devaraj T.B.
    Kottoor C.N.R.
    [J]. Australian Journal of Electrical and Electronics Engineering, 2024, 21 (01): : 1 - 10
  • [13] A Data-Driven Reinforcement Learning Based Energy Management Strategy via Bridging Offline Initialization and Online Fine-Tuning for a Hybrid Electric Vehicle
    Hu, Bo
    Liu, Bocheng
    Zhang, Sunan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (10) : 1 - 10
  • [14] Energy Management Strategy of Fuel Cell Electric Vehicles Using Model-Based Reinforcement Learning With Data-Driven Model Update
    Lee, Heeyun
    Cha, Suk Won
    [J]. IEEE ACCESS, 2021, 9 : 59244 - 59254
  • [15] Data-Driven Reinforcement Learning-Based Real-Time Energy Management System for Plug-In Hybrid Electric Vehicles
    Qi, Xuewei
    Wu, Guoyuan
    Boriboonsomsin, Kanok
    Barth, Matthew J.
    Gonder, Jeffrey
    [J]. TRANSPORTATION RESEARCH RECORD, 2016, (2572) : 1 - 8
  • [16] A Data-Driven Predictive Energy Management Strategy for Plug-in Hybrid Vehicles
    Lohrer, Juergen
    Foerth, Matthias
    Lienkamp, Markus
    [J]. 2017 INTERNATIONAL CONFERENCE ON MECHANICAL, SYSTEM AND CONTROL ENGINEERING (ICMSC), 2017, : 297 - 304
  • [17] Deep stochastic reinforcement learning-based energy management strategy for fuel cell hybrid electric vehicles
    Jouda, Basel
    Al-Mahasneh, Ahmad Jobran
    Abu Mallouh, Mohammed
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2024, 301
  • [18] Online energy management strategy for ammonia-hydrogen hybrid electric vehicles harnessing deep reinforcement learning
    Chen, Fujun
    Wang, Bowen
    Ni, Meng
    Gong, Zhichao
    Jiao, Kui
    [J]. ENERGY, 2024, 301
  • [19] Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
    Hu, Yue
    Li, Weimin
    Xu, Kun
    Zahid, Taimoor
    Qin, Feiyan
    Li, Chenming
    [J]. APPLIED SCIENCES-BASEL, 2018, 8 (02):
  • [20] Research on Energy Management Strategy for Hybrid Electric Vehicles Based on Inverse Reinforcement Learning
    Qi C.
    Song C.
    Song S.
    Jin L.
    Wang D.
    Xiao F.
    [J]. Qiche Gongcheng/Automotive Engineering, 2023, 45 (10): : 1954 - 1964and1974