Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

被引:3
|
作者
Chen, Hao [1 ,2 ]
Guo, Gang [1 ]
Tang, Bangbei [3 ]
Hu, Guo [2 ]
Tang, Xiaolin [1 ]
Liu, Teng [1 ]
机构
[1] Chongqing Univ, Dept Automot Engn, Chongqing 400044, Peoples R China
[2] Chongqing Normal Univ, Dept Prod Design, Chongqing 401331, Peoples R China
[3] Chongqing Univ Arts & Sci, Sch Intelligent Mfg Engn, Chongqing 402160, Peoples R China
关键词
Transfer learning; Deep reinforcement learning; Proximal policy optimization; Energy management; Hybrid electric vehicle; Real-world driving cycles;
D O I
10.1016/j.egyr.2023.09.087
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problemsolving capabilities of deep reinforcement learning (DRL), this paper proposes a real-time EMS via incorporating the DRL method and transfer learning (TL). The related EMSs are derived from and evaluated on the real-world collected driving cycle dataset from Transportation Secure Data Center (TSDC). The concrete DRL algorithm is proximal policy optimization (PPO) belonging to the policy gradient (PG) techniques. For specification, many source driving cycles are utilized for training the parameters of deep networks based on PPO. The learned parameters are transformed into the target driving cycles under the TL framework. The EMSs related to the target driving cycles are estimated and compared in different training conditions. Simulation results indicate that the presented transfer DRL-based EMS could effectively reduce the time consumption and guarantee the control performance. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2680 / 2692
页数:13
相关论文
共 50 条
  • [1] Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning
    Chen, Hao
    Guo, Gang
    Tang, Bangbei
    Hu, Guo
    Tang, Xiaolin
    Liu, Teng
    [J]. ENERGY REPORTS, 2023, 9 : 1098 - 1109
  • [2] An Adaptive Hierarchical Energy Management Strategy for Hybrid Electric Vehicles Combining Heuristic Domain Knowledge and Data-Driven Deep Reinforcement Learning
    Hu, Bo
    Li, Jiaxi
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (03) : 3275 - 3288
  • [3] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    [J]. INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [4] Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles
    Sun, Haochen
    Fu, Zhumu
    Tao, Fazhan
    Zhu, Longlong
    Si, Pengju
    [J]. JOURNAL OF POWER SOURCES, 2020, 455
  • [5] A Hybrid Algorithm Combining Data-Driven and Simulation-Based Reinforcement Learning Approaches to Energy Management of Hybrid Electric Vehicles
    Hu, Bo
    Zhang, Sunan
    Liu, Bocheng
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (01): : 1257 - 1273
  • [6] A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems
    Bao, Gang
    Xu, Rui
    [J]. COGNITIVE COMPUTATION, 2023, 15 (02) : 739 - 750
  • [7] A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems
    Gang Bao
    Rui Xu
    [J]. Cognitive Computation, 2023, 15 : 739 - 750
  • [8] A Data-Driven Solution for Energy Management Strategy of Hybrid Electric Vehicles Based on Uncertainty-Aware Model-Based Offline Reinforcement Learning
    Hu, Bo
    Xiao, Yang
    Zhang, Sunan
    Liu, Bocheng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (06) : 7709 - 7719
  • [9] Data-Driven Energy Management of an Electric Vehicle Charging Station Using Deep Reinforcement Learning
    Rani, G. S. Asha
    Priya, P. S. Lal
    Jayan, Jino
    Satheesh, Rahul
    Kolhe, Mohan Lal
    [J]. IEEE ACCESS, 2024, 12 : 65956 - 65966
  • [10] A Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicles in Connected Traffic Environment
    Li, Jie
    Wu, Xiaodong
    Hu, Sunan
    Fan, Jiawei
    [J]. IFAC PAPERSONLINE, 2021, 54 (10): : 150 - 156