Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework

被引:0
|
作者
Huang, Xuejin [1 ]
Zhang, Jingyi [2 ]
Ou, Kai [3 ]
Huang, Yin [1 ]
Kang, Zehao [1 ]
Mao, Xuping [1 ]
Zhou, Yujie [1 ]
Xuan, Dongji [1 ]
机构
[1] Wenzhou Univ, Coll Mech & Elect Engn, Wenzhou, Peoples R China
[2] Chongqing Jinkang Powertrain New Energy Co Ltd, Chongqing 400000, Peoples R China
[3] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
关键词
Fuel cell hybrid electric vehicle; Energy management strategy; Energy source aging; Model predictive control framework; Bi-directional long short-term memory network; Model-based deep reinforcement learning; STRATEGY; LIFETIME; BUS;
D O I
10.1016/j.energy.2024.131769
中图分类号
O414.1 [热力学];
学科分类号
摘要
The main contribution of this study is to introduce deep reinforcement learning (DRL) within the model prediction control (MPC) framework, and consider comprehensive economic objectives including fuel cell degradation costs, lithium battery aging costs, hydrogen consumption costs, etc. This approach successfully mitigated the inherent shortcomings of deep reinforcement learning, namely poor generalization and lack of adaptability, thereby significantly enhancing the robustness of economic driving decision in unknown scenarios. In this study, an MPC framework was developed for the energy management problem of fuel cell vehicles, and Bi-directional Long Short-Term Memory (Bi-LSTM) neural network was used to construct a vehicle speed predictor The accuracy of its prediction was verified through comparative analysis, and then it was regarded as a DRL model. Different from the overall strategy of the entire driving cycle, the model based DRL agent can learn the optimal action for each vehicle state. The simulation evaluated the impact of different predictors and prediction ranges on hydrogen economy, and verified the adaptability of the proposed strategy in different driving environments, the stability of battery state maintenance, and the advantages of delaying energy system degradation through comprehensive comparative analysis.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Cloud-based health-conscious energy management of hybrid battery systems in electric vehicles with deep reinforcement learning
    Li, Weihan
    Cui, Han
    Nemeth, Thomas
    Jansen, Jonathan
    Uenluebayir, Cem
    Wei, Zhongbao
    Feng, Xuning
    Han, Xuebing
    Ouyang, Minggao
    Dai, Haifeng
    Wei, Xuezhe
    Sauer, Dirk Uwe
    APPLIED ENERGY, 2021, 293
  • [2] Energy management of hybrid electric vehicles based on model predictive control and deep reinforcement learning
    Zhang, Chunmei
    Cul, Wei
    Du, Yi
    Li, Tao
    Cui, Naxin
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 5441 - 5446
  • [3] Deep stochastic reinforcement learning-based energy management strategy for fuel cell hybrid electric vehicles
    Jouda, Basel
    Al-Mahasneh, Ahmad Jobran
    Abu Mallouh, Mohammed
    ENERGY CONVERSION AND MANAGEMENT, 2024, 301
  • [4] Multi-Objective Optimization-Based Health-Conscious Predictive Energy Management Strategy for Fuel Cell Hybrid Electric Vehicles
    Sellali, Mehdi
    Ravey, Alexandre
    Betka, Achour
    Kouzou, Abdellah
    Benbouzid, Mohamed
    Djerdir, Abdesslem
    Kennel, Ralph
    Abdelrahem, Mohamed
    ENERGIES, 2022, 15 (04)
  • [5] Reinforcement learning-based real-time intelligent energy management for hybrid electric vehicles in a model predictive control framework*
    Yang, Ningkang
    Ruan, Shumin
    Han, Lijin
    Liu, Hui
    Guo, Lingxiong
    Xiang, Changle
    ENERGY, 2023, 270
  • [6] Health-Conscious Energy Management for Fuel Cell Hybrid Electric Vehicles Based on Adaptive Equivalent Consumption Minimization Strategy
    Zhang, Pei
    Wang, Yubing
    Du, Hongbo
    Du, Changqing
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [7] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [8] Learning-based model predictive energy management for fuel cell hybrid electric bus with health-aware control
    Jia, Chunchun
    He, Hongwen
    Zhou, Jiaming
    Li, Jianwei
    Wei, Zhongbao
    Li, Kunang
    APPLIED ENERGY, 2024, 355
  • [9] Review on health-conscious energy management strategies for fuel cell hybrid electric vehicles: Degradation models and strategies
    Yue, Meiling
    Jemei, Samir
    Gouriveau, Rafael
    Zerhouni, Noureddine
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2019, 44 (13) : 6844 - 6861
  • [10] Reinforcement Learning based Energy Management for Fuel Cell Hybrid Electric Vehicles
    Guo, Liang
    Li, Zhongliang
    Outbib, Rachid
    IECON 2021 - 47TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2021,