Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework

被引:0
|
作者
Huang, Xuejin [1 ]
Zhang, Jingyi [2 ]
Ou, Kai [3 ]
Huang, Yin [1 ]
Kang, Zehao [1 ]
Mao, Xuping [1 ]
Zhou, Yujie [1 ]
Xuan, Dongji [1 ]
机构
[1] Wenzhou Univ, Coll Mech & Elect Engn, Wenzhou, Peoples R China
[2] Chongqing Jinkang Powertrain New Energy Co Ltd, Chongqing 400000, Peoples R China
[3] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
关键词
Fuel cell hybrid electric vehicle; Energy management strategy; Energy source aging; Model predictive control framework; Bi-directional long short-term memory network; Model-based deep reinforcement learning; STRATEGY; LIFETIME; BUS;
D O I
10.1016/j.energy.2024.131769
中图分类号
O414.1 [热力学];
学科分类号
摘要
The main contribution of this study is to introduce deep reinforcement learning (DRL) within the model prediction control (MPC) framework, and consider comprehensive economic objectives including fuel cell degradation costs, lithium battery aging costs, hydrogen consumption costs, etc. This approach successfully mitigated the inherent shortcomings of deep reinforcement learning, namely poor generalization and lack of adaptability, thereby significantly enhancing the robustness of economic driving decision in unknown scenarios. In this study, an MPC framework was developed for the energy management problem of fuel cell vehicles, and Bi-directional Long Short-Term Memory (Bi-LSTM) neural network was used to construct a vehicle speed predictor The accuracy of its prediction was verified through comparative analysis, and then it was regarded as a DRL model. Different from the overall strategy of the entire driving cycle, the model based DRL agent can learn the optimal action for each vehicle state. The simulation evaluated the impact of different predictors and prediction ranges on hydrogen economy, and verified the adaptability of the proposed strategy in different driving environments, the stability of battery state maintenance, and the advantages of delaying energy system degradation through comprehensive comparative analysis.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Health-conscious deep reinforcement learning energy management for fuel cell buses integrating environmental and look-ahead road information
    Jia, Chunchun
    Zhou, Jiaming
    He, Hongwen
    Li, Jianwei
    Wei, Zhongbao
    Li, Kunang
    ENERGY, 2024, 290
  • [32] Research on Deep Reinforcement Learning-based Intelligent Car-following Control and Energy Management Strategy for Hybrid Electric Vehicles
    Tang X.
    Chen J.
    Liu T.
    Li J.
    Hu X.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2021, 57 (22): : 237 - 246
  • [33] Deep Reinforcement Learning-based Control Strategy of Connected Hybrid Electric Vehicles Platooning
    Guo J.
    Li W.
    Wang B.
    Wang J.
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2024, 60 (02): : 262 - 271
  • [34] A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles
    Zhao, Pu
    Wang, Yanzhi
    Chang, Naehyuck
    Zhu, Qi
    Lin, Xue
    2018 23RD ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2018, : 196 - 202
  • [35] Integrating Model Predictive Control With Federated Reinforcement Learning for Decentralized Energy Management of Fuel Cell Vehicles
    Khalatbarisoltani, Arash
    Boulon, Loic
    Hu, Xiaosong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (12) : 13639 - 13653
  • [36] Nonlinear Model Predictive Control for the Energy Management of Fuel Cell Hybrid Electric Vehicles in Real Time
    Pereira, Derick Furquim
    Lopes, Francisco da Costa
    Watanabe, Edson H.
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (04) : 3213 - 3223
  • [37] A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime
    Li, Wei
    Ye, Jiaye
    Cui, Yunduan
    Kim, Namwook
    Cha, Suk Won
    Zheng, Chunhua
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 859 - 872
  • [38] A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime
    Wei Li
    Jiaye Ye
    Yunduan Cui
    Namwook Kim
    Suk Won Cha
    Chunhua Zheng
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 859 - 872
  • [39] An energy management strategy for plug-in hybrid electric vehicles based on deep learning and improved model predictive control
    Sun, Xilei
    Fu, Jianqin
    Yang, Huiyong
    Xie, Mingke
    Liu, Jingping
    ENERGY, 2023, 269
  • [40] Reinforcement Learning-Based Energy Management for Fuel Cell Electrical Vehicles Considering Fuel Cell Degradation
    Shuai, Qilin
    Wang, Yiheng
    Jiang, Zhengxiong
    Hua, Qingsong
    ENERGIES, 2024, 17 (07)