Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework

被引:0
|
作者
Huang, Xuejin [1 ]
Zhang, Jingyi [2 ]
Ou, Kai [3 ]
Huang, Yin [1 ]
Kang, Zehao [1 ]
Mao, Xuping [1 ]
Zhou, Yujie [1 ]
Xuan, Dongji [1 ]
机构
[1] Wenzhou Univ, Coll Mech & Elect Engn, Wenzhou, Peoples R China
[2] Chongqing Jinkang Powertrain New Energy Co Ltd, Chongqing 400000, Peoples R China
[3] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
关键词
Fuel cell hybrid electric vehicle; Energy management strategy; Energy source aging; Model predictive control framework; Bi-directional long short-term memory network; Model-based deep reinforcement learning; STRATEGY; LIFETIME; BUS;
D O I
10.1016/j.energy.2024.131769
中图分类号
O414.1 [热力学];
学科分类号
摘要
The main contribution of this study is to introduce deep reinforcement learning (DRL) within the model prediction control (MPC) framework, and consider comprehensive economic objectives including fuel cell degradation costs, lithium battery aging costs, hydrogen consumption costs, etc. This approach successfully mitigated the inherent shortcomings of deep reinforcement learning, namely poor generalization and lack of adaptability, thereby significantly enhancing the robustness of economic driving decision in unknown scenarios. In this study, an MPC framework was developed for the energy management problem of fuel cell vehicles, and Bi-directional Long Short-Term Memory (Bi-LSTM) neural network was used to construct a vehicle speed predictor The accuracy of its prediction was verified through comparative analysis, and then it was regarded as a DRL model. Different from the overall strategy of the entire driving cycle, the model based DRL agent can learn the optimal action for each vehicle state. The simulation evaluated the impact of different predictors and prediction ranges on hydrogen economy, and verified the adaptability of the proposed strategy in different driving environments, the stability of battery state maintenance, and the advantages of delaying energy system degradation through comprehensive comparative analysis.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning
    Zhou, Jianhao
    Guo, Aijun
    Wang, Jie
    Wang, Chunyan
    Zhao, Wanzhong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 238 (14) : 4659 - 4675
  • [42] Benchmarking Deep Reinforcement Learning Based Energy Management Systems for Hybrid Electric Vehicles
    Wu Yuankai
    Lian Renzong
    Wang Yong
    Lin Yi
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT II, 2022, 13605 : 613 - 625
  • [43] Deep reinforcement learning based energy management strategy of fuel cell hybrid railway vehicles considering fuel cell aging
    Deng, Kai
    Liu, Yingxu
    Hai, Di
    Peng, Hujun
    Lowenstein, Lars
    Pischinger, Stefan
    Hameyer, Kay
    ENERGY CONVERSION AND MANAGEMENT, 2022, 251
  • [44] Deep reinforcement learning based energy management strategy of fuel cell hybrid railway vehicles considering fuel cell aging
    Deng, Kai
    Liu, Yingxu
    Hai, Di
    Peng, Hujun
    Löwenstein, Lars
    Pischinger, Stefan
    Hameyer, Kay
    Energy Conversion and Management, 2022, 251
  • [45] A Novel Model Predictive Control Framework for Energy Management in Retrofit Hybrid Electric Vehicles
    Kothuri, Naveen
    Chandrasekhar, Aditya
    Sengupta, Somnath
    SAE INTERNATIONAL JOURNAL OF ELECTRIFIED VEHICLES, 2023, 12 (03): : 343 - 359
  • [46] A learning-based hierarchical energy management control strategy for hybrid electric vehicles
    Chen, Yanfang
    Li, Xuefang
    IET Control Theory and Applications, 2024, 18 (18): : 2725 - 2741
  • [47] A Deep Reinforcement Learning-Based Energy Management Framework With Lagrangian Relaxation for Plug-In Hybrid Electric Vehicle
    Zhang, Hailong
    Peng, Jiankun
    Tan, Huachun
    Dong, Hanxuan
    Ding, Fan
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) : 1146 - 1160
  • [48] Reinforcement Learning-Based Electric Vehicles Energy Management Strategy with Battery Thermal Model
    黄淦
    曹童杰
    韩俊华
    赵萍
    张光林
    Journal of Donghua University(English Edition), 2023, 40 (01) : 80 - 87
  • [49] A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles
    Mei, Peng
    Karimi, Hamid Reza
    Xie, Hehui
    Chen, Fei
    Huang, Cong
    Yang, Shichun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [50] BATTERY HEALTH-CONSCIOUS POWER MANAGEMENT FOR PLUG-IN HYBRID ELECTRIC VEHICLES VIA STOCHASTIC CONTROL
    Moura, Scott J.
    Stein, Jeffrey L.
    Fathy, Hosam K.
    PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE 2010, VOL 1, 2010, : 615 - 624