Optimizing fuel economy and durability of hybrid fuel cell electric vehicles using deep reinforcement learning-based energy management systems

被引:19
|
作者
Hu, Haowen [1 ]
Yuan, Wei-Wei [2 ]
Su, Minghang [1 ]
Ou, Kai [1 ]
机构
[1] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
[2] Minjiang Univ, Fujian Prov Key Lab Informat Proc & Intelligent Co, Fuzhou 350108, Peoples R China
关键词
Energy management strategy (EMS); Deep reinforcement learning; Fuel economy; Battery degradation; Fuel cell degradation; Overall cost; STRATEGY; OPTIMIZATION; BATTERY; DEGRADATION;
D O I
10.1016/j.enconman.2023.117288
中图分类号
O414.1 [热力学];
学科分类号
摘要
An effective energy management strategy (EMS) is crucial for the reliable operation of fuel cell hybrid electric vehicles (FCHEVs). This study proposes a power distribution optimization strategy for FCHEVs that leverages deep reinforcement learning (DRL) and Pontryagin's minimum principle (PMP). The DRL algorithm effectively balances fuel economy, battery durability, and fuel cell durability objectives. The degradation mechanisms of battery and fuel cell under extreme working conditions are considered in the PMP optimization. A comprehensive evaluation framework is established with degradation and energy consumption models to serve as a reward for deep reinforcement learning to balance fuel economy and power sources' lifetime. Simulation results show that the proposed EMS framework reduces FC degradation by 18.4% and battery degradation by 71.1% compared to traditional PMP-based EMS under the NEDC driving condition. Hardware-in-the-loop (HIL) testing demonstrates that the proposed EMS framework has the potential for real-time application, with an average relative error between experiment and simulation of approximately 0.0203. This research highlights the significance of the proposed EMS framework in ensuring the reliable operation of FCHEVs with enhanced performance and reduced cost.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Ensemble Reinforcement Learning-Based Supervisory Control of Hybrid Electric Vehicle for Fuel Economy Improvement
    Xu, Bin
    Hu, Xiaosong
    Tang, Xiaolin
    Lin, Xianke
    Li, Huayi
    Rathod, Dhruvang
    Filipi, Zoran
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2020, 6 (02): : 717 - 727
  • [42] Deep Reinforcement Learning Based Energy Management Strategy for Fuel Cell and Battery Powered Rail Vehicles
    Deng, Kai
    Hai, Di
    Peng, Hujun
    Loewenstein, Lars
    Hameyer, Kay
    2021 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2021,
  • [43] Dyna algorithm-based reinforcement learning energy management for fuel cell hybrid engineering vehicles
    Liu, Huiying
    Yao, Yongming
    Li, Tianyu
    Du, Miaomiao
    Wang, Xiao
    Li, Haofa
    Li, Ming
    JOURNAL OF ENERGY STORAGE, 2024, 94
  • [44] Deep reinforcement learning-based energy management system enhancement using digital twin for electric vehicles
    Ye, Yiming
    Xu, Bin
    Wang, Hanchen
    Zhang, Jiangfeng
    Lawler, Benjamin
    Ayalew, Beshah
    Energy, 2024, 312
  • [45] A Learning Model Predictive Controller for Energy Management in Fuel Cell Hybrid Electric Vehicles
    Xun, Qian
    Li, Qiuyu
    Yang, Hengzhao
    2024 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE AND EXPO, ITEC 2024, 2024,
  • [46] Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning
    Zhou, Jianhao
    Guo, Aijun
    Wang, Jie
    Wang, Chunyan
    Zhao, Wanzhong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 238 (14) : 4659 - 4675
  • [47] Deep reinforcement learning and fuzzy logic controller codesign for energy management of hydrogen fuel cell powered electric vehicles
    Seyed Mehdi Rakhtala Rostami
    Zeyad Al-Shibaany
    Peter Kay
    Hamid Reza Karimi
    Scientific Reports, 14 (1)
  • [48] Multi-objective reinforcement learning-based energy management for fuel cell vehicles considering lifecycle costs
    Wu, J. J.
    Song, D. F.
    Zhang, X. M.
    Duan, C. S.
    Yang, D. P.
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2023, 48 (95) : 37385 - 37401
  • [49] Optimizing Fuel Economy of Hybrid Electric Vehicles Using a Markov Decision Process Model
    Lin, Xue
    Wang, Yanzhi
    Bogdan, Paul
    Chang, Naehyuck
    Pedram, Massoud
    2015 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2015, : 718 - 723
  • [50] Energy Management Strategy of Fuel Cell Vehicles Based on Reinforcement Learning and Traffic Information
    Song Z.
    Min D.
    Chen H.
    Pan Y.
    Zhang T.
    Tongji Daxue Xuebao/Journal of Tongji University, 2021, 49 : 211 - 216