A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction

被引:30
|
作者
Yang, Duo [1 ]
Wang, Li [2 ]
Yu, Kunjie [1 ]
Liang, Jing [1 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
[2] Hefei Univ Technol, Dept Vehicle Engn, Hefei 230009, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Fuel cell; Hybrid dynamic system; Energy management strategy; Reinforcement learning; Velocity prediction; STORAGE SYSTEM; POWER MANAGEMENT; ELECTRIC VEHICLE; OPTIMIZATION;
D O I
10.1016/j.enconman.2022.116453
中图分类号
O414.1 [热力学];
学科分类号
摘要
The fuel cell vehicle is an ideal new energy vehicle development direction, and its energy management strategy is one of the core technologies to ensure the safe and efficient operation of the vehicle. We proposed a novel reinforcement learning-based energy management method for the fuel cell/lithium battery hybrid system in this paper. In order to improve the reliability of the EMS, the real-time driving profile classification and velocity prediction method based on data driven and statistical analysis is proposed to forecast vehicle velocity in the near future. Then a reinforcement learning method is designed to realize the real-time power allocation. The reward value function which comprehensively considers the system safety, economics and fuel cell durability is crea-tively put forward. The double Q-learning strategy is applied to update the Q value function. In addition, the real-time reference path of power allocation is designed by taking battery state-of-charge as an indicator. A new dynamic test profile is conducted to verify the proposed method. The multiple groups of comparative simulation experiments show that the proposed EMS can effectively reduce the life decay rate of fuel cell, but also improves fuel economics by up to 6% compared with other commonly used methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Reinforcement learning-based real-time energy management for a hybrid tracked vehicle
    Zou, Yuan
    Liu, Teng
    Liu, Dexing
    Sun, Fengchun
    [J]. APPLIED ENERGY, 2016, 171 : 372 - 382
  • [2] Real-time energy management of fuel cell hybrid electric vehicle based on variable horizon velocity prediction considering power source durability
    Ma, Yan
    Qi, Baohui
    Wang, Siyu
    Ma, Qian
    Sui, Zhen
    Gao, Jinwu
    [J]. Energy, 2025, 315
  • [3] A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime
    Li, Wei
    Ye, Jiaye
    Cui, Yunduan
    Kim, Namwook
    Cha, Suk Won
    Zheng, Chunhua
    [J]. INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 859 - 872
  • [4] A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime
    Wei Li
    Jiaye Ye
    Yunduan Cui
    Namwook Kim
    Suk Won Cha
    Chunhua Zheng
    [J]. International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 859 - 872
  • [5] Reinforcement Learning-Based Energy Management Strategy Considering Driving Style for Hybrid Electric Vehicle
    Shi, Dehua
    Yuan, Chao
    Wang, Shaohua
    Zhou, Weiqi
    Chen, Long
    [J]. Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2024, 58 (10): : 51 - 62
  • [6] A reinforcement learning-based energy management strategy for fuel cell electric vehicle considering coupled-energy sources degradations
    Huo, Weiwei
    Liu, Teng
    Lu, Bing
    [J]. Sustainable Energy, Grids and Networks, 2024, 40
  • [7] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    [J]. INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [8] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    [J]. International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [9] Reinforcement Learning-Based Energy Management Strategy for a Hybrid Electric Tracked Vehicle
    Liu, Teng
    Zou, Yuan
    Liu, Dexing
    Sun, Fengchun
    [J]. ENERGIES, 2015, 8 (07): : 7243 - 7260
  • [10] Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle
    Xiong, Rui
    Cao, Jiayi
    Yu, Quanqing
    [J]. APPLIED ENERGY, 2018, 211 : 538 - 548