Longevity-aware energy management for fuel cell hybrid electric bus based on a novel proximal policy optimization deep reinforcement learning framework

被引:29
|
作者
Huang, Ruchen [1 ,2 ,3 ]
He, Hongwen [1 ,2 ,3 ]
Zhao, Xuyang [1 ,3 ]
Gao, Miaojue [1 ,3 ]
机构
[1] Beijing Inst Technol, Natl Engn Res Ctr Elect Vehicles, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Collaborat Innovat Ctr Elect Vehicles Beijing, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuel cell hybrid electric bus; Energy management strategy; Deep reinforcement learning; Proximal policy optimization (PPO); Multi-thread distributed computation; GRADIENT METHODS; PREDICTION; LIFETIME; GO;
D O I
10.1016/j.jpowsour.2023.232717
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
With the prosperity of artificial intelligence and new energy vehicles, energy-saving technologies for zero -emission fuel cell hybrid electric vehicles through high-efficient deep reinforcement learning algorithms have become a research focus. This article proposes an energy management strategy based on a novel deep rein-forcement learning framework to reduce the hydrogen consumption of a fuel cell hybrid electric bus while suppressing the degradation of the fuel cell. To begin, a novel proximal policy optimization framework is designed by taking advantage of multi-thread distributed computation, and then a promising energy manage-ment strategy based on this novel framework is proposed. Furthermore, the fuel cell degradation model is established and fuel cell longevity is incorporated into the optimization objective. Finally, the adaptability and computational efficiency of the proposed strategy are verified under the test cycle. Simulation results indicate that the proposed strategy improves the training efficiency effectively, and achieves efficient optimization of hydrogen conservation and fuel cell degradation suppression compared with the strategy based on the proximal policy optimization algorithm. This article contributes to energy conservation and lifespan extension for fuel cell vehicles through deep reinforcement learning methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Energy management optimization of fuel cell hybrid electric vehicle based on deep reinforcement learning
    Wang, Hao-Cong
    Wang, Yue-Yang
    Fu, Zhu-Mu
    Chen, Qi-Hong
    Tao, Fa-Zhan
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (10): : 1831 - 1841
  • [2] Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework
    Huang, Ruchen
    He, Hongwen
    Gao, Miaojue
    APPLIED ENERGY, 2023, 346
  • [3] Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning
    Tang, Xiaolin
    Zhou, Haitao
    Wang, Feng
    Wang, Weida
    Lin, Xianke
    ENERGY, 2022, 238
  • [4] Energy sources durability energy management for fuel cell hybrid electric bus based on deep reinforcement learning considering future terrain information
    Li, Kunang
    Zhou, Jiaming
    Jia, Chunchun
    Yi, Fengyan
    Zhang, Caizhi
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 52 : 821 - 833
  • [5] Reinforcement Learning based Energy Management for Fuel Cell Hybrid Electric Vehicles
    Guo, Liang
    Li, Zhongliang
    Outbib, Rachid
    IECON 2021 - 47TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2021,
  • [6] An Energy Management Strategy for Hybrid Electric Bus Based on Reinforcement Learning
    Fang, Yuedong
    Song, Chunyue
    Xia, Bingwei
    Song, Qiuyin
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 5005 - 5009
  • [7] Energy management of fuel cell hybrid electric bus in mountainous regions: A deep reinforcement learning approach considering terrain characteristics
    Tang, Tianfeng
    Peng, Qianlong
    Shi, Qing
    Peng, Qingguo
    Zhao, Jin
    Chen, Chaoyi
    Wang, Guangwei
    Energy, 2024, 311
  • [8] Energy management for a hybrid electric vehicle based on prioritized deep reinforcement learning framework
    Du, Guodong
    Zou, Yuan
    Zhang, Xudong
    Guo, Lingxiong
    Guo, Ningyuan
    ENERGY, 2022, 241
  • [9] Deep reinforcement learning with deep-Q-network based energy management for fuel cell hybrid electric truck
    Wang, Zhifu
    Zhang, Shunshun
    Luo, Wei
    Xu, Song
    ENERGY, 2024, 306
  • [10] Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning
    Zhou, Jianhao
    Guo, Aijun
    Wang, Jie
    Wang, Chunyan
    Zhao, Wanzhong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 238 (14) : 4659 - 4675