Energy Management Strategy based on Reinforcement Learning for Fuel Cell Hybrid Vehicle with A New Reward Function Approach

被引:0
|
作者
Baumler, Antoine [1 ]
Benterki, Abdelmoudjib [1 ]
机构
[1] ESTACA Lab Paris Saclay, ESTACA, F-78180 Montigny Le Bretonneux, France
关键词
Energy Management Strategy; Reinforcement; Learning; Soft Actor Critic; Reward function; OPTIMIZATION; DESIGN; SYSTEM;
D O I
10.1109/VPPC60535.2023.10403148
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Fuel cell hybrid vehicle have attracted more attention in recent years to tackle the current encountered environmental issues. Those vehicles raise implementation challenges such as the energy management strategy (EMS) to improve and optimize the energy consumption. This paper takes the learning approach with the reinforcement learning (RL) technique, which requires a proper reward function design to achieve the suited agent behavior in terms of optimization. Studies in this area propose a reward function that penalizes the consumption and uses the charge sustaining method, based on a reference state of charge (SOC). The main contribution and the originality of our research work is to introduce SOC limits to penalize the agent when it reaches the limits, instead of penalizing deviations from a given reference SOC, which constitutes a relevant degree of freedom for the EMS. The proposed approach is trained under a real drive cycle and the results are validated with the WLTP cycle.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle
    Zhang, Yuxiang
    Ma, Rui
    Zhao, Dongdong
    Huangfu, Yigeng
    Liu, Weiguo
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (02) : 1537 - 1547
  • [2] Deep reinforcement learning based energy management strategy for range extend fuel cell hybrid electric vehicle
    Huang, Yin
    Hu, Haoqin
    Tan, Jiaqi
    Lu, Chenlei
    Xuan, Dongji
    ENERGY CONVERSION AND MANAGEMENT, 2023, 277
  • [3] Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning
    Tang, Xiaolin
    Zhou, Haitao
    Wang, Feng
    Wang, Weida
    Lin, Xianke
    ENERGY, 2022, 238
  • [4] Energy management optimization of fuel cell hybrid electric vehicle based on deep reinforcement learning
    Wang, Hao-Cong
    Wang, Yue-Yang
    Fu, Zhu-Mu
    Chen, Qi-Hong
    Tao, Fa-Zhan
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (10): : 1831 - 1841
  • [5] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [6] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [7] Energy Management Strategy Based on Reinforcement Learning and Frequency Decoupling for Fuel Cell Hybrid Powertrain
    Li, Hongzhe
    Kang, Jinsong
    Li, Cheng
    ENERGIES, 2024, 17 (08)
  • [8] Energy management strategy for hybrid fuel cell vehicle
    da Fonseca, Ramon
    Bideaux, Eric
    Jeanneret, Bruno
    Gerard, Mathias
    Desbois-Renaudin, Matthieu
    Sari, Ali
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2012, : 485 - 490
  • [9] Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
    Hu, Yue
    Li, Weimin
    Xu, Kun
    Zahid, Taimoor
    Qin, Feiyan
    Li, Chenming
    APPLIED SCIENCES-BASEL, 2018, 8 (02):
  • [10] Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle
    Qi, Chunyang
    Zhu, Yiwen
    Song, Chuanxue
    Yan, Guangfu
    Wang, Da
    Xiao, Feng
    Zhang, Xu
    Cao, Jingwei
    Song, Shixin
    ENERGY, 2022, 238