Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

被引:11
|
作者
Huang, Gan [1 ,2 ]
Zhao, Ping [1 ,2 ]
Zhang, Guanglin [1 ,2 ]
机构
[1] Donghua Univ, Coll Informat Sci & Technol, Minist Educ, Shanghai 201620, Peoples R China
[2] Donghua Univ, Engn Res Ctr Digitized Text & Apparel Technol, Minist Educ, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Battery thermal management; deep reinforcement learning (DRL); electric vehicles (EVs); ENERGY MANAGEMENT; STRATEGY; OPTIMIZATION; SYSTEM;
D O I
10.1109/JIOT.2022.3145849
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid developments of electric vehicles (EVs) in recent years, it is desirable to improve the energy efficiency to prolong the limited life of battery and extend the cruising range of EVs. In real EVs, the battery thermal management system is installed to cool the battery and maintain the expected high power output. In this article, we propose a novel energy management strategy based on deep reinforcement learning (DRL) considering battery thermal effects on energy efficiency. The main idea is to formulate energy management as an optimization problem, further extract the state sequence features of the vehicle via gated recurrent unit (GRU), and finally, propose a double deep Q network (double DQN)-based algorithm to obtain the optimal strategy. Comparisons of our double DQN algorithm and existent fuzzy control, as well as two other conventional reinforcement learning (RL) algorithms, are conducted under New European Driving Cycle, FTP-75, HWFET, and US06 cycles, and the results demonstrate that the proposed algorithm achieves an energy reduction of more than 6.7% during aggressive driving.
引用
收藏
页码:14060 / 14072
页数:13
相关论文
共 50 条
  • [1] Real-Time Battery Thermal Management for Electric Vehicles
    Kim, Eugene
    Shin, Kang G.
    Lee, Jinkyu
    [J]. 2014 ACM/IEEE INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (ICCPS), 2014, : 72 - 83
  • [2] Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning
    Han, Lijin
    Yang, Ke
    Ma, Tian
    Yang, Ningkang
    Liu, Hui
    Guo, Lingxiong
    [J]. ENERGY, 2022, 259
  • [3] Deep Reinforcement Learning Energy Management System for Multiple Battery Based Electric Vehicles
    Chaoui, Hicham
    Gualous, Hamid
    Boulon, Loic
    Kelouwani, Sousso
    [J]. 2018 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2018,
  • [4] Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning
    Unagar, Ajaykumar
    Tian, Yuan
    Chao, Manuel Arias
    Fink, Olga
    [J]. ENERGIES, 2021, 14 (05)
  • [5] Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles
    Li, Weihan
    Cui, Han
    Nemeth, Thomas
    Jansen, Jonathan
    Uenluebayir, Cem
    Wei, Zhongbao
    Zhang, Lei
    Wang, Zhenpo
    Ruan, Jiageng
    Dai, Haifeng
    Wei, Xuezhe
    Sauer, Dirk Uwe
    [J]. JOURNAL OF ENERGY STORAGE, 2021, 36
  • [6] Reinforcement learning-based control for the thermal management of the battery and occupant compartments of electric vehicles
    Zhang, Yan
    Huang, Jianglu
    He, Liange
    Zhao, Donggang
    Zhao, Yu
    [J]. SUSTAINABLE ENERGY & FUELS, 2024, 8 (03) : 588 - 603
  • [7] Reinforcement Learning-Based Electric Vehicles Energy Management Strategy with Battery Thermal Model
    黄淦
    曹童杰
    韩俊华
    赵萍
    张光林
    [J]. Journal of Donghua University(English Edition), 2023, 40 (01) : 80 - 87
  • [8] Implementation of real-time energy management strategy based on reinforcement learning for hybrid electric vehicles and simulation validation
    Kong, Zehui
    Zou, Yuan
    Liu, Teng
    [J]. PLOS ONE, 2017, 12 (07):
  • [9] Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems based on Deep Reinforcement Learning
    Yuan, Ran
    Wang, Bo
    Sun, Yeqi
    [J]. 2021 INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SOCIAL INTELLIGENCE (ICCSI), 2021,
  • [10] Deep Reinforcement Learning-Based Real-Time Joint Optimal Power Split for Battery-Ultracapacitor-Fuel Cell Hybrid Electric Vehicles
    Kim, Daniel
    Hong, Seokjoon
    Cui, Shengmin
    Joe, Inwhee
    [J]. ELECTRONICS, 2022, 11 (12)