Reinforcement Learning-based Controller for Thermal Management System of Electric Vehicles

被引:4
|
作者
Choi, Wansik [1 ]
Kim, Jae Woong [2 ]
Ahn, Changsun [1 ]
Gim, Juhui [3 ]
机构
[1] Pusan Natl Univ, Sch Mech Engn, Busan, South Korea
[2] Hyundai Motor Co, Total Thermal Management Res Lab, Hwaseong, South Korea
[3] Changwon Natl Univ, Sch Elect Elect & Control Engn, Chang Won, South Korea
基金
新加坡国家研究基金会;
关键词
thermal management system; electric vehicle; air conditioning; reinforcement learning; deep Q-network;
D O I
10.1109/VPPC55846.2022.10003470
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The thermal management system in electric vehicles (EV) becomes significant because the performance of the system is highly correlated with the driving range, reliability, and safety of the electric vehicles. Therefore, a controller of the thermal system should be designed to minimize the tracking error and power consumption while satisfying constraints. In this study, a reinforcement learning (RL)-based controller is proposed. This paper presents the selection of states and design of the reward function of RL for the thermal management system of EV. The controller is trained by the sequential learning method that is based on Deep Q-network (DQN) and adjusted for fast convergence of multi-input problems. The results show better performance compared with the rule-based controller.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Reinforcement learning-based control for the thermal management of the battery and occupant compartments of electric vehicles
    Zhang, Yan
    Huang, Jianglu
    He, Liange
    Zhao, Donggang
    Zhao, Yu
    [J]. SUSTAINABLE ENERGY & FUELS, 2024, 8 (03) : 588 - 603
  • [2] Reinforcement Learning-Based Electric Vehicles Energy Management Strategy with Battery Thermal Model
    黄淦
    曹童杰
    韩俊华
    赵萍
    张光林
    [J]. Journal of Donghua University(English Edition), 2023, 40 (01) : 80 - 87
  • [3] Reinforcement Learning-Based Energy Management System Enhancement Using Digital Twin for Electric Vehicles
    Ye, Yiming
    Xu, Bin
    Zhang, Jiangfeng
    Lawler, Benjamin
    Ayalew, Beshah
    [J]. 2022 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2022,
  • [4] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    [J]. INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [5] Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles
    Li, Weihan
    Cui, Han
    Nemeth, Thomas
    Jansen, Jonathan
    Uenluebayir, Cem
    Wei, Zhongbao
    Zhang, Lei
    Wang, Zhenpo
    Ruan, Jiageng
    Dai, Haifeng
    Wei, Xuezhe
    Sauer, Dirk Uwe
    [J]. JOURNAL OF ENERGY STORAGE, 2021, 36
  • [6] Reinforcement learning-based demand-side management by smart charging of electric vehicles
    Ozcelik, Melik Bugra
    Kesici, Mert
    Aksoy, Necati
    Genc, Istemihan
    [J]. ELECTRICAL ENGINEERING, 2022, 104 (06) : 3933 - 3942
  • [7] Reinforcement learning-based demand-side management by smart charging of electric vehicles
    Melik Bugra Ozcelik
    Mert Kesici
    Necati Aksoy
    Istemihan Genc
    [J]. Electrical Engineering, 2022, 104 : 3933 - 3942
  • [8] Deep Reinforcement Learning-based Building Energy Management using Electric Vehicles for Demand Response
    Kang, Daeyoung
    Yoon, Seunghyun
    Lim, Hyuk
    [J]. 2023 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION, ICAIIC, 2023, : 375 - 377
  • [9] Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Liu, Teng
    Qin, Yechen
    Cao, Dongpu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 9922 - 9934
  • [10] Continuous Reinforcement Learning-Based Energy Management Strategy for Hybrid Electric-Tracked Vehicles
    Han, Ruoyan
    Lian, Renzong
    He, Hongwen
    Han, Xuefeng
    [J]. IEEE JOURNAL OF EMERGING AND SELECTED TOPICS IN POWER ELECTRONICS, 2023, 11 (01) : 19 - 31