Real-Time Optimal Energy Management of Electrified Powertrains with Reinforcement Learning

被引:15
|
作者
Biswas, Atriya [1 ]
Anselma, Pier G. [2 ]
Emadi, Ali [1 ]
机构
[1] McMaster Univ, MARC, Hamilton, ON, Canada
[2] Politecn Torino, Dept Mech & Aerosp Engn DIMEAS, Turin, Italy
关键词
Automotive systems; electric and hybrid electric vehicles; electrified powertrains; energy management system; premeditated EMS; Q-learning; real-world driving scenario; real-time; reinforcement learning;
D O I
10.1109/itec.2019.8790482
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reinforcement learning (RL) algorithm is employed in solving energy management problem for electrified powertrain in real-world driving scenarios and the application process is streamlined. A near-global optimal control policy is articulated for the energy management system (EMS) using Q-learning algorithm which is real-time implementable. The core of the EMS is an updating optimal control policy in the form of a changing look-up table comprising near-global optimal action value function (Q-values) corresponding to all feasible state-action combinations. Using the updating control policy, the EMS can optimally decide power-split between electric machines (EMs) and internal combustion engine (ICE) in real-world driving situations.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Real-Time Optimal Energy Management of Electrified Engines
    Zhao, Dezong
    Winward, Edward
    Yang, Zhijia
    Stobart, Richard
    Steffen, Thomas
    [J]. IFAC PAPERSONLINE, 2016, 49 (11): : 251 - 258
  • [2] Real-Time Multiobjective Energy Management for Electrified Powertrains: A Convex Optimization-Driven Predictive Approach
    Li, Yapeng
    Wang, Feng
    Tang, Xiaolin
    Lin, Xianke
    Liu, Changpeng
    Hu, Xiaosong
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (03) : 3139 - 3150
  • [3] Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning
    Guo, Chenyu
    Wang, Xin
    Zheng, Yihui
    Zhang, Feng
    [J]. ENERGY, 2022, 238
  • [4] Real-time Energy Management of Microgrid Using Reinforcement Learning
    Bi, Wenzheng
    Shu, Yuankai
    Dong, Wei
    Yang, Qiang
    [J]. 2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 38 - 41
  • [5] Applying Reinforcement Learning Method for Real-time Energy Management
    Dayani, Aida Borhan
    Fazlollahtabar, Hamed
    Ahmadiahangar, Roya
    Rosin, Argo
    Naderi, Mohammad Salay
    Bagheri, Mehdi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2019 IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2019,
  • [6] Real-time Autonomous Optimal Energy Management Strategy for Residents Based on Deep Reinforcement Learning
    Ye, Yujian
    Wang, Huiyu
    Tang, Yi
    Strbac, Goran
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (01): : 110 - 119
  • [7] Real-Time Energy Management Control for Hybrid Electric Powertrains
    Zaher, Mohamed
    Cetinkunt, Sabri
    [J]. JOURNAL OF CONTROL SCIENCE AND ENGINEERING, 2013, 2013
  • [8] Towards Real-Time Optimal Energy Management of HEV Powertrains Using Stochastic Dynamic Programming
    Leroy, Thomas
    Malaize, Jeremy
    Corde, Gilles
    [J]. 2012 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2012, : 383 - 388
  • [9] Optimal Control of an Integrated Energy and Thermal Management System for Electrified Powertrains
    Wei, Caiyang
    Hofman, Theo
    Caarls, Esin Ilhan
    van Iperen, Rokus
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 322 - 327
  • [10] A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution
    Ganesh, Akhil Hannegudda
    Xu, Bin
    [J]. RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2022, 154