A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:10
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [1] Reinforcement Learning Energy Management Strategy of Tram Based on Condition Identification
    Mo H.
    Yang Z.
    Lin F.
    Wang Y.
    An X.
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2021, 36 (19): : 4170 - 4182
  • [2] Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management
    Liu, Yuankun
    Zhang, Dongxia
    Gooi, Hoay Beng
    [J]. CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (03): : 572 - 582
  • [3] RESEARCH ON HEV ENERGY MANAGEMENT STRATEGY BASED ON IMPROVED DEEP REINFORCEMENT LEARNING
    Wu, Zhongqiang
    Ma, Boyan
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (12) : 8451 - 8468
  • [4] Hierarchical Optimization Strategy for Home Energy Management Based on Deep Reinforcement Learning
    Zhang, Tian
    Zhao, Qi
    Chen, Zhong
    Wang, Ruisheng
    Xing, Qiang
    Tian, Jiang
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2021, 45 (21): : 149 - 158
  • [5] Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
    Hu, Yue
    Li, Weimin
    Xu, Kun
    Zahid, Taimoor
    Qin, Feiyan
    Li, Chenming
    [J]. APPLIED SCIENCES-BASEL, 2018, 8 (02):
  • [6] Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle
    Lian, Renzong
    Peng, Jiankun
    Wu, Yuankai
    Tan, Huachun
    Zhang, Hailong
    [J]. ENERGY, 2020, 197
  • [7] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
    Lee, Seongwoo
    Seon, Joonho
    Sun, Young Ghyu
    Kim, Soo Hyun
    Kyeong, Chanuk
    Kim, Dong In
    Kim, Jin Young
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
  • [8] Deep reinforcement learning-based energy management strategy for hybrid electric vehicles
    Zhang, Shiyi
    Chen, Jiaxin
    Tang, Bangbei
    Tang, Xiaolin
    [J]. INTERNATIONAL JOURNAL OF VEHICLE PERFORMANCE, 2022, 8 (01) : 31 - 45
  • [9] Energy Management Strategy for Hybrid Electric Vehicle Based on the Deep Reinforcement Learning Method
    Chen Z.
    Fang Z.
    Yang R.
    Yu Q.
    Kang M.
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2022, 37 (23): : 6157 - 6168
  • [10] Research on Energy Management Strategy of a Hybrid Commercial Vehicle Based on Deep Reinforcement Learning
    Xi, Jianguo
    Ma, Jingwei
    Wang, Tianyou
    Gao, Jianping
    [J]. WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (10):