A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:10
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [31] Cloud Computing-based Parallel Deep Reinforcement Learning Energy Management Strategy for Connected PHEVs
    Sun, Tong
    Ma, Chao
    Li, Zechun
    Yang, Kun
    ENGINEERING LETTERS, 2024, 32 (06) : 1210 - 1220
  • [32] Real-time Autonomous Optimal Energy Management Strategy for Residents Based on Deep Reinforcement Learning
    Ye, Yujian
    Wang, Huiyu
    Tang, Yi
    Strbac, Goran
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2022, 46 (01): : 110 - 119
  • [33] A Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicles in Connected Traffic Environment
    Li, Jie
    Wu, Xiaodong
    Hu, Sunan
    Fan, Jiawei
    IFAC PAPERSONLINE, 2021, 54 (10): : 150 - 156
  • [34] An efficient intelligent energy management strategy based on deep reinforcement learning for hybrid electric flying car
    Yang, Chao
    Lu, Zhexi
    Wang, Weida
    Wang, Muyao
    Zhao, Jing
    ENERGY, 2023, 280
  • [35] Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Liu, Teng
    Qin, Yechen
    Cao, Dongpu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 9922 - 9934
  • [36] An Energy Management Strategy for Hybrid Energy Storage System Based on Reinforcement Learning
    Wang, Yujie
    Li, Wenhuan
    Liu, Zeyan
    Li, Ling
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (03):
  • [37] Energy management strategy of a novel parallel electric-hydraulic hybrid electric vehicle based on deep reinforcement learning and entropy evaluation
    Zhang, Zhen
    Zhang, Tiezhu
    Hong, Jichao
    Zhang, Hongxin
    Yang, Jian
    JOURNAL OF CLEANER PRODUCTION, 2023, 403
  • [38] Deep Reinforcement Learning Based PHEV Energy Management With Co-Recognition for Traffic Condition and Driving Style
    Cui, Naxin
    Cui, Wei
    Shi, Yuemei
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (04): : 3026 - 3039
  • [39] Deep-Reinforcement-Learning-Based Energy Management Strategy for Supercapacitor Energy Storage Systems in Urban Rail Transit
    Yang, Zhongping
    Zhu, Feiqin
    Lin, Fei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (02) : 1150 - 1160
  • [40] Residential Energy Management with Deep Reinforcement Learning
    Wan, Zhiqiang
    Li, Hepeng
    He, Haibo
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,