A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:10
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [41] An Energy Management Strategy for Hybrid Electric Bus Based on Reinforcement Learning
    Fang, Yuedong
    Song, Chunyue
    Xia, Bingwei
    Song, Qiuyin
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 5005 - 5009
  • [42] An Energy Management Strategy for Traction Substation with ESS Based on Reinforcement Learning
    Luo, Jiaming
    Wei, Xiaoguang
    Gao, Shibin
    Guo, Xiaoran
    Zhong, Tianbao
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION TECHNOLOGIES FOR RAIL TRANSPORTATION, EITRT 2023: ENERGY TRACTION TECHNOLOGY OF RAIL TRANSPORTATION, 2024, 1135 : 11 - 19
  • [43] A Novel Adaptive Sampling Strategy for Deep Reinforcement Learning
    Liang, Xingxing
    Chen, Li
    Feng, Yanghe
    Liu, Zhong
    Ma, Yang
    Huang, Kuihua
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2021, 20 (02)
  • [44] Online Microgrid Energy Management Based on Safe Deep Reinforcement Learning
    Li, Hepeng
    Wang, Zhenhua
    Li, Lusi
    He, Haibo
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [45] Deep reinforcement learning based energy management for a hybrid electric vehicle
    Du, Guodong
    Zou, Yuan
    Zhang, Xudong
    Liu, Teng
    Wu, Jinlong
    He, Dingbo
    ENERGY, 2020, 201 (201)
  • [46] A Deep Reinforcement Learning Based Approach for Home Energy Management System
    Li, Hepeng
    Wan, Zhiqiang
    He, Haibo
    2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,
  • [47] Energy management strategy for fuel cell electric vehicles based on scalable reinforcement learning in novel environment
    Wang, Da
    Mei, Lei
    Xiao, Feng
    Song, Chuanxue
    Qi, Chunyang
    Song, Shixin
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 59 : 668 - 678
  • [48] Deep Reinforcement Learning Based Pricing Strategy of Aggregators Considering Renewable Energy
    Chuang, Yu-Chieh
    Chiu, Wei-Yu
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03): : 499 - 508
  • [49] Control Strategy of Microgrid Energy Storage System Based on Deep Reinforcement Learning
    Liang H.
    Li H.
    Zhang H.
    Hu Z.
    Qin Z.
    Cao J.
    Dianwang Jishu/Power System Technology, 2021, 45 (10): : 3869 - 3876
  • [50] CONFLICT RESOLUTION STRATEGY BASED ON DEEP REINFORCEMENT LEARNING FOR AIR TRAFFIC MANAGEMENT
    Sui, Dong
    Ma, Chenyu
    Dong, Jintao
    AVIATION, 2023, 27 (03) : 177 - 186