A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:10
|
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
下载
收藏
页码:1674 / 1688
页数:15
相关论文
共 50 条
  • [21] An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning
    Han, Baohui
    Hu, Mingjie
    Lv, Shilin
    Bao, Zhejing
    Lu, Lingxia
    Yu, Miao
    2023 6TH INTERNATIONAL CONFERENCE ON RENEWABLE ENERGY AND POWER ENGINEERING, REPE 2023, 2023, : 407 - 412
  • [22] Deep reinforcement learning-based energy management strategy for fuel cell buses integrating future road information and cabin comfort control
    Jia, Chunchun
    Liu, Wei
    He, Hongwen
    Chau, K. T.
    ENERGY CONVERSION AND MANAGEMENT, 2024, 321
  • [23] Energy Management System for Microgrids based on Deep Reinforcement Learning
    Garrido, Cesar
    Marin, Luis G.
    Jimenez-Estevez, Guillermo
    Lozano, Fernando
    Higuera, Carolina
    2021 IEEE CHILEAN CONFERENCE ON ELECTRICAL, ELECTRONICS ENGINEERING, INFORMATION AND COMMUNICATION TECHNOLOGIES (IEEE CHILECON 2021), 2021, : 609 - 615
  • [24] Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning
    Zhou, Jianhao
    Guo, Aijun
    Wang, Jie
    Wang, Chunyan
    Zhao, Wanzhong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 238 (14) : 4659 - 4675
  • [25] Energy Storage Scheduling Optimization Strategy Based on Deep Reinforcement Learning
    Hou, Shixi
    Han, Jienan
    Liu, Xiangjiang
    Guo, Ruoshan
    Chu, Yundi
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 33 - 44
  • [26] Energy Saving Strategy of UAV in MEC Based on Deep Reinforcement Learning
    Dai, Zhiqiang
    Xu, Gaochao
    Liu, Ziqi
    Ge, Jiaqi
    Wang, Wei
    FUTURE INTERNET, 2022, 14 (08):
  • [27] A novel forecasting based scheduling method for household energy management system based on deep reinforcement learning
    Ren, Mifeng
    Liu, Xiangfei
    Yang, Zhile
    Zhang, Jianhua
    Guo, Yuanjun
    Jia, Yanbing
    SUSTAINABLE CITIES AND SOCIETY, 2022, 76
  • [28] Deep Reinforcement Learning Based Energy Management Strategy for Fuel Cell and Battery Powered Rail Vehicles
    Deng, Kai
    Hai, Di
    Peng, Hujun
    Loewenstein, Lars
    Hameyer, Kay
    2021 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2021,
  • [29] Deep Reinforcement Learning based Energy Management Strategy for Commercial Buildings Considering Comprehensive Comfort Levels
    Liang, Zheming
    Bian, Desong
    Xu, Chunlei
    Zhang, Xiaohu
    Shi, Di
    Wang, Zhiwei
    2020 52ND NORTH AMERICAN POWER SYMPOSIUM (NAPS), 2021,
  • [30] Deep reinforcement learning based energy storage management strategy considering prediction intervals of wind power
    Liu, Fang
    Liu, Qianyi
    Tao, Qing
    Huang, Yucong
    Li, Danyun
    Sidorov, Denis
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 145