A Decentralized Multi-agent Energy Management Strategy Based on a Look-Ahead Reinforcement Learning Approach

被引：6
|
作者：
Khalatbarisoltani A. [1 ]
Kandidayeni M. [2 ,3 ]
Boulon L. [1 ]
Hu X. [4 ,5 ]
机构：
[1] Hydrogen Research Institute, Department of Electrical and Computer Engineering, Université du Québec À Trois-Rivières, G8Z 4M3, QC
[2] Electric-Transport, Energy Storage and Conversion Lab (E-TESC), Université de Sherbrooke
[3] State Key Laboratory for Mechanical Transmission, Department of Automotive Engineering, Chongqing University, Chongqing
[4] Advanced Vehicle Engineering Centre, Cranfield University, Cranfield
来源：
SAE International Journal of Electrified Vehicles | 2021年 / 11卷 / 02期
关键词：
Energy management - Fuel cells - Reinforcement learning - Electric load flow - Powertrains - Energy efficiency;
D O I：
10.4271/14-11-02-0012
中图分类号：
学科分类号：
摘要：
An energy management strategy (EMS) has an essential role in ameliorating the efficiency and lifetime of the powertrain components in a hybrid fuel cell vehicle (HFCV). The EMS of intelligent HFCVs is equipped with advanced data-driven techniques to efficiently distribute the power flow among the power sources, which have heterogeneous energetic characteristics. Decentralized EMSs provide higher modularity (plug and play) and reliability compared to the centralized data-driven strategies. Modularity is the specification that promotes the discovery of new components in a powertrain system without the need for reconfiguration. Hence, this article puts forward a decentralized reinforcement learning (Dec-RL) framework for designing an EMS in a heavy-duty HFCV. The studied powertrain is composed of two parallel fuel cell systems (FCSs) and a battery pack. The contribution of the suggested multi-agent approach lies in the development of a fully decentralized learning strategy composed of several connected local modules. The performance of the proposed approach is investigated through several simulations and experimental tests. The results indicate the advantage of the established Dec-RL control scheme in convergence speed and optimization criteria. © 2021 SAE International Journal of Electrified Vehicles.
引用
收藏
相关论文
共 50 条
  • [31] Multi-agent Reinforcement Learning for Decentralized Coalition Formation Games
    Taywade, Kshitija
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 15738 - 15739
  • [32] Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning
    El Mhamdi, El Mandi
    Guerraoui, Rachid
    Hendrikx, Hadrien
    Maurer, Alexandre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [33] Decentralized Anomaly Detection in Cooperative Multi-Agent Reinforcement Learning
    Kazari, Kiarash
    Shereen, Ezzeldin
    Dan, Gyorgy
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 162 - 170
  • [34] Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents
    Zhang, Kaiqing
    Yang, Zhuoran
    Liu, Han
    Zhang, Tong
    Basar, Tamer
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [35] A Multi-Agent Deep Reinforcement Learning Approach for Practical Decentralized UAV Collision Avoidance
    Thumiger, Nicholas
    Deghat, Mohammad
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 2174 - 2179
  • [36] Multi-agent Reinforcement Learning in Network Management
    Bagnasco, Ricardo
    Serrat, Joan
    SCALABILITY OF NETWORKS AND SERVICES, PROCEEDINGS, 2009, 5637 : 199 - 202
  • [37] A modular approach to multi-agent reinforcement learning
    Ono, N
    Fukumoto, K
    DISTRIBUTED ARTIFICIAL INTELLIGENCE MEETS MACHINE LEARNING: LEARNING IN MULTI-AGENT ENVIRONMENTS, 1997, 1221 : 25 - 39
  • [38] Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling
    Fang, Xiaohan
    Wang, Jinkuan
    Song, Guanru
    Han, Yinghua
    Zhao, Qiang
    Cao, Zhiao
    ENERGIES, 2020, 13 (01)
  • [39] An energy management strategy of deep reinforcement learning based on multi-agent architecture under self-generating conditions
    Chang, Chengcheng
    Zhao, Wanzhong
    Wang, Chunyan
    Luan, Zhongkai
    ENERGY, 2023, 283
  • [40] Look-Ahead Unit Commitment With Adaptive Horizon Based on Deep Reinforcement Learning
    Yan, Jiahao
    Li, Yaping
    Yao, Jianguo
    Yang, Shengchun
    Li, Feng
    Zhu, Kedong
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 3673 - 3684
12345