A Decentralized Multi-agent Energy Management Strategy Based on a Look-Ahead Reinforcement Learning Approach

被引：6
|
作者：
Khalatbarisoltani A. [1 ]
Kandidayeni M. [2 ,3 ]
Boulon L. [1 ]
Hu X. [4 ,5 ]
机构：
[1] Hydrogen Research Institute, Department of Electrical and Computer Engineering, Université du Québec À Trois-Rivières, G8Z 4M3, QC
[2] Electric-Transport, Energy Storage and Conversion Lab (E-TESC), Université de Sherbrooke
[3] State Key Laboratory for Mechanical Transmission, Department of Automotive Engineering, Chongqing University, Chongqing
[4] Advanced Vehicle Engineering Centre, Cranfield University, Cranfield
来源：
SAE International Journal of Electrified Vehicles | 2021年 / 11卷 / 02期
关键词：
Energy management - Fuel cells - Reinforcement learning - Electric load flow - Powertrains - Energy efficiency;
D O I：
10.4271/14-11-02-0012
中图分类号：
学科分类号：
摘要：
An energy management strategy (EMS) has an essential role in ameliorating the efficiency and lifetime of the powertrain components in a hybrid fuel cell vehicle (HFCV). The EMS of intelligent HFCVs is equipped with advanced data-driven techniques to efficiently distribute the power flow among the power sources, which have heterogeneous energetic characteristics. Decentralized EMSs provide higher modularity (plug and play) and reliability compared to the centralized data-driven strategies. Modularity is the specification that promotes the discovery of new components in a powertrain system without the need for reconfiguration. Hence, this article puts forward a decentralized reinforcement learning (Dec-RL) framework for designing an EMS in a heavy-duty HFCV. The studied powertrain is composed of two parallel fuel cell systems (FCSs) and a battery pack. The contribution of the suggested multi-agent approach lies in the development of a fully decentralized learning strategy composed of several connected local modules. The performance of the proposed approach is investigated through several simulations and experimental tests. The results indicate the advantage of the established Dec-RL control scheme in convergence speed and optimization criteria. © 2021 SAE International Journal of Electrified Vehicles.
引用
收藏
相关论文
共 50 条
  • [41] Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids
    Kofinas, P.
    Dounis, A., I
    Vouros, G. A.
    APPLIED ENERGY, 2018, 219 : 53 - 67
  • [42] Look-Ahead Reinforcement Learning for Load Balancing Network Traffic
    Possebon, Isadora P.
    da Silva, Bruno Castro
    Schaeffer-Filho, Alberto E.
    2022 27TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2022), 2022,
  • [43] Decentralized graph-based multi-agent reinforcement learning using reward machines
    Hu, Jueming
    Xu, Zhe
    Wang, Weichang
    Qu, Guannan
    Pang, Yutian
    Liu, Yongming
    NEUROCOMPUTING, 2024, 564
  • [44] Decentralized reinforcement social learning based on cooperative policy exploration in multi-agent systems
    Wang, Chi
    Chen, Xin
    2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 1575 - 1580
  • [45] Learning Decentralized Traffic Signal Controllers With Multi-Agent Graph Reinforcement Learning
    Zhang, Yao
    Yu, Zhiwen
    Zhang, Jun
    Wang, Liang
    Luan, Tom H.
    Guo, Bin
    Yuen, Chau
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (06) : 7180 - 7195
  • [46] Scalable energy management approach of residential hybrid energy system using multi-agent deep reinforcement learning
    Wang, Zixuan
    Xiao, Fu
    Ran, Yi
    Li, Yanxue
    Xu, Yang
    APPLIED ENERGY, 2024, 367
  • [47] Energy management based on safe multi-agent reinforcement learning for smart buildings in distribution networks
    Sun, Yiyun
    Zhang, Senlin
    Liu, Meiqin
    Zheng, Ronghao
    Dong, Shanling
    ENERGY AND BUILDINGS, 2024, 318
  • [48] A multi-agent deep reinforcement learning based energy management for behind-the-meter resources
    Wilk P.
    Wang N.
    Li J.
    Electricity Journal, 2022, 35 (05):
  • [49] Energy-Efficient Collaborative Inference in MEC: A Multi-Agent Reinforcement Learning Based Approach
    Xiao, Yilin
    Wan, Kunpeng
    Xiao, Liang
    Yang, Helin
    2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS, BIGCOM, 2022, : 407 - 412
  • [50] Decentralized multi-agent reinforcement learning with networked agents: recent advances
    Zhang, Kaiqing
    Yang, Zhuoran
    Basar, Tamer
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (06) : 802 - 814
12345