Distributed deep reinforcement learning for optimal voltage control of PEMFC

被引:10
|
作者
Li, Jiawen [1 ]
Yu, Tao [1 ]
机构
[1] South China Univ Technol, Coll Elect Power, Guangzhou 510640, Peoples R China
关键词
D O I
10.1049/rpg2.12202
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Proton exchange membrane fuel cells (PEMFCs) are promising components in the renewable energy field due to their high energy efficiency and low pollution output. However, these cells are also characterized by considerable nonlinearity, which in turn adversely affects the PEMFC output voltage. Conventional control algorithms cannot guarantee sufficient output voltage control, as they lack the robust adaptive ability required for adapting to these fluctuations in PEMFCs. In this paper, an optimal output voltage controller based on distributed deep reinforcement learning, which controls the output voltage by regulating the fuel input of the PEMFC, is proposed. In addition, an ensemble intelligence exploration multi-delay deep deterministic policy gradient (EIM-DDPG) algorithm is proposed for this controller. An ensemble intelligence exploration policy plus a classification experience replay mechanism are included within the EIM-DDPG algorithm to improve the exploration ability of the algorithm and thus increase the robustness and adaptive capability of the controller. As a result, the model-free optimal output voltage controller offers high robustness and adaptability. The simulation results in this paper demonstrate that the proposed optimal controller can realize the effective control of PEMFC output voltage.
引用
收藏
页码:2778 / 2798
页数:21
相关论文
共 50 条
  • [1] Distributed Imitation-Orientated Deep Reinforcement Learning Method for Optimal PEMFC Output Voltage Control
    Li, Jiawen
    Li, Yaping
    Yu, Tao
    [J]. FRONTIERS IN ENERGY RESEARCH, 2021, 9
  • [2] Voltage Optimal Control of Distribution Network Based on Deep Reinforcement Learning
    Quan, Huan
    Peng, Xiangang
    Liu, Hanyu
    Zhou, Peng
    Wu, Zelin
    Su, Haokun
    [J]. Dianwang Jishu/Power System Technology, 2023, 47 (05): : 2029 - 2038
  • [3] Optimal control with deep reinforcement learning for shunt compensations to enhance voltage stability
    Cao, Shang
    Liao, Shiwu
    Wang, Shaorong
    Luo, Xiaotong
    [J]. 2020 5TH ASIA CONFERENCE ON POWER AND ELECTRICAL ENGINEERING (ACPEE 2020), 2020, : 398 - 403
  • [4] Research on Optimal Control Strategy of Distributed Photovoltaic Based on Deep Reinforcement Learning
    Dai, Zhiqiang
    Xu, Yunuo
    Hu, Wei
    Wang, Haitao
    Lin, Kai
    Li, Binghui
    Guo, Qiuting
    Pei, Xun
    [J]. 2023 2ND ASIAN CONFERENCE ON FRONTIERS OF POWER AND ENERGY, ACFPE, 2023, : 458 - 462
  • [5] Distributed deep reinforcement learning for simulation control
    Pawar, Suraj
    Maulik, Romit
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (02):
  • [6] Efficient Distributed Energy Resource Voltage Control Using Ensemble Deep Reinforcement Learning
    Obert, James
    Trevizan, Rodrigo D.
    Chavez, Adrian
    [J]. INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2023, 17 (02) : 293 - 308
  • [7] Optimal Distributed Coordinated Reinforcement Learning for Secondary Voltage Control in Time-Delayed Microgrid
    Zhao, Chanjuan
    Wang, Chao
    Cheng, Zhiyou
    Sun, Wei
    Zhao, Bao
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (03): : 3480 - 3491
  • [8] Intelligent Controller Based on Distributed Deep Reinforcement Learning for PEMFC Air Supply System
    Li, Jiawen
    Yu, Tao
    [J]. IEEE ACCESS, 2021, 9 : 7496 - 7507
  • [9] Active voltage control method of distributed photovoltaic based on value decomposition deep reinforcement learning
    Liu, Shuo
    Guo, Chuangxin
    Feng, Bin
    Zhang, Yong
    Wang, Yibo
    [J]. Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2023, 43 (10): : 152 - 159
  • [10] Deep Reinforcement Learning for Electric Transmission Voltage Control
    Thayer, Brandon L.
    Overbye, Thomas J.
    [J]. 2020 IEEE ELECTRIC POWER AND ENERGY CONFERENCE (EPEC), 2020,