A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid

被引:5
|
作者
Liu, Yulin [1 ]
Qie, Tianhao [1 ]
Yu, Yang [4 ]
Wang, Yuxuan [1 ]
Chau, Tat Kei [1 ]
Zhang, Xinan [1 ]
Manandhar, Ujjal [2 ]
Li, Sinan [3 ]
Iu, Herbert H. C. [1 ]
Fernando, Tyrone [1 ]
机构
[1] Univ Western Australia, Sch Engn, Crawley, WA 6009, Australia
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Univ Sydney, Sch Elect & Informat Engn, Sydney 2006, Australia
[4] Halliburton Ltd, Ctr Excellence Adv Control, Singapore 639940, Singapore
关键词
Solid oxide fuel cell; DC microgrid; integral reinforcement learning; hardware-in-the-loop; twin delayed deep deterministic policy gradient; POWER-PLANT; H-INFINITY; MODEL;
D O I
10.1109/TSTE.2022.3224179
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper proposes a new online integral reinforcement learning (IRL)-based control algorithm for the solid oxide fuel cell (SOFC) to overcome the long-lasting problems of model dependency and sensitivity to offline training dataset in the existing SOFC control approaches. The proposed method automatically updates the optimal control gains through the online neural network training. Unlike the other online learning-based control methods that rely on the assumption of initial stabilizing control or trial-and-error based initial control policy search, the proposed method employs the offline twin delayed deep deterministic policy gradient (TD3) algorithm to systematically determine the initial stabilizing control policy. Compared to the conventional IRL-based control, the proposed method contributes to greatly reduce the computational burden without compromising the control performance. The excellent performance of the proposed method is verified by hardware-in-the-loop experiments.
引用
收藏
页码:688 / 703
页数:16
相关论文
共 50 条
  • [31] A novel data-driven controller for solid oxide fuel cell via deep reinforcement learning
    Li, Jiawen
    Yu, Tao
    JOURNAL OF CLEANER PRODUCTION, 2021, 321
  • [32] A Self-Adaptive Vibration Reduction Method Based on Deep Deterministic Policy Gradient (DDPG) Reinforcement Learning Algorithm
    Jin, Xin
    Ma, Hongbao
    Kang, Yihua
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [33] Energy management with adaptive moving average filter and deep deterministic policy gradient reinforcement learning for fuel cell hybrid electric vehicles
    Zhao, Yinghua
    Huang, Siqi
    Wang, Xiaoyu
    Shi, Jingwu
    Yao, Shouwen
    Energy, 2024, 312
  • [34] Deep Deterministic Policy Gradient Algorithm Based Reinforcement Learning Controller for Single-Inductor Multiple-Output DC-DC Converter
    Ye, Jian
    Guo, Huanyu
    Wang, Benfei
    Zhang, Xinan
    IEEE TRANSACTIONS ON POWER ELECTRONICS, 2024, 39 (04) : 4078 - 4090
  • [35] Twin delayed deep deterministic policy gradient based energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles considering predicted terrain information
    Tao, Fazhan
    Fu, Zhigao
    Gong, Huixian
    Ji, Baofeng
    Zhou, Yao
    ENERGY, 2023, 283
  • [36] Optimal control strategy for solid oxide fuel cell-based hybrid energy system using deep reinforcement learning
    Chen, Tao
    Gao, Ciwei
    Song, Yutong
    IET RENEWABLE POWER GENERATION, 2022, 16 (05) : 912 - 921
  • [37] A Policy optimization-based Deep Reinforcement Learning method for data-driven output voltage control of grid connected solid oxide fuel cell considering operation constraints
    Zeng, Shunqi
    Huang, Chunyan
    Wang, Fei
    Li, Xin
    Chen, Minghui
    ENERGY REPORTS, 2023, 10 : 1161 - 1168
  • [38] Deep Deterministic Policy Gradient Reinforcement Learning Based Adaptive PID Load Frequency Control of an AC Micro-Grid
    Sabahi, Kamran
    Jamil, Mohsin
    Shokri-Kalandaragh, Yaser
    Tavan, Mehdi
    Arya, Yogendra
    IEEE CANADIAN JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2024, 47 (01): : 15 - 21
  • [39] Twin Delayed Deep Deterministic Policy Gradient (TD3) Based Virtual Inertia Control for Inverter-Interfacing DGs in Microgrids
    Egbomwan, Osarodion Emmanuel
    Liu, Shichao
    Chaoui, Hicham
    IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2122 - 2132
  • [40] Autonomous Input Voltage Sharing Control and Triple Phase Shift Modulation Method for ISOP-DAB Converter in DC Microgrid: A Multiagent Deep Reinforcement Learning-Based Method
    Zeng, Yu
    Pou, Josep
    Sun, Changjiang
    Mukherjee, Suvajit
    Xu, Xu
    Gupta, Amit Kumar
    Dong, Jiaxin
    IEEE TRANSACTIONS ON POWER ELECTRONICS, 2023, 38 (03) : 2985 - 3000