State Predictive Control of Modular SMES Magnet Based on Deep Reinforcement Learning

被引:1
|
作者
Zhang, Zitong [1 ]
Shi, Jing [1 ]
Guo, Shuqiang [1 ]
Yang, Wangwang [1 ]
Lin, Dengquan [1 ]
Xu, Ying [1 ]
Ren, Li [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Engn, State Key Lab Adv Electromagnet Engn & Technol, Wuhan 430074, Peoples R China
基金
国家重点研发计划;
关键词
Superconducting magnetic energy storage; Thermal stability; Toroidal magnetic fields; Databases; Power system stability; Predictive models; Superconducting magnets; Superconducting magnetic energy storage (SMES); state predictive control; deep reinforcement learning;
D O I
10.1109/TASC.2022.3148682
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Modular superconducting magnetic energy storage (M-SMES) system, which characterizes high reliability, flexibility, and strong scalability, can deal with the stability and economy of power sys-tem operation, large-scale renewable energy access, power quality and other issues. The thermal stability of M-SMES magnets is a key issue affecting its operation and coordinated control. In this paper, a deep reinforcement learning (DRL) based state predictive power allocation strategy, aiming at improving the reliability of M-SMES, is proposed. Firstly, the interaction between temperature, current, state of charge and other parameters is comprehensively analyzed, and a state database of SMES magnet is established. Then, the prediction model of magnet temperature rise is built. Based on the real-time state and the compensation demand from the grid side, a DRL algorithm is adopted to control each SMES module coordinately, which aims at maximizing the compensation capability of the M-SMES within a safe range. Finally, through a case study, the effectiveness of the proposed method is verified.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] A modular framework for stabilizing deep reinforcement learning control
    Lawrence, Nathan P.
    Loewen, Philip D.
    Wang, Shuyuan
    Forbes, Michael G.
    Gopaluni, R. Bhushan
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 8006 - 8011
  • [2] Predictive control optimization of chiller plants based on deep reinforcement learning
    He, Kun
    Fu, Qiming
    Lu, You
    Wang, Yunzhe
    Luo, Jun
    Wu, Hongjie
    Chen, Jianping
    [J]. JOURNAL OF BUILDING ENGINEERING, 2023, 76
  • [3] A deep reinforcement learning based hyper-heuristic for modular production control
    Panzer, Marcel
    Bender, Benedict
    Gronau, Norbert
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2024, 62 (08) : 2747 - 2768
  • [4] Predictive Control of a Robot Manipulator with Deep Reinforcement Learning
    Bejar, Eduardo
    Moran, Antonio
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2021, : 127 - 130
  • [5] Predictive control of power demand peak regulation based on deep reinforcement learning
    Fu, Qiming
    Liu, Lu
    Zhao, Lifan
    Wang, Yunzhe
    Zheng, Yi
    Lu, You
    Chen, Jianping
    [J]. JOURNAL OF BUILDING ENGINEERING, 2023, 75
  • [6] Deep Reinforcement Learning for Predictive Longitudinal Control of Automated Vehicles
    Buechel, Martin
    Knoll, Alois
    [J]. 2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 2391 - 2397
  • [7] Deep Reinforcement Learning Current Control of Permanent Magnet Synchronous Machines
    Schindler, Tobias
    Broghammert, Lara
    Karamanakost, Petros
    Dietzt, Armin
    Kennel, Ralph
    [J]. 2023 IEEE INTERNATIONAL ELECTRIC MACHINES & DRIVES CONFERENCE, IEMDC, 2023,
  • [8] Research and Application of Predictive Control Method Based on Deep Reinforcement Learning for HVAC Systems
    Fu, Chenhui
    Zhang, Yunhua
    [J]. IEEE ACCESS, 2021, 9 : 130845 - 130852
  • [9] Comparison of Deep Reinforcement Learning and Model Predictive Control for Adaptive Cruise Control
    Lin, Yuan
    McPhee, John
    Azad, Nasser L.
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (02): : 221 - 231
  • [10] Model Predictive Control-Based Reinforcement Learning
    Han, Qiang
    Boussaid, Farid
    Bennamoun, Mohammed
    [J]. 2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,