Fractional-Order Control Method Based on Twin-Delayed Deep Deterministic Policy Gradient Algorithm

被引：0
|
作者：
Jiao, Guangxin [1 ]
An, Zhengcai [1 ]
Shao, Shuyi [1 ]
Sun, Dong [2 ]
机构：
[1] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Automat Engn, Nanjing 211106, Peoples R China
[2] Jincheng Nanjing Engn Inst Aircraft Syst, Nanjing 211199, Peoples R China
来源：
FRACTAL AND FRACTIONAL | 2024年 / 8卷 / 02期
关键词：
FODOB; FOSMC; radial basis function network; TD3; algorithm;
D O I：
10.3390/fractalfract8020099
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
In this paper, a fractional-order control method based on the twin-delayed deep deterministic policy gradient (TD3) algorithm in reinforcement learning is proposed. A fractional-order disturbance observer is designed to estimate the disturbances, and the radial basis function network is selected to approximate system uncertainties in the system. Then, a fractional-order sliding-mode controller is constructed to control the system, and the parameters of the controller are tuned using the TD3 algorithm, which can optimize the control effect. The results show that the fractional-order control method based on the TD3 algorithm can not only improve the closed-loop system performance under different operating conditions but also enhance the signal tracking capability.
引用
收藏
页数：17
相关论文
共 50 条
  • [41] A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid
    Liu, Yulin
    Qie, Tianhao
    Yu, Yang
    Wang, Yuxuan
    Chau, Tat Kei
    Zhang, Xinan
    Manandhar, Ujjal
    Li, Sinan
    Iu, Herbert H. C.
    Fernando, Tyrone
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2023, 14 (01) : 688 - 703
  • [42] Twin Delayed Deep Deterministic Policy Gradient (TD3) Based Virtual Inertia Control for Inverter-Interfacing DGs in Microgrids
    Egbomwan, Osarodion Emmanuel
    Liu, Shichao
    Chaoui, Hicham
    IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2122 - 2132
  • [43] Bifurcation control of a fractional-order PD control strategy for a delayed fractional-order prey–predator system
    Lu Lu
    Chengdai Huang
    Xinyu Song
    The European Physical Journal Plus, 138
  • [44] Reinforcement learning control method for real-time hybrid simulation based on deep deterministic policy gradient algorithm
    Li, Ning
    Tang, Jichuan
    Li, Zhong-Xian
    Gao, Xiuyu
    Structural Control and Health Monitoring, 2022, 29 (10)
  • [45] Reinforcement learning control method for real-time hybrid simulation based on deep deterministic policy gradient algorithm
    Li, Ning
    Tang, Jichuan
    Li, Zhong-Xian
    Gao, Xiuyu
    STRUCTURAL CONTROL & HEALTH MONITORING, 2022, 29 (10):
  • [46] Continuous Control for Automated Lane Change Behavior Based on Deep Deterministic Policy Gradient Algorithm
    Wang, Pin
    Li, Hanhan
    Chan, Ching-Yao
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1454 - 1460
  • [47] Course Tracking Control for Smart Ships Based on A Deep Deterministic Policy Gradient-based Algorithm
    Wang, Wei-ye
    Ma, Feng
    Liu, Jialun
    2019 5TH INTERNATIONAL CONFERENCE ON TRANSPORTATION INFORMATION AND SAFETY (ICTIS 2019), 2019, : 1400 - 1404
  • [48] Variable fractional-order gradient descent method
    Li J.
    Shen Y.
    Yang S.
    Zhendong yu Chongji/Journal of Vibration and Shock, 2021, 40 (09): : 43 - 47
  • [49] Optimal demand response based dynamic pricing strategy via Multi-Agent Federated Twin Delayed Deep Deterministic policy gradient algorithm
    Ma, Haining
    Zhang, Huifeng
    Tian, Ding
    Yue, Dong
    Hancke, Gerhard P.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [50] A Particle Swarm Optimization Algorithm Based on Deep Deterministic Policy Gradient
    Lu H.-X.
    Yin S.-Y.
    Gong G.-L.
    Liu Y.
    Cheng G.
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2021, 50 (02): : 199 - 206
12345