Multivariable Coupled System Control Method Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Jin [1 ]
Li, Han [1 ]
Zhang, Qingxin [1 ]
机构
[1] Shenyang Aerosp Univ, Sch Artificial Intelligence, Shenyang 110136, Peoples R China
关键词
multivariate coupled system; deep reinforcement learning; control system; PPO; normalization; ROBUST-CONTROL;
D O I
10.3390/s23218679
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Due to the multi-loop coupling characteristics of multivariable systems, it is difficult for traditional control methods to achieve precise control effects. Therefore, this paper proposes a control method based on deep reinforcement learning to achieve stable and accurate control of multivariable coupling systems. Based on the proximal policy optimization algorithm (PPO), this method selects tanh as the activation function and normalizes the advantage function. At the same time, based on the characteristics of the multivariable coupling system, the reward function and controller are redesigned structures, achieving stable and precise control of the controlled system. In addition, this study used the amplitude of the control quantity output by the controller as an indicator to evaluate the controller's performance. Finally, simulation verification was conducted in MATLAB/Simulink. The experimental results show that compared with decentralized control, decoupled control and traditional PPO control, the method proposed in this article achieves better control effects.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Manipulator Control Method Based on Deep Reinforcement Learning
    Zeng, Rui
    Liu, Manlu
    Zhang, Junjun
    Li, Xinmao
    Zhou, Qijie
    Jiang, Yuanchen
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 415 - 420
  • [2] Aircraft Control Method Based on Deep Reinforcement Learning
    Zhen, Yan
    Hao, Mingrui
    PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 912 - 917
  • [3] Multivariable System Identification Method Based on Continuous Action Reinforcement Learning Automata
    Jiang, Meiying
    Jin, Qibing
    PROCESSES, 2019, 7 (08)
  • [4] A Hierarchical Resource Scheduling Method for Satellite Control System Based on Deep Reinforcement Learning
    Li, Yang
    Guo, Xiye
    Meng, Zhijun
    Qin, Junxiang
    Li, Xuan
    Ma, Xiaotian
    Ren, Sichuang
    Yang, Jun
    ELECTRONICS, 2023, 12 (19)
  • [5] An Intersection Signal Control Method Based on Deep Reinforcement Learning
    Pang Ha-li
    Ding Ke
    2017 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2017), 2017, : 344 - 348
  • [6] Satellite attitude control method based on deep reinforcement learning
    Wang Yuejiao
    Ma Zhong
    Yang Yidai
    Wang Zhuping
    Tang Lei
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2019, 39 (04) : 36 - 42
  • [7] Traffic signal control method based on deep reinforcement learning
    Liu Z.-M.
    Ye B.-L.
    Zhu Y.-D.
    Yao Q.
    Wu W.-M.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (06): : 1249 - 1256
  • [8] Task scheduling for control system based on deep reinforcement learning
    Liu, Yuhao
    Ni, Yuqing
    Dong, Chang
    Chen, Jun
    Liu, Fei
    NEUROCOMPUTING, 2024, 610
  • [9] Intelligent direct thrust control for multivariable turbofan engine based on reinforcement and deep learning methods
    Zhu, Yiyang
    Pan, Muxuan
    Zhou, Wenxiang
    Huang, Jinquan
    AEROSPACE SCIENCE AND TECHNOLOGY, 2022, 131
  • [10] A Coordinated Control Method for Hybrid Energy Storage System in Microgrid Based on Deep Reinforcement Learning
    Zhang Z.
    Qiu C.
    Zhang D.
    Xu S.
    He X.
    Dianwang Jishu/Power System Technology, 2019, 43 (06): : 1914 - 1921