Multivariable Coupled System Control Method Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Jin [1 ]
Li, Han [1 ]
Zhang, Qingxin [1 ]
机构
[1] Shenyang Aerosp Univ, Sch Artificial Intelligence, Shenyang 110136, Peoples R China
关键词
multivariate coupled system; deep reinforcement learning; control system; PPO; normalization; ROBUST-CONTROL;
D O I
10.3390/s23218679
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Due to the multi-loop coupling characteristics of multivariable systems, it is difficult for traditional control methods to achieve precise control effects. Therefore, this paper proposes a control method based on deep reinforcement learning to achieve stable and accurate control of multivariable coupling systems. Based on the proximal policy optimization algorithm (PPO), this method selects tanh as the activation function and normalizes the advantage function. At the same time, based on the characteristics of the multivariable coupling system, the reward function and controller are redesigned structures, achieving stable and precise control of the controlled system. In addition, this study used the amplitude of the control quantity output by the controller as an indicator to evaluate the controller's performance. Finally, simulation verification was conducted in MATLAB/Simulink. The experimental results show that compared with decentralized control, decoupled control and traditional PPO control, the method proposed in this article achieves better control effects.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Power System Security Correction Control Based on Deep Reinforcement Learning
    Wang Y.
    Li L.
    Yu Y.
    Yang N.
    Liu M.
    Li T.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (12): : 121 - 129
  • [22] A quantum system control method based on enhanced reinforcement learning
    Liu, Wenjie
    Wang, Bosi
    Fan, Jihao
    Ge, Yebo
    Zidan, Mohammed
    SOFT COMPUTING, 2022, 26 (14) : 6567 - 6575
  • [23] A Distributed Intelligent Lighting Control System Based on Deep Reinforcement Learning
    Fang, Peixin
    Wang, Ming
    Li, Jingzheng
    Zhao, Qianchuan
    Zheng, Xuehan
    Gao, He
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [24] Power System Fault Diagnosis Method Based on Deep Reinforcement Learning
    Wang, Zirui
    Zhang, Ziqi
    Zhang, Xu
    Du, Mingxuan
    Zhang, Huiting
    Liu, Bowen
    ENERGIES, 2022, 15 (20)
  • [25] A cooperative control method and application for series multivariable coupled system
    Yu, Yongchuan
    Yang, Haonan
    Wan, Shuo
    Liu, Qiusheng
    Yan, Jianzhuo
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [26] Multivariable anesthesia control using reinforcement learning
    Sadati, N.
    Aflaki, A.
    Jahed, M.
    2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 4563 - +
  • [27] ANFIS Based Reinforcement Learning Strategy for Control A Nonlinear Coupled Tanks System
    Ali Hussien Mary
    Abbas H. Miry
    Mohammed H. Miry
    Journal of Electrical Engineering & Technology, 2022, 17 : 1921 - 1929
  • [28] ANFIS Based Reinforcement Learning Strategy for Control A Nonlinear Coupled Tanks System
    Mary, Ali Hussien
    Miry, Abbas H.
    Miry, Mohammed H.
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2022, 17 (03) : 1921 - 1929
  • [29] Reinforcement Learning Control with Deep Deterministic Policy Gradient Algorithm for Multivariable pH Process
    Panjapornpon, Chanin
    Chinchalongporn, Patcharapol
    Bardeeniz, Santi
    Makkayatorn, Ratthanita
    Wongpunnawat, Witchaya
    PROCESSES, 2022, 10 (12)
  • [30] Control Method Based on Deep Reinforcement Learning for Robotic Follower with Monocular Vision
    Wang, Dongdong
    Qiu, Feng
    Liu, Xiaobo
    2019 3RD INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2019), 2019, 1229