Multivariable Coupled System Control Method Based on Deep Reinforcement Learning

被引:1
|
作者
Xu, Jin [1 ]
Li, Han [1 ]
Zhang, Qingxin [1 ]
机构
[1] Shenyang Aerosp Univ, Sch Artificial Intelligence, Shenyang 110136, Peoples R China
关键词
multivariate coupled system; deep reinforcement learning; control system; PPO; normalization; ROBUST-CONTROL;
D O I
10.3390/s23218679
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Due to the multi-loop coupling characteristics of multivariable systems, it is difficult for traditional control methods to achieve precise control effects. Therefore, this paper proposes a control method based on deep reinforcement learning to achieve stable and accurate control of multivariable coupling systems. Based on the proximal policy optimization algorithm (PPO), this method selects tanh as the activation function and normalizes the advantage function. At the same time, based on the characteristics of the multivariable coupling system, the reward function and controller are redesigned structures, achieving stable and precise control of the controlled system. In addition, this study used the amplitude of the control quantity output by the controller as an indicator to evaluate the controller's performance. Finally, simulation verification was conducted in MATLAB/Simulink. The experimental results show that compared with decentralized control, decoupled control and traditional PPO control, the method proposed in this article achieves better control effects.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Continuous control of a polymerization system with deep reinforcement learning
    Ma, Yan
    Zhu, Wenbo
    Benton, Michael G.
    Romagnoli, Jose
    JOURNAL OF PROCESS CONTROL, 2019, 75 : 40 - 47
  • [42] Deep reinforcement learning to control an unmanned swarm system
    Liang, Hongtao
    Wang, Yaonan
    Hua, Hean
    Zhong, Hang
    Zheng, Chenghong
    Zeng, Junhao
    Liang, Jiacheng
    Li, Zhengchen
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2024, 46 (09): : 1521 - 1534
  • [43] A Power System Corrective Control Method Based on Evolutionary Reinforcement Learning
    Zhang, Haoran
    Xu, Peidong
    Zhang, Ke
    Zhao, Hang
    Dai, Yuxin
    Gao, Tianlu
    Zhang, Jun
    IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION, 2022, 6 : 815 - 819
  • [44] An Online Deep Reinforcement Learning Based Parameter Identification Method for HVDC System
    Hu, Jianxiong
    Wang, Qi
    Tang, Yi
    2021 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2021,
  • [45] A Deep Reinforcement Learning Based Energy Storage System Control Method for Wind farm Integrating Prediction and Decision
    Yang, Jiajun
    Yang, Ming
    Du, Pingjing
    Yan, Fangqing
    Yu, Yixiao
    PROCEEDINGS OF 2019 IEEE 3RD INTERNATIONAL ELECTRICAL AND ENERGY CONFERENCE (CIEEC), 2019, : 568 - 573
  • [46] District-Coupled Epidemic Control via Deep Reinforcement Learning
    Du, Xinqi
    Liu, Tianyi
    Zhao, Songwei
    Song, Jiuman
    Chen, Hechang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 417 - 428
  • [47] Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system
    Yi, Zonggen
    Luo, Yusheng
    Westover, Tyler
    Katikaneni, Sravya
    Ponkiya, Binaka
    Sah, Suba
    Mahmud, Sadab
    Raker, David
    Javaid, Ahmad
    Heben, Michael J.
    Khanna, Raghav
    APPLIED ENERGY, 2022, 328
  • [48] Intelligent Control of Manipulator Based on Deep Reinforcement Learning
    Zhou, Jiangtao
    Zheng, Hua
    Zhao, Dongzhu
    Chen, Yingxue
    2021 12TH INTERNATIONAL CONFERENCE ON MECHANICAL AND AEROSPACE ENGINEERING (ICMAE), 2021, : 275 - 279
  • [49] Deep reinforcement learning based voltage control revisited
    Nematshahi, Saeed
    Shi, Di
    Wang, Fengyu
    Yan, Bing
    Nair, Adithya
    IET GENERATION TRANSMISSION & DISTRIBUTION, 2023, 17 (21) : 4826 - 4835
  • [50] Missile Attitude Control Based on Deep Reinforcement Learning
    Li, Bohao
    Ma, Fei
    Wu, Yunjie
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 931 - 936