A Cooperative Control Method Based on Reinforcement Learning

被引:0
|
作者
Zhuang, Zhiwei [1 ]
Xu, Yongheng [1 ]
Zou, Luobao [1 ]
Zhang, Weidong [1 ]
Zhao, Qunfei [1 ]
Yao, Ruiwen [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai, Peoples R China
基金
美国国家科学基金会;
关键词
Reinforcement Learning; Deep Learning; Basis Weight and moisture control; Forward Decoupling; Pade Approximation; PID; time delay;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increase of system dimensions, the difficulty of decoupling increases exponentially and the controller becomes more difficult to design. A reinforcement learning framework combined with tradition control method is presented to get rid of decoupling trouble and simplified controller design. A Markov decision process of basis weight and moisture control is explicitly defined. A first-order Pade approximation is applied to solve the time delay problem in reinforcement learning. With the proposed design, the control scheme could obtain a good performance of the control system as same as the PID & feedforward decoupling control through cooperative control. Numerical simulations are given to demonstrate the effectiveness of the proposed method.
引用
收藏
页码:1586 / 1591
页数:6
相关论文
共 50 条
  • [1] Cooperative Merging Control Based on Reinforcement Learning With Dynamic Waypoint
    Yang, Xiao
    Liu, Hongfei
    Xu, Miao
    Wan, Jintao
    [J]. IEEE ACCESS, 2024, 12 : 81581 - 81592
  • [2] Comparative Study of Cooperative Platoon Merging Control Based on Reinforcement Learning
    Irshayyid, Ali
    Chen, Jun
    [J]. SENSORS, 2023, 23 (02)
  • [3] Research on Cooperative Control of Traffic Signals based on Deep Reinforcement Learning
    Fan, Lingling
    Yang, Yusong
    Ji, Honghai
    Xiong, Shuangshuang
    [J]. 2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1608 - 1612
  • [4] Distributed Highway Control: A Cooperative Reinforcement Learning-Based Approach
    Kovari, Balint
    Knab, Istvan Gellert
    Esztergar-Kiss, Domokos
    Aradi, Szilard
    Becsi, Tamas
    [J]. IEEE ACCESS, 2024, 12 : 104463 - 104472
  • [5] Cooperative game guidance method for hypersonic vehicles based on reinforcement learning
    Ni, Weilin
    Wang, Yonghai
    Xu, Cong
    Chi, Fenghua
    Liang, Haizhao
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2023, 44
  • [6] Cooperative Search Method for Multiple UAVs Based on Deep Reinforcement Learning
    Gao, Mingsheng
    Zhang, Xiaoxuan
    [J]. SENSORS, 2022, 22 (18)
  • [7] Deep Decentralized Reinforcement Learning for Cooperative Control
    Koepf, Florian
    Tesfazgi, Samuel
    Flad, Michael
    Hohmann, Soeren
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 1555 - 1562
  • [8] Aircraft Control Method Based on Deep Reinforcement Learning
    Zhen, Yan
    Hao, Mingrui
    [J]. PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 912 - 917
  • [9] A Reinforcement Learning-Based Distributed Control Scheme for Cooperative Intersection Traffic Control
    Guzman, Jose A.
    Pizarro, German
    Nunez, Felipe
    [J]. IEEE ACCESS, 2023, 11 : 57037 - 57045
  • [10] Manipulator Control Method Based on Deep Reinforcement Learning
    Zeng, Rui
    Liu, Manlu
    Zhang, Junjun
    Li, Xinmao
    Zhou, Qijie
    Jiang, Yuanchen
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 415 - 420