Reinforcement Learning Control for Discrete-time Systems over Fading Channels

被引:0
|
作者
Lai, Jing [1 ]
Xiong, Junlin [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230026, Peoples R China
来源
IFAC PAPERSONLINE | 2023年 / 56卷 / 02期
基金
中国国家自然科学基金;
关键词
fading channels; reinforcement learning; generalized policy iteration; GENERALIZED POLICY ITERATION;
D O I
10.1016/j.ifacol.2023.10.1251
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the average cost minimization problem for a class of discrete-time systems suffering from fading channels and additive noise. An approximate generalized policy iteration algorithm is proposed to search for the optimal control policy for the considered problem without resorting to the system matrices. The estimation errors of the kernel matrices are proven to be small and the proposed model-free reinforcement learning algorithm is proven to be convergent. Some numerical examples are provided to illustrate the obtained results. Copyright (c) 2023 The Authors.
引用
收藏
页码:4834 / 4839
页数:6
相关论文
共 50 条
  • [1] Iterative Learning Control for Discrete-time Linear Systems Through Fading Channels
    Qu, Ganggui
    Shen, Dong
    [J]. IFAC PAPERSONLINE, 2019, 52 (24): : 123 - 128
  • [2] On the Robust Stability of Uncertain Discrete-Time Networked Control Systems Over Fading Channels
    Su, L.
    Chesi, G.
    [J]. 2015 AMERICAN CONTROL CONFERENCE (ACC), 2015, : 6010 - 6015
  • [3] Feedback Stabilization of Discrete-Time Networked Systems Over Fading Channels
    Xiao, Nan
    Xie, Lihua
    Qiu, Li
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (09) : 2176 - 2189
  • [4] Quantized H filtering for discrete-time systems over fading channels
    Chen, Wei
    Zou, Yuanyuan
    Xiao, Nan
    Niu, Yugang
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2018, 40 (10) : 3115 - 3124
  • [5] Analysis and Design of Discrete-Time Networked Systems over Fading Channels
    Xiao Nan
    Xie Lihua
    [J]. 2011 30TH CHINESE CONTROL CONFERENCE (CCC), 2011, : 6562 - 6567
  • [6] Robust Stability Analysis and Synthesis for Uncertain Discrete-Time Networked Control Systems Over Fading Channels
    Su, Lanlan
    Chesi, Graziano
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (04) : 1966 - 1971
  • [7] Consensus Control of Discrete-Time Multiagent Systems Over Correlated Fading Channels: A Compressed Coding Scheme
    Chen, Wei
    Zhao, Rong
    Liu, Lu
    Liu, Guo-Ping
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (09): : 5760 - 5771
  • [8] Output Feedback Stabilizing Control with Instantaneous Quantization Error for Discrete-Time Systems over Quantized Fading Channels
    Feng, Yu
    Chen, Xiang
    Gu, Guoxiang
    [J]. 2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 6555 - 6560
  • [9] Voltage Synchronization of Discrete-time Microgrids over Analog Fading Channels
    Lai, Jingang
    Lu, Xiaoqing
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 12900 - 12905
  • [10] Reinforcement Learning-Based Model Predictive Control for Discrete-Time Systems
    Lin, Min
    Sun, Zhongqi
    Xia, Yuanqing
    Zhang, Jinhui
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3312 - 3324