Gradient-Based Discrete-Time Concurrent Learning for Standalone Function Approximation

被引:16
|
作者
Djaneye-Boundjou, Ouboti [1 ]
Ordonez, Raul [1 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
关键词
Uncertainty; Function approximation; Approximation algorithms; Convergence; Computational modeling; Symmetric matrices; Linear algebra; learning; system identification; ADAPTIVE-CONTROL; CONVERGENCE; SYSTEMS;
D O I
10.1109/TAC.2019.2920087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When using standard learning techniques for uncertainty approximation, persistently exciting inputs are necessary in order to achieve good parameter estimation. It has been shown in recent years that, through concurrent learning (CL), it is possible to achieve better learning without requiring persistency of excitation. We define good learning here by how well an uncertainty can be reconstructed given the estimated parameters. Most studies concerning CL have however been done in the continuous-time (CT) framework. While working with discrete-time (DT) structured uncertainties, we have shown in an earlier study that the concept of CL could be used to solve the parameter identification problem granted, much like in the CT domain, a less restrictive condition compared to that of persistency of excitation is verified. This paper furthers our fundamental study of CL in the DT framework while drawing comparisons with the traditional but fundamental gradient descent technique. As a main contribution, via formal derivations, we present a generalized gradient-based CL motivated DT algorithm for online approximation of both DT structured and unstructured uncertainties. Numerical simulations are provided to show how well the designed algorithm leverages memory usage to achieve better learning.
引用
收藏
页码:749 / 756
页数:8
相关论文
共 50 条
  • [1] Robust monotone gradient-based discrete-time iterative learning control
    Owens, D. H.
    Hatonen, J. J.
    Daley, S.
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2009, 19 (06) : 634 - 661
  • [2] Hierarchical gradient-based identification of multivariable discrete-time systems
    Ding, F
    Chen, TW
    [J]. AUTOMATICA, 2005, 41 (02) : 315 - 325
  • [3] Robustness analysis of a gradient-based repetitive algorithm for discrete-time systems
    Hätönen, J
    Freeman, C
    Owens, DH
    Lewin, P
    Rogers, E
    [J]. 2004 43RD IEEE CONFERENCE ON DECISION AND CONTROL (CDC), VOLS 1-5, 2004, : 1301 - 1306
  • [4] Estimation and approximation bounds for gradient-based reinforcement learning
    Bartlett, PL
    Baxter, J
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2002, 64 (01) : 133 - 150
  • [5] Intractability of Learning the Discrete Logarithm with Gradient-Based Methods
    Takhanov, Rustem
    Tezekbayev, Maxat
    Pak, Artur
    Bolatov, Arman
    Kadyrsizova, Zhibek
    Assylbekov, Zhenisbek
    [J]. ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [6] Homogeneous Discrete-Time Approximation
    Sanchez, Tonametl
    Efimov, Denis
    Polyakov, Andrey
    Moreno, Jaime A.
    [J]. IFAC PAPERSONLINE, 2019, 52 (16): : 19 - 24
  • [7] Gradient-Based Learning of Discrete Structured Measurement Operators for Signal Recovery
    Sauder, Jonathan
    Genzel, Martin
    Jung, Peter
    [J]. IEEE Journal on Selected Areas in Information Theory, 2022, 3 (03): : 481 - 492
  • [8] Gradient-based Sharpness Function
    Rudnaya, Maria
    Mattheij, Robert
    Maubach, Joseph
    ter Morsche, Hennie
    [J]. WORLD CONGRESS ON ENGINEERING, WCE 2011, VOL I, 2011, : 301 - 306
  • [9] Gradient-based learning and optimization
    Cao, XR
    [J]. PROCEEDINGS OF THE 17TH INTERNATIONAL SYMPOSIUM ON COMPUTER AND INFORMATION SCIENCES, 2003, : 3 - 7
  • [10] Discrete-time approximation of Wonhain filters
    Gang George YIN
    [J]. Control Theory and Technology, 2004, (01) : 1 - 10