Gradient-Based Discrete-Time Concurrent Learning for Standalone Function Approximation

被引:16
|
作者
Djaneye-Boundjou, Ouboti [1 ]
Ordonez, Raul [1 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
关键词
Uncertainty; Function approximation; Approximation algorithms; Convergence; Computational modeling; Symmetric matrices; Linear algebra; learning; system identification; ADAPTIVE-CONTROL; CONVERGENCE; SYSTEMS;
D O I
10.1109/TAC.2019.2920087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When using standard learning techniques for uncertainty approximation, persistently exciting inputs are necessary in order to achieve good parameter estimation. It has been shown in recent years that, through concurrent learning (CL), it is possible to achieve better learning without requiring persistency of excitation. We define good learning here by how well an uncertainty can be reconstructed given the estimated parameters. Most studies concerning CL have however been done in the continuous-time (CT) framework. While working with discrete-time (DT) structured uncertainties, we have shown in an earlier study that the concept of CL could be used to solve the parameter identification problem granted, much like in the CT domain, a less restrictive condition compared to that of persistency of excitation is verified. This paper furthers our fundamental study of CL in the DT framework while drawing comparisons with the traditional but fundamental gradient descent technique. As a main contribution, via formal derivations, we present a generalized gradient-based CL motivated DT algorithm for online approximation of both DT structured and unstructured uncertainties. Numerical simulations are provided to show how well the designed algorithm leverages memory usage to achieve better learning.
引用
收藏
页码:749 / 756
页数:8
相关论文
共 50 条
  • [41] GLR: Gradient-Based Learning Rate Scheduler
    Spatafora, Maria Ausilia Napoli
    Ortis, Alessandro
    Battiato, Sebastiano
    [J]. IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 : 269 - 281
  • [42] Gradient-Based Local Causal Structure Learning
    Liang, Jiaxuan
    Wang, Jun
    Yu, Guoxian
    Domeniconi, Carlotta
    Zhang, Xiangliang
    Guo, Maozu
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 486 - 495
  • [43] FIR filter approximation by IIR filters based on discrete-time vector fitting
    Wong, Ngai
    Lei, Chi-Un
    [J]. 2007 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, 2007, : 2343 - 2346
  • [44] Robust gradient-based iterative learning control
    Owens, D. H.
    Haetoenen, J.
    Daley, S.
    [J]. 2007 INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL SYSTEMS, 2007, : 143 - 148
  • [45] Separation conditions and approximation of discrete-time and discrete-space systems
    Sandberg, IW
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 1998, 17 (03) : 305 - 320
  • [46] Separation conditions and approximation of discrete-time and discrete-space systems
    Irwin W. Sandberg
    [J]. Circuits, Systems and Signal Processing, 1998, 17 : 305 - 320
  • [47] Gradient-based learning applied to document recognition
    Lecun, Y
    Bottou, L
    Bengio, Y
    Haffner, P
    [J]. PROCEEDINGS OF THE IEEE, 1998, 86 (11) : 2278 - 2324
  • [48] Discrete-Time Minimum Tracking Based on Stochastic Approximation Algorithm With Randomized Differences
    Granichin, Oleg
    Gurevich, Lev
    Vakhitov, Alexander
    [J]. PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 5763 - 5767
  • [49] Robust gradient-based iterative learning control
    Owens, D. H.
    Hatonen, J.
    Daley, S.
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING, AND CONTROL, VOLS 1 AND 2, 2007, : 163 - 168
  • [50] Optimizing FIR approximation for discrete-time IIR filters
    Yamamoto, Y
    Anderson, BDO
    Nagahara, M
    Koyanagi, Y
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2003, 10 (09) : 273 - 276