Regularization for the Kernel Recursive Least Squares CMAC

被引:0
|
作者
Laufer, C. [1 ]
Coghill, G. [1 ]
机构
[1] Univ Auckland, Elect & Elect Engn Dept, Auckland 1, New Zealand
关键词
ALGORITHM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Cerebellar Model Articulation Controller (CMAC) neural network is an associative memory that is biologically inspired by the cerebellum, which is found in the brains of animals. In recent works, the kernel recursive least squares CMAC (KRLS-CMAC) was proposed as a superior alternative to the standard CMAC as it converges faster, does not require tuning of a learning rate parameter, and is much better at modeling. The KRLS-CMAC however, still suffered from the learning interference problem. Learning interference was addressed in the standard CMAC by regularization. Previous works have also applied regularization to kernelized CMACs, however they were not computationally feasible for large resolutions and dimensionalities. This paper brings the regularization technique to the KRLS-CMAC in a way that allows it to be used efficiently in multiple dimensions with infinite resolution kernel functions.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Regularization-Induced Bias and Consistency in Recursive Least Squares
    Lai, Brian
    Ul Islam, Syed Aseem
    Bernstein, Dennis S.
    2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 3987 - 3992
  • [22] A recursive least squares algorithm with ?1 regularization for sparse representation
    Di LIU
    Simone BALDI
    Quan LIU
    Wenwu YU
    ScienceChina(InformationSciences), 2023, 66 (02) : 281 - 282
  • [23] A Class of Weighted Quantized Kernel Recursive Least Squares Algorithms
    Wang, Shiyuan
    Wang, Wanli
    Duan, Shukai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2017, 64 (06) : 730 - 734
  • [24] Bootstrapping particle filters using Kernel Recursive Least Squares
    Oreshkin, Boris
    Coates, Mark
    2007 IEEE AEROSPACE CONFERENCE, VOLS 1-9, 2007, : 1889 - 1895
  • [25] A BAYESIAN APPROACH TO TRACKING WITH KERNEL RECURSIVE LEAST-SQUARES
    Lazaro-Gredilla, Miguel
    Van Vaerenbergh, Steven
    Santamaria, Ignacio
    2011 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2011,
  • [26] OPERATOR-VALUED KERNEL RECURSIVE LEAST SQUARES ALGORITHM
    Amblard, P. O.
    Kadri, H.
    2015 23RD EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2015, : 2376 - 2380
  • [27] FIXED-BUDGET KERNEL RECURSIVE LEAST-SQUARES
    Van Vaerenbergh, Steven
    Santamaria, Ignacio
    Liu, Weifeng
    Principe, Jose C.
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1882 - 1885
  • [28] A Recursive Least-Squares with a Time-Varying Regularization Parameter
    Mahadi, Maaz
    Ballal, Tarig
    Moinuddin, Muhammad
    Al-Saggaf, Ubaid M.
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [29] Recursive Least-squares Reinforcement Learning Controller Based on General Fuzzy CMAC
    Shen, Zhipeng
    Zhang, Ning
    Guo, Chen
    2007 SECOND INTERNATIONAL CONFERENCE ON BIO-INSPIRED COMPUTING: THEORIES AND APPLICATIONS, 2007, : 191 - 195
  • [30] The Kernel Kalman Rule - Efficient Nonparametric Inference with Recursive Least Squares
    Gebhardt, Gregor H. W.
    Kupcsik, Andras
    Neumann, Gerhard
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3754 - 3760