Regularization for the Kernel Recursive Least Squares CMAC

被引:0
|
作者
Laufer, C. [1 ]
Coghill, G. [1 ]
机构
[1] Univ Auckland, Elect & Elect Engn Dept, Auckland 1, New Zealand
关键词
ALGORITHM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Cerebellar Model Articulation Controller (CMAC) neural network is an associative memory that is biologically inspired by the cerebellum, which is found in the brains of animals. In recent works, the kernel recursive least squares CMAC (KRLS-CMAC) was proposed as a superior alternative to the standard CMAC as it converges faster, does not require tuning of a learning rate parameter, and is much better at modeling. The KRLS-CMAC however, still suffered from the learning interference problem. Learning interference was addressed in the standard CMAC by regularization. Previous works have also applied regularization to kernelized CMACs, however they were not computationally feasible for large resolutions and dimensionalities. This paper brings the regularization technique to the KRLS-CMAC in a way that allows it to be used efficiently in multiple dimensions with infinite resolution kernel functions.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] The Kernel Recursive Least Squares CMAC with Vector Eligibility
    Carl Laufer
    Nitish Patel
    George Coghill
    Neural Processing Letters, 2014, 39 : 269 - 284
  • [2] The Kernel Recursive Least Squares CMAC with Vector Eligibility
    Laufer, Carl
    Patel, Nitish
    Coghill, George
    NEURAL PROCESSING LETTERS, 2014, 39 (03) : 269 - 284
  • [3] Kernel Recursive Least-Squares Temporal Difference Algorithms with Sparsification and Regularization
    Zhang, Chunyuan
    Zhu, Qingxin
    Niu, Xinzheng
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2016, 2016
  • [4] Projected Kernel Recursive Least Squares Algorithm
    Zhao, Ji
    Zhang, Hongbin
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 356 - 365
  • [5] Quantized Kernel Recursive Least Squares Algorithm
    Chen, Badong
    Zhao, Songlin
    Zhu, Pingping
    Principe, Jose C.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (09) : 1484 - 1491
  • [6] The kernel recursive least-squares algorithm
    Engel, Y
    Mannor, S
    Meir, R
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2004, 52 (08) : 2275 - 2285
  • [7] Extended Kernel Recursive Least Squares Algorithm
    Liu, Weifeng
    Park, Il
    Wang, Yiwen
    Principe, Jose C.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (10) : 3801 - 3814
  • [8] DISTRIBUTED KERNEL LEARNING USING KERNEL RECURSIVE LEAST SQUARES
    Fraser, Nicholas J.
    Moss, Duncan J. M.
    Epain, Nicolas
    Leong, Philip H. W.
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 5500 - 5504
  • [9] Combining tracking and regularization in recursive least squares identification
    Gunnarsson, S
    PROCEEDINGS OF THE 35TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1996, : 2551 - 2552
  • [10] Kernel recursive least squares dictionary learning algorithm
    Alipoor, Ghasem
    Skretting, Karl
    DIGITAL SIGNAL PROCESSING, 2023, 141