Quantized Kernel Recursive Least Squares Algorithm

被引:172
|
作者
Chen, Badong [1 ]
Zhao, Songlin [2 ]
Zhu, Pingping [2 ]
Principe, Jose C. [2 ]
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Peoples R China
[2] Univ Florida, Dept Elect & Comp Engn, Gainesville, FL 32611 USA
关键词
Kernel recursive least squares (KRLS); quantization; quantized kernel recursive least squares (QKRLS); sparsification;
D O I
10.1109/TNNLS.2013.2258936
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In a recent paper, we developed a novel quantized kernel least mean square algorithm, in which the input space is quantized (partitioned into smaller regions) and the network size is upper bounded by the quantization codebook size (number of the regions). In this brief, we propose the quantized kernel least squares regression, and derive the optimal solution. By incorporating a simple online vector quantization method, we derive a recursive algorithm to update the solution, namely the quantized kernel recursive least squares algorithm. The good performance of the new algorithm is demonstrated by Monte Carlo simulations.
引用
收藏
页码:1484 / 1491
页数:9
相关论文
共 50 条
  • [1] A Class of Weighted Quantized Kernel Recursive Least Squares Algorithms
    Wang, Shiyuan
    Wang, Wanli
    Duan, Shukai
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2017, 64 (06) : 730 - 734
  • [2] Projected Kernel Recursive Least Squares Algorithm
    Zhao, Ji
    Zhang, Hongbin
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 356 - 365
  • [3] Extended Kernel Recursive Least Squares Algorithm
    Liu, Weifeng
    Park, Il
    Wang, Yiwen
    Principe, Jose C.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (10) : 3801 - 3814
  • [4] The kernel recursive least-squares algorithm
    Engel, Y
    Mannor, S
    Meir, R
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2004, 52 (08) : 2275 - 2285
  • [5] Kernel recursive least squares dictionary learning algorithm
    Alipoor, Ghasem
    Skretting, Karl
    [J]. DIGITAL SIGNAL PROCESSING, 2023, 141
  • [6] Deep kernel recursive least-squares algorithm
    Hossein Mohamadipanah
    Mahdi Heydari
    Girish Chowdhary
    [J]. Nonlinear Dynamics, 2021, 104 : 2515 - 2530
  • [7] Deep kernel recursive least-squares algorithm
    Mohamadipanah, Hossein
    Heydari, Mahdi
    Chowdhary, Girish
    [J]. NONLINEAR DYNAMICS, 2021, 104 (03) : 2515 - 2530
  • [8] Quaternion kernel recursive least-squares algorithm
    Wang, Gang
    Qiao, Jingci
    Xue, Rui
    Peng, Bei
    [J]. SIGNAL PROCESSING, 2021, 178
  • [9] A novel extended kernel recursive least squares algorithm
    Zhu, Pingping
    Chen, Badong
    Principe, Jose C.
    [J]. NEURAL NETWORKS, 2012, 32 : 349 - 357
  • [10] Analysis on Extended Kernel Recursive Least Squares Algorithm
    Zhu, Pingping
    Principe, Jose C.
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,