Kernel-based sparse regression with the correntropy-induced loss

被引:23
|
作者
Chen, Hong [1 ]
Wang, Yulong [2 ]
机构
[1] Huazhong Agr Univ, Inst Appl Math, Coll Sci, Wuhan 430070, Hubei, Peoples R China
[2] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Learning theory; Kernel-based regression; Correntropy-induced loss; Sparsity; Learning rate; SIGNAL;
D O I
10.1016/j.acha.2016.04.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The correntropy-induced loss (C-loss) has been employed in learning algorithms to improve their robustness to non-Gaussian noise and outliers recently. Despite its success on robust learning, only little work has been done to study the generalization performance of regularized regression with the C-loss. To enrich this theme, this paper investigates a kernel-based regression algorithm with the C-loss and l(1)-regularizer in data dependent hypothesis spaces. The asymptotic learning rate is established for the proposed algorithm in terms of novel error decomposition and capacity-based analysis technique. The sparsity characterization of the derived predictor is studied theoretically. Empirical evaluations demonstrate its advantages over the related approaches. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:144 / 164
页数:21
相关论文
共 50 条
  • [31] Kernel Classifier with Correntropy Loss
    Pokharel, Rosha
    Principe, Jose. C.
    [J]. 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
  • [32] Learning rates for kernel-based expectile regression
    Muhammad Farooq
    Ingo Steinwart
    [J]. Machine Learning, 2019, 108 : 203 - 227
  • [33] Correntropy-Induced Metric-Based Variable Step Size Normalized Least Mean Square Algorithm in Sparse System Identification
    Yadav, Rajni
    Jain, Sonia
    Rai, C. S.
    [J]. FIRST INTERNATIONAL CONFERENCE ON SUSTAINABLE TECHNOLOGIES FOR COMPUTATIONAL INTELLIGENCE, 2020, 1045 : 593 - 605
  • [34] A Kernel-based sparse representation method for face recognition
    Zhu, Ningbo
    Li, Shengtao
    [J]. NEURAL COMPUTING & APPLICATIONS, 2014, 24 (3-4): : 845 - 852
  • [35] A Kernel-based sparse representation method for face recognition
    Ningbo Zhu
    Shengtao Li
    [J]. Neural Computing and Applications, 2014, 24 : 845 - 852
  • [36] Convergence rate of SVM for kernel-based robust regression
    Wang, Shuhua
    Chen, Zhenlong
    Sheng, Baohuai
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2019, 17 (01)
  • [37] Robust kernel-based regression with bounded influence for outliers
    Hwang, Sangheum
    Kim, Dohyun
    Jeong, Myong K.
    Yum, Bong-Jin
    [J]. JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2015, 66 (08) : 1385 - 1398
  • [38] Reproducing kernel-based functional linear expectile regression
    Liu, Meichen
    Pietrosanu, Matthew
    Liu, Peng
    Jiang, Bei
    Zhou, Xingcai
    Kong, Linglong
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2022, 50 (01): : 241 - 266
  • [39] Kernel-Based Mixture of Experts Models For Linear Regression
    Santarcangelo, Joseph
    Zhang, Xiao-Ping
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 1526 - 1529
  • [40] Kernel-based estimation of semiparametric regression in triangular systems
    Martins-Filho, Carlos
    Yao, Feng
    [J]. ECONOMICS LETTERS, 2012, 115 (01) : 24 - 27