Kernel-based sparse regression with the correntropy-induced loss

被引:23
|
作者
Chen, Hong [1 ]
Wang, Yulong [2 ]
机构
[1] Huazhong Agr Univ, Inst Appl Math, Coll Sci, Wuhan 430070, Hubei, Peoples R China
[2] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Learning theory; Kernel-based regression; Correntropy-induced loss; Sparsity; Learning rate; SIGNAL;
D O I
10.1016/j.acha.2016.04.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The correntropy-induced loss (C-loss) has been employed in learning algorithms to improve their robustness to non-Gaussian noise and outliers recently. Despite its success on robust learning, only little work has been done to study the generalization performance of regularized regression with the C-loss. To enrich this theme, this paper investigates a kernel-based regression algorithm with the C-loss and l(1)-regularizer in data dependent hypothesis spaces. The asymptotic learning rate is established for the proposed algorithm in terms of novel error decomposition and capacity-based analysis technique. The sparsity characterization of the derived predictor is studied theoretically. Empirical evaluations demonstrate its advantages over the related approaches. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:144 / 164
页数:21
相关论文
共 50 条
  • [41] On the Convergence Rate of Kernel-Based Sequential Greedy Regression
    Wang, Xiaoyin
    Wei, Xiaoyan
    Pan, Zhibin
    [J]. ABSTRACT AND APPLIED ANALYSIS, 2012,
  • [42] Kernel-based regression via a novel robust loss function and iteratively reweighted least squares
    Hongwei Dong
    Liming Yang
    [J]. Knowledge and Information Systems, 2021, 63 : 1149 - 1172
  • [43] Kernel-based regression via a novel robust loss function and iteratively reweighted least squares
    Dong, Hongwei
    Yang, Liming
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2021, 63 (05) : 1149 - 1172
  • [44] CTSVM: A robust twin support vector machine with correntropy-induced loss function for binary classification problems
    Zheng, Xiaohan
    Zhang, Li
    Yan, Leilei
    [J]. INFORMATION SCIENCES, 2021, 559 : 22 - 45
  • [45] Error Approximation of Hyperspectral Unmixing via Correntropy-Induced Metric
    Li, Chunzhi
    Chen, Xiaohua
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) : 282 - 286
  • [46] Learning sparse conditional distribution: An efficient kernel-based approach
    Chen, Fang
    He, Xin
    Wang, Junhui
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2021, 15 (01): : 1610 - 1635
  • [47] Kernel-Based Multiview Joint Sparse Coding for Image Annotation
    Zang, Miao
    Xu, Huimin
    Zhang, Yongmei
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2017, 2017
  • [48] Efficient seismic sparse decomposition based on multiple kernel-based models
    School of Mathematics and Physics, China University of Geosciences , Wuhan
    Hubei
    430074, China
    不详
    Hubei
    430079, China
    不详
    Hubei
    430073, China
    [J]. Shiyou Diqiu Wuli Kantan, 3 (444-450):
  • [49] A New Kernel-Based Algorithm for Cluster Sparse System Identification
    Senthil Murugan Boopalan
    Sundaravanan Jothiprakasam
    [J]. Transactions of the Indian National Academy of Engineering, 2024, 9 (1) : 225 - 239
  • [50] Nonparametric Basis Pursuit via Sparse Kernel-Based Learning
    Bazerque, Juan Andres
    Giannakis, Georgios B.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2013, 30 (04) : 112 - 125