Kernel-based sparse regression with the correntropy-induced loss

被引:23
|
作者
Chen, Hong [1 ]
Wang, Yulong [2 ]
机构
[1] Huazhong Agr Univ, Inst Appl Math, Coll Sci, Wuhan 430070, Hubei, Peoples R China
[2] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Learning theory; Kernel-based regression; Correntropy-induced loss; Sparsity; Learning rate; SIGNAL;
D O I
10.1016/j.acha.2016.04.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The correntropy-induced loss (C-loss) has been employed in learning algorithms to improve their robustness to non-Gaussian noise and outliers recently. Despite its success on robust learning, only little work has been done to study the generalization performance of regularized regression with the C-loss. To enrich this theme, this paper investigates a kernel-based regression algorithm with the C-loss and l(1)-regularizer in data dependent hypothesis spaces. The asymptotic learning rate is established for the proposed algorithm in terms of novel error decomposition and capacity-based analysis technique. The sparsity characterization of the derived predictor is studied theoretically. Empirical evaluations demonstrate its advantages over the related approaches. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:144 / 164
页数:21
相关论文
共 50 条
  • [1] Sparse Additive Machine With the Correntropy-Induced Loss
    Yuan, Peipei
    You, Xinge
    Chen, Hong
    Wang, Yingjie
    Peng, Qinmu
    Zou, Bin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [2] Robust regression framework with asymmetrically analogous to correntropy-induced loss
    Yang, Liming
    Ding, Guangsheng
    Yuan, Chao
    Zhang, Min
    [J]. Knowledge-Based Systems, 2020, 191
  • [3] Robust regression framework with asymmetrically analogous to correntropy-induced loss
    Yang, Liming
    Ding, Guangsheng
    Yuan, Chao
    Zhang, Min
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 191
  • [4] Feature Selection Using Sparse Twin Support Vector Machine with Correntropy-Induced Loss
    Zheng, Xiaohan
    Zhang, Li
    Yan, Leilei
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 434 - 445
  • [5] Kernel-based online regression with canal loss
    Liang, Xijun
    Zhang, Zhipeng
    Song, Yunquan
    Jian, Ling
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2022, 297 (01) : 268 - 279
  • [6] Correntropy-induced metric with Laplacian kernel for robust fluorescence molecular tomography
    Yuan, Yating
    Guo, Hongbo
    Yi, Huangjian
    Yu, Jingjing
    He, Xuelei
    He, Xiaowei
    [J]. BIOMEDICAL OPTICS EXPRESS, 2021, 12 (10) : 5991 - 6012
  • [7] Efficient and robust deep learning with Correntropy-induced loss function
    Liangjun Chen
    Hua Qu
    Jihong Zhao
    Badong Chen
    Jose C. Principe
    [J]. Neural Computing and Applications, 2016, 27 : 1019 - 1031
  • [8] Correntropy-Induced Discriminative Nonnegative Sparse Coding for Robust Palmprint Recognition
    Jing, Kunlei
    Zhang, Xinman
    Song, Guokun
    [J]. SENSORS, 2020, 20 (15) : 1 - 29
  • [9] Efficient and robust deep learning with Correntropy-induced loss function
    Chen, Liangjun
    Qu, Hua
    Zhao, Jihong
    Chen, Badong
    Principe, Jose C.
    [J]. NEURAL COMPUTING & APPLICATIONS, 2016, 27 (04): : 1019 - 1031
  • [10] SLiKER: Sparse loss induced kernel ensemble regression
    Shen, Xiang-Jun
    Ni, ChengGong
    Wang, Liangjun
    Zha, Zheng-Jun
    [J]. PATTERN RECOGNITION, 2021, 109