Least Square Regression with lp-Coefficient Regularization

被引:16
|
作者
Tong, Hongzhi [1 ]
Chen, Di-Rong [2 ]
Yang, Fenghong [3 ]
机构
[1] Univ Int Business & Econ, Sch Informat Technol & Management Engn, Beijing 100029, Peoples R China
[2] Beijing Univ Aeronaut & Astronaut, Dept Math & LMIB, Beijing 100083, Peoples R China
[3] Cent Univ Finance & Econ, Sch Appl Math, Beijing 100081, Peoples R China
关键词
NEURAL-NETWORKS; LEARNING-THEORY; CLASSIFIERS; COMPLEXITY; RATES;
D O I
10.1162/NECO_a_00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The selection of the penalty functional is critical for the performance of a regularized learning algorithm, and thus it deserves special attention. In this article, we present a least square regression algorithm based on l(p)-coefficient regularization. Comparing with the classical regularized least square regression, the new algorithm is different in the regularization term. Our primary focus is on the error analysis of the algorithm. An explicit learning rate is derived under some ordinary assumptions.
引用
收藏
页码:3221 / 3235
页数:15
相关论文
共 50 条
  • [1] Least square regression with indefinite kernels and coefficient regularization
    Sun, Hongwei
    Wu, Qiang
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2011, 30 (01) : 96 - 109
  • [2] LEAST SQUARE REGRESSION WITH COEFFICIENT REGULARIZATION BY GRADIENT DESCENT
    Huang, Juan
    Chen, Hong
    Li, Luoqing
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2012, 10 (01)
  • [3] Learning rates for least square regressions with coefficient regularization
    Bao Huai Sheng
    Pei Xin Ye
    Jian Li Wang
    [J]. Acta Mathematica Sinica, English Series, 2012, 28 : 2205 - 2212
  • [4] Learning Rates for Least Square Regressions with Coefficient Regularization
    Bao Huai SHENG
    Pei Xin YE
    Jian Li WANG
    [J]. Acta Mathematica Sinica,English Series, 2012, (11) : 2205 - 2212
  • [5] Learning rates for least square regressions with coefficient regularization
    Sheng, Bao Huai
    Ye, Pei Xin
    Wang, Jian Li
    [J]. ACTA MATHEMATICA SINICA-ENGLISH SERIES, 2012, 28 (11) : 2205 - 2212
  • [6] Learning Rates for Least Square Regressions with Coefficient Regularization
    Bao Huai SHENG
    Pei Xin YE
    Jian Li WANG
    [J]. ActaMathematicaSinica., 2012, 28 (11) - 2212
  • [7] Entropy controlled Laplacian regularization for least square regression
    Wang, Xinchao
    Tao, Dacheng
    Li, Zhu
    [J]. SIGNAL PROCESSING, 2010, 90 (06) : 2043 - 2049
  • [8] Adaptive graph regularization method based on least square regression for clustering
    Peng, Siyuan
    Lu, Jing
    Cao, Jiangzhong
    Peng, Qiaomei
    Yang, Zhijing
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 114
  • [9] Least Square Regression Learning with Data Dependent Hypothesis and Coefficient Regularzation
    Sheng, Bao-Huai
    Ye, Pei-Xin
    [J]. JOURNAL OF COMPUTERS, 2011, 6 (04) : 671 - 675
  • [10] On Accelerated Gradient Approximation for Least Square Regression with L1-regularization
    Zhang, Yongquan
    Sun, Jianyong
    [J]. 2015 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2015, : 1569 - 1575