Large-scale regression with non-convex loss and penalty

被引：16

作者：

Buccini, Alessandro ^{[1
]}

Cabrera, Omar De la Cruz ^{[2
]}

Donatelli, Marco ^{[3
]}

Martinelli, Andrea ^{[3
]}

Reichel, Lothar ^{[2
]}

机构：

[1] Univ Cagliari, Dept Math & Comp Sci, I-09124 Cagliari, Italy

[2] Kent State Univ, Dept Math Sci, Kent, OH 44242 USA

[3] Univ Insubria, Dept Sci & High Technol, I-22100 Como, Italy

来源：

APPLIED NUMERICAL MATHEMATICS | 2020年 / 157卷

关键词：

Regression; Regularization; Robustness; Non-convex Optimization; MINIMIZATION; REGULARIZATION; SHRINKAGE; ALGORITHM; SPARSITY;

D O I：

10.1016/j.apnum.2020.07.006

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We describe a computational method for parameter estimation in linear regression, that is capable of simultaneously producing sparse estimates and dealing with outliers and heavy-tailed error distributions. The method used is based on the image restoration method proposed in Huang et al. (2017) [13]. It can be applied to problems of arbitrary size. The choice of certain parameters is discussed. Results obtained for simulated and real data are presented. (C) 2020 IMACS. Published by Elsevier B.V. All rights reserved.

引用

页码：590 / 601

页数：12

共 50 条

[41] Echo state network with a non-convex penalty for nonlinear time series prediction
Wang, Wenting
Li, Fanjun
Liu, Qianwen
NEUROCOMPUTING, 2025, 637
[42] Estimating scale economies in non-convex production models
Cesaroni, Giovanni
Kerstens, Kristiaan
Van de Woestyne, Ignace
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2017, 68 (11) : 1442 - 1451
[43] Robust regularized extreme learning machine for regression with non-convex loss function via DC program
Wang, Kuaini
Pei, Huimin
Cao, Jinde
Zhong, Ping
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2020, 357 (11): : 7069 - 7091
[44] An efficient algorithm for the non-convex penalized multinomial logistic regression
Kwon, Sunghoon
Kim, Dongshin
Lee, Sangin
COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2020, 27 (01) : 129 - 140
[45] Cluster Analysis: Unsupervised Learning via Supervised Learning with a Non-convex Penalty
Pan, Wei
Shen, Xiatong
Liu, Binghui
JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 1865 - 1889
[46] Sparse signals recovered by non-convex penalty in quasi-linear systems
Cui, Angang
Li, Haiyang
Wen, Meng
Peng, Jigen
JOURNAL OF INEQUALITIES AND APPLICATIONS, 2018,
[47] Sparse signals recovered by non-convex penalty in quasi-linear systems
Angang Cui
Haiyang Li
Meng Wen
Jigen Peng
Journal of Inequalities and Applications, 2018
[48] Cluster analysis: Unsupervised learning via supervised learning with a non-convex penalty
Pan, Wei
Shen, Xiaotong
Liu, Binghui
Journal of Machine Learning Research, 2013, 14 : 1865 - 1889
[49] CLUSTERING BY ORTHOGONAL NON-NEGATIVE MATRIX FACTORIZATION: A SEQUENTIAL NON-CONVEX PENALTY APPROACH
Wang, Shuai
Chang, Tsung-Hui
Cui, Ying
Pang, Jong-Shi
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5576 - 5580
[50] Katalyst: Boosting Convex Katyusha for Non-Convex Problems with a Large Condition Number
Chen, Zaiyi
Xu, Yi
Hu, Haoyuan
Yang, Tianbao
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97

← 1 2 3 4 5 →