TRADING ACCURACY FOR SPARSITY IN OPTIMIZATION PROBLEMS WITH SPARSITY CONSTRAINTS

被引：89

作者：

Shalev-Shwartz, Shai ^{[1
]}

Srebro, Nathan ^{[2
]}

Zhang, Tong ^{[3
]}

机构：

[1] Hebrew Univ Jerusalem, Sch Comp Sci & Engn, Jerusalem, Israel

[2] Toyota Technol Inst, Chicago, IL 60637 USA

[3] Rutgers State Univ, Dept Stat, New Brunswick, NJ 08901 USA

来源：

SIAM JOURNAL ON OPTIMIZATION | 2010年 / 20卷 / 06期

关键词：

sparsity; linear prediction; GREEDY APPROXIMATION; CONVERGENCE; REGRESSION; SELECTION; SYSTEMS; LASSO; WOLFE;

D O I：

10.1137/090759574

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We study the problem of minimizing the expected loss of a linear predictor while constraining its sparsity, i.e., bounding the number of features used by the predictor. While the resulting optimization problem is generally NP-hard, several approximation algorithms are considered. We analyze the performance of these algorithms, focusing on the characterization of the trade-off between accuracy and sparsity of the learned predictor in different scenarios.

引用

页码：2807 / 2832

页数：26

共 50 条

[21] SUPERRESOLUTION VIA SPARSITY CONSTRAINTS
DONOHO, DL
SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 1992, 23 (05) : 1309 - 1331
[22] Exploration under Sparsity Constraints
Manss, Christoph
Shutin, Dmitriy
Ruiz, Alberto Viseras
Wiedemann, Thomas
Mueller, Joachim
2015 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR), 2015,
[23] Sparsity constrained optimization problems via disjunctive programming
Movahedian, N.
Nobakhtian, S.
Sarabadan, M.
OPTIMIZATION, 2022, 71 (10) : 2979 - 3005
[24] Surface inpainting with sparsity constraints
Zhong, Ming
Qin, Hong
COMPUTER AIDED GEOMETRIC DESIGN, 2016, 41 : 23 - 35
[25] Bicomplex signals with sparsity constraints
Cerejeiras, Paula
Fu, Yingxiong
Gomes, Narciso
MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2018, 41 (13) : 5140 - 5158
[26] Accelerated Projected Gradient Method for Linear Inverse Problems with Sparsity Constraints
Daubechies, Ingrid
Fornasier, Massimo
Loris, Ignace
JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2008, 14 (5-6) : 764 - 792
[27] Accelerated Projected Gradient Method for Linear Inverse Problems with Sparsity Constraints
Ingrid Daubechies
Massimo Fornasier
Ignace Loris
Journal of Fourier Analysis and Applications, 2008, 14 : 764 - 792
[28] Accelerated Projected Gradient Algorithms for Sparsity Constrained Optimization Problems
Alcantara, Jan Harold
Lee, Ching-pei
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
[29] Rule Weight Optimization and Feature Selection in Fuzzy Systems with Sparsity Constraints
Lughofer, Edwin
Kindermann, Stefan
PROCEEDINGS OF THE JOINT 2009 INTERNATIONAL FUZZY SYSTEMS ASSOCIATION WORLD CONGRESS AND 2009 EUROPEAN SOCIETY OF FUZZY LOGIC AND TECHNOLOGY CONFERENCE, 2009, : 950 - 956
[30] Trading Complexity for Sparsity in Random Forest Explanations
Audemard, Gilles
Bellart, Steve
Bounia, Louenas
Koriche, Frederic
Lagniez, Jean-Marie
Marquis, Pierre
THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 5461 - 5469

← 1 2 3 4 5 →