TRADING ACCURACY FOR SPARSITY IN OPTIMIZATION PROBLEMS WITH SPARSITY CONSTRAINTS

被引：89

作者：

Shalev-Shwartz, Shai ^{[1
]}

Srebro, Nathan ^{[2
]}

Zhang, Tong ^{[3
]}

机构：

[1] Hebrew Univ Jerusalem, Sch Comp Sci & Engn, Jerusalem, Israel

[2] Toyota Technol Inst, Chicago, IL 60637 USA

[3] Rutgers State Univ, Dept Stat, New Brunswick, NJ 08901 USA

来源：

SIAM JOURNAL ON OPTIMIZATION | 2010年 / 20卷 / 06期

关键词：

sparsity; linear prediction; GREEDY APPROXIMATION; CONVERGENCE; REGRESSION; SELECTION; SYSTEMS; LASSO; WOLFE;

D O I：

10.1137/090759574

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We study the problem of minimizing the expected loss of a linear predictor while constraining its sparsity, i.e., bounding the number of features used by the predictor. While the resulting optimization problem is generally NP-hard, several approximation algorithms are considered. We analyze the performance of these algorithms, focusing on the characterization of the trade-off between accuracy and sparsity of the learned predictor in different scenarios.

引用

页码：2807 / 2832

页数：26

共 50 条

[1] Online Linear Optimization with Sparsity Constraints
Wang, Jun-Kun
Lu, Chi-Jen
Lin, Shou-De
ALGORITHMIC LEARNING THEORY, VOL 98, 2019, 98
[2] Convex optimization under combinatorial sparsity constraints
Buchheim, Christoph
Traversi, Emiliano
OPERATIONS RESEARCH LETTERS, 2022, 50 (06) : 632 - 638
[3] Graph optimization for dimensionality reduction with sparsity constraints
Zhang, Limei
Chen, Songcan
Qiao, Lishan
PATTERN RECOGNITION, 2012, 45 (03) : 1205 - 1210
[4] On Tractable Convex Relaxations of Standard Quadratic Optimization Problems under Sparsity Constraints
Bomze, Immanuel
Peng, Bo
Qiu, Yuzhou
Yildirim, E. Alper
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2025, 204 (03)
[5] Iterated hard shrinkage for minimization problems with sparsity constraints
Bredies, Kristian
Lorenz, Dirk A.
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2008, 30 (02): : 657 - 683
[6] Optimization problems involving group sparsity terms
Beck, Amir
Hallak, Nadav
MATHEMATICAL PROGRAMMING, 2019, 178 (1-2) : 39 - 67
[7] Optimization problems involving group sparsity terms
Amir Beck
Nadav Hallak
Mathematical Programming, 2019, 178 : 39 - 67
[8] Restricted Normal Cones and Sparsity Optimization with Affine Constraints
Bauschke, Heinz H.
Luke, D. Russell
Phan, Hung M.
Wang, Xianfu
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2014, 14 (01) : 63 - 83
[9] Restricted Normal Cones and Sparsity Optimization with Affine Constraints
Heinz H. Bauschke
D. Russell Luke
Hung M. Phan
Xianfu Wang
Foundations of Computational Mathematics, 2014, 14 : 63 - 83
[10] Doubly majorized algorithm for sparsity-inducing optimization problems with regularizer-compatible constraints
Tianxiang Liu
Ting Kei Pong
Akiko Takeda
Computational Optimization and Applications, 2023, 86 : 521 - 553

← 1 2 3 4 5 →