SUFFICIENT CONDITIONS FOR INSTABILITY OF THE SUBGRADIENT METHOD WITH CONSTANT STEP SIZE

被引：0

作者：

Josz, Cedric ^{[1
]}

Lai, Lexiao ^{[1
]}

机构：

[1] Columbia Univ, Dept Ind Engn & Operat Res, New York, NY 10027 USA

来源：

SIAM JOURNAL ON OPTIMIZATION | 2024年 / 34卷 / 01期

关键词：

Lyapunov stability; metric subregularity; subgradient method; Verdier condition; METRIC SUBREGULARITY; REGULARITY; STRATIFICATIONS;

D O I：

10.1137/22M1535723

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We provide sufficient conditions for instability of the subgradient method with constant step size around a local minimum of a locally Lipschitz semialgebraic function. They are satisfied by several spurious local minima arising in robust principal component analysis and neural networks.

引用

页码：57 / 70

页数：14

共 50 条

[1] Lyapunov stability of the subgradient method with constant step size
Josz, Cedric
Lai, Lexiao
MATHEMATICAL PROGRAMMING, 2023, 202 (1-2) : 387 - 396
[2] Publisher Correction to: Lyapunov stability of the subgradient method with constant step size
Cédric Josz
Lexiao Lai
Mathematical Programming, 2023, 202 (1-2) : 397 - 398
[3] A subgradient method with constant step-size for l1-composite optimization
Scagliotti, A.
Franzone, P. Colli
BOLLETTINO DELLA UNIONE MATEMATICA ITALIANA, 2024, 17 (02): : 471 - 490
[4] ON THE CHOICE OF STEP SIZE IN SUBGRADIENT OPTIMIZATION
BAZARAA, MS
SHERALI, HD
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1981, 7 (04) : 380 - 388
[5] Asymptotic Network Independence and Step-Size for a Distributed Subgradient Method
Olshevsky, Alex
Journal of Machine Learning Research, 2022, 23
[6] Asymptotic Network Independence and Step-Size for a Distributed Subgradient Method
Olshevsky, Alex
JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
[7] Generalized subgradient method with relaxation step
1600, Elsevier Science B.V., Amsterdam, Netherlands (71):
[8] A generalized subgradient method with relaxation step
Brannlund, U
MATHEMATICAL PROGRAMMING, 1995, 71 (02) : 207 - 219
[9] A convergent incremental gradient method with a constant step size
Blatt, Doron
Hero, Alfred O.
Gauchman, Hillel
SIAM JOURNAL ON OPTIMIZATION, 2007, 18 (01) : 29 - 51
[10] SUFFICIENT CONDITIONS FOR STABILITY AND INSTABILITY IN CARRIER SYSTEMS USING DIRECT METHOD
KUTSCHKE, KH
ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1971, 51 (02): : 125 - &

← 1 2 3 4 5 →