Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization∗

被引：0
|
作者：
Li, Zhize [1 ]
Li, Jian [2 ]
机构：
[1] Department of Electrical and Computer Engineering Carnegie Mellon University, Pittsburgh,PA,15213, United States
[2] Institute for Interdisciplinary Information Sciences Tsinghua University, Beijing,100084, China
来源：
Journal of Machine Learning Research | 2022年 / 23卷
基金：
中国国家自然科学基金;
关键词：
Gradient-descent - Local minimums - Nonconvex optimization - Nonconvex-optimization - Optimal algorithm - Proximal gradient descent - Simple++ - Stationary points - Stochastic gradient algorithms - Variance reductions;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
相关论文
共 50 条
  • [31] Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds
    Shuailing Feng
    Wen Huang
    Lele Song
    Shihui Ying
    Tieyong Zeng
    Optimization Letters, 2022, 16 : 2277 - 2297
  • [32] A NONDERIVATIVE VERSION OF THE GRADIENT SAMPLING ALGORITHM FOR NONSMOOTH NONCONVEX OPTIMIZATION
    Kiwiel, Krzysztof C.
    SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 1983 - 1994
  • [33] A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems
    Wang, Qingsong
    Liu, Zehui
    Cui, Chunfeng
    Han, Deren
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15580 - 15588
  • [34] A STOCHASTIC SUBGRADIENT METHOD FOR NONSMOOTH NONCONVEX MULTILEVEL COMPOSITION OPTIMIZATION
    Ruszczynski, Andrzej
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2021, 59 (03) : 2301 - 2320
  • [35] Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems
    Wang, Zhiguo
    Zhang, Jiawei
    Chang, Tsung-Hui
    Li, Jian
    Luo, Zhi-Quan
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4486 - 4501
  • [36] Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold
    Wang, Bokun
    Ma, Shiqian
    Xue, Lingzhou
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [37] Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold
    Wang, Bokun
    Ma, Shiqian
    Xue, Lingzhou
    Journal of Machine Learning Research, 2022, 23
  • [38] Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization
    Lian, Xiangru
    Huang, Yijun
    Li, Yuncheng
    Liu, Ji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [39] STOCHASTIC GENERALIZED-DIFFERENTIABLE FUNCTIONS IN THE PROBLEM OF NONCONVEX NONSMOOTH STOCHASTIC OPTIMIZATION
    NORKIN, VI
    CYBERNETICS, 1986, 22 (06): : 804 - 809
  • [40] STOCHASTIC ALTERNATING STRUCTURE-ADAPTED PROXIMAL GRADIENT DESCENT METHOD WITH VARIANCE REDUCTION FOR NONCONVEX NONSMOOTH OPTIMIZATION
    Jia, Zehui
    Zhang, Wenxing
    Cai, Xingju
    Han, Deren
    MATHEMATICS OF COMPUTATION, 2024, 93 (348) : 1677 - 1714
12345