Reduced subgradient bundle method for linearly constrained non-smooth non-convex problems

被引:0
|
作者
El Ghali, A. [1 ]
El Moudden, M. [1 ]
机构
[1] Moulay Ismail Univ, Dept Math & Comp Sci, Fac Sci, Meknes, Morocco
关键词
Non-smooth programming; non-convex optimization; reduced subgradient; linearly constrained problems; TRUST-REGION ALGORITHM; GRADIENT; OPTIMIZATION; IMPLEMENTATION;
D O I
10.1080/02331934.2020.1777124
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose an algorithm for solving linearly constrained non-smooth, non-convex optimization problems. The objective functions in these problems are, in general, upper semidifferentiable locally Lipschitz functions. The method is based on the idea of adapting, to the non-smooth setting, the variant of the reduced gradient algorithm proposed by Luenberger, and on bundle techniques which are aimed at building an approximation of the subdifferential. It may be thought of as an extension of reduced gradient methods for dealing with both non-smoothness and non-convexity of the objective function. Under the non-degeneracy assumption, the termination of the proposed algorithm at a stationary point is proved. Numerical results and comparisons with some existing methods are reported to show the efficiency of our algorithm.
引用
收藏
页码:2103 / 2130
页数:28
相关论文
共 50 条
  • [1] A Stochastic Subgradient Method for Distributionally Robust Non-convex and Non-smooth Learning
    Mert Gürbüzbalaban
    Andrzej Ruszczyński
    Landi Zhu
    [J]. Journal of Optimization Theory and Applications, 2022, 194 : 1014 - 1041
  • [2] A Stochastic Subgradient Method for Distributionally Robust Non-convex and Non-smooth Learning
    Gurbuzbalaban, Mert
    Ruszczynski, Andrzej
    Zhu, Landi
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 194 (03) : 1014 - 1041
  • [3] A splitting bundle approach for non-smooth non-convex minimization
    Fuduli, A.
    Gaudioso, M.
    Nurminski, E. A.
    [J]. OPTIMIZATION, 2015, 64 (05) : 1131 - 1151
  • [4] A proximal gradient method for control problems with non-smooth and non-convex control cost
    Natemeyer, Carolin
    Wachsmuth, Daniel
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2021, 80 (02) : 639 - 677
  • [5] A proximal gradient method for control problems with non-smooth and non-convex control cost
    Carolin Natemeyer
    Daniel Wachsmuth
    [J]. Computational Optimization and Applications, 2021, 80 : 639 - 677
  • [6] A method to construct a quasi-normal cone for non-convex and non-smooth set and its applications to non-convex and non-smooth optimization
    Li, Hongwei
    Zhou, Dequn
    Liu, Qinghuai
    [J]. WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 1585 - +
  • [7] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    [J]. Journal of Machine Learning Research, 2019, 20
  • [8] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [9] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [10] Stochastic Proximal Methods for Non-Smooth Non-Convex Constrained Sparse Optimization
    Metel, Michael R.
    Takeda, Akiko
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22