Smooth minimization of non-smooth functions

被引:1606
|
作者
Nesterov, Y [1 ]
机构
[1] Univ Catholique Louvain, Ctr Operat Res & Econometr, B-1348 Louvain, Belgium
关键词
non-smooth optimization; convex optimization; optimal methods; complexity theory; structural optimization;
D O I
10.1007/s10107-004-0552-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper we propose anew approach for constructing efficient schemes for non-smooth convex optimization. It is based on a special smoothing technique, which can be applied to functions with explicit max-structure. Our approach can be considered as an alternative to black-box minimization. From the viewpoint of efficiency estimates, we manage to improve the traditional bounds on the number of iterations of the gradient schemes from O (1/is an element of(2)) to O (1/is an element of), keeping basically the complexity of each iteration unchanged.
引用
收藏
页码:127 / 152
页数:26
相关论文
共 50 条
  • [41] Non-smooth Non-convex Bregman Minimization: Unification and New Algorithms
    Peter Ochs
    Jalal Fadili
    Thomas Brox
    [J]. Journal of Optimization Theory and Applications, 2019, 181 : 244 - 278
  • [42] Non-smooth Non-convex Bregman Minimization: Unification and New Algorithms
    Ochs, Peter
    Fadili, Jalal
    Brox, Thomas
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 181 (01) : 244 - 278
  • [43] Relaxed Majorization-Minimization for Non-Smooth and Non-Convex Optimization
    Xu, Chen
    Lin, Zhouchen
    Zhao, Zhenyu
    Zha, Hongbin
    [J]. THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 812 - 818
  • [44] NECESSARY AND SUFFICIENT OPTIMALITY CONDITIONS FOR A CLASS OF NON-SMOOTH MINIMIZATION PROBLEMS
    BENTAL, A
    ZOWE, J
    [J]. MATHEMATICAL PROGRAMMING, 1982, 24 (01) : 70 - 91
  • [45] Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization
    Mainge, Paul-Emile
    Labarre, Florian
    [J]. NUMERICAL ALGORITHMS, 2022, 90 (01) : 99 - 136
  • [46] Minimization of cost-functions with non-smooth data-fidelity terms to clean impulsive noise
    Nikolova, M
    [J]. ENERGY MINIMIZATION METHODS IN COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 2003, 2683 : 391 - 406
  • [47] Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization
    Paul-Emile Maingé
    Florian Labarre
    [J]. Numerical Algorithms, 2022, 90 : 99 - 136
  • [48] Non-smooth Characteristic on Biological Surface and Development of Bionics Non-smooth Diamond Bit
    Zhong, Chongmei
    [J]. ADVANCES IN MANUFACTURING SCIENCE AND ENGINEERING, PTS 1-4, 2013, 712-715 : 360 - 365
  • [49] Interpolation of non-smooth functions on anisotropic finite element meshes
    Apel, T
    [J]. RAIRO-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS-MODELISATION MATHEMATIQUE ET ANALYSE NUMERIQUE, 1999, 33 (06): : 1149 - 1185
  • [50] SMOOTH AND NON-SMOOTH REGULARIZATIONS OF THE NONLINEAR DIFFUSION EQUATION
    Tomassetti, Giuseppe
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2017, 10 (06): : 1519 - 1537