Minimization of Non-smooth, Non-convex Functionals by Iterative Thresholding

被引:0
|
作者
Kristian Bredies
Dirk A. Lorenz
Stefan Reiterer
机构
[1] University of Graz,Institute of Mathematics and Scientific Computing
[2] TU Braunschweig,Institute for Analysis and Algebra
来源
Journal of Optimization Theory and Applications | 2015年 / 165卷
关键词
Non-convex optimization; Non-smooth optimization; Gradient projection method; Iterative thresholding; 49M05; 65K10;
D O I
暂无
中图分类号
学科分类号
摘要
Convergence analysis is carried out for a forward-backward splitting/generalized gradient projection method for the minimization of a special class of non-smooth and genuinely non-convex minimization problems in infinite-dimensional Hilbert spaces. The functionals under consideration are the sum of a smooth, possibly non-convex and non-smooth, necessarily non-convex functional. For separable constraints in the sequence space, we show that the generalized gradient projection method amounts to a discontinuous iterative thresholding procedure, which can easily be implemented. In this case we prove strong subsequential convergence and moreover show that the limit satisfies strengthened necessary conditions for a global minimizer, i.e., it avoids a certain set of non-global minimizers. Eventually, the method is applied to problems arising in the recovery of sparse data, where strong convergence of the whole sequence is shown, and numerical tests are presented.
引用
收藏
页码:78 / 112
页数:34
相关论文
共 50 条
  • [1] Minimization of Non-smooth, Non-convex Functionals by Iterative Thresholding
    Bredies, Kristian
    Lorenz, Dirk A.
    Reiterer, Stefan
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2015, 165 (01) : 78 - 112
  • [2] Dual Iterative Hard Thresholding: From Non-convex Sparse Minimization to Non-smooth Concave Maximization
    Liu, Bo
    Yuan, Xiao-Tong
    Wang, Lezi
    Liu, Qingshan
    Metaxas, Dimitris N.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [3] A splitting bundle approach for non-smooth non-convex minimization
    Fuduli, A.
    Gaudioso, M.
    Nurminski, E. A.
    OPTIMIZATION, 2015, 64 (05) : 1131 - 1151
  • [4] Non-smooth Non-convex Bregman Minimization: Unification and New Algorithms
    Ochs, Peter
    Fadili, Jalal
    Brox, Thomas
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 181 (01) : 244 - 278
  • [5] Non-smooth Non-convex Bregman Minimization: Unification and New Algorithms
    Peter Ochs
    Jalal Fadili
    Thomas Brox
    Journal of Optimization Theory and Applications, 2019, 181 : 244 - 278
  • [6] Relaxed Majorization-Minimization for Non-Smooth and Non-Convex Optimization
    Xu, Chen
    Lin, Zhouchen
    Zhao, Zhenyu
    Zha, Hongbin
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 812 - 818
  • [7] Nested Alternating Minimization with FISTA for Non-convex and Non-smooth Optimization Problems
    Gur, Eyal
    Sabach, Shoham
    Shtern, Shimrit
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 199 (03) : 1130 - 1157
  • [8] Nested Alternating Minimization with FISTA for Non-convex and Non-smooth Optimization Problems
    Eyal Gur
    Shoham Sabach
    Shimrit Shtern
    Journal of Optimization Theory and Applications, 2023, 199 : 1130 - 1157
  • [9] A method to construct a quasi-normal cone for non-convex and non-smooth set and its applications to non-convex and non-smooth optimization
    Li, Hongwei
    Zhou, Dequn
    Liu, Qinghuai
    WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 1585 - +
  • [10] Efficient Convex Optimization for Non-convex Non-smooth Image Restoration
    Li, Xinyi
    Yuan, Jing
    Tai, Xue-Cheng
    Liu, Sanyang
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 99 (02)