A Gauss-Seidel type inertial proximal alternating linearized minimization for a class of nonconvex optimization problems

被引:22
|
作者
Gao, Xue [1 ]
Cai, Xingju [1 ]
Han, Deren [2 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Key Lab NSLSCS Jiangsu Prov, Nanjing 210023, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp BDB, Sch Math & Syst Sci, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Gauss-Seidel; Inertial; Alternating proximal linearized minimization; Kurdyka-Lojasiewicz property; Nonconvex-nonsmooth optimization; CONVERGENCE; NONSMOOTH; ALGORITHM;
D O I
10.1007/s10898-019-00819-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper we study a broad class of nonconvex and nonsmooth minimization problems, whose objective function is the sum of a smooth function of the entire variables and two nonsmooth functions of each variable. We adopt the framework of the proximal alternating linearized minimization (PALM), together with the inertial strategy to accelerate the convergence. Since the inertial step is performed once the x-subproblem/y-subproblem is updated, the algorithm is a Gauss-Seidel type inertial proximal alternating linearized minimization (GiPALM) algorithm. Under the assumption that the underlying functions satisfy the Kurdyka-Lojasiewicz (KL) property and some suitable conditions on the parameters, we prove that each bounded sequence generated by GiPALM globally converges to a critical point. We apply the algorithm to signal recovery, image denoising and nonnegative matrix factorization models, and compare it with PALM and the inertial proximal alternating linearized minimization.
引用
收藏
页码:863 / 887
页数:25
相关论文
共 50 条
  • [31] Two-step inertial Bregman alternating minimization algorithm for nonconvex and nonsmooth problems
    Jing Zhao
    Qiao-Li Dong
    Michael Th. Rassias
    Fenghui Wang
    Journal of Global Optimization, 2022, 84 : 941 - 966
  • [32] Two-step inertial Bregman alternating minimization algorithm for nonconvex and nonsmooth problems
    Zhao, Jing
    Dong, Qiao-Li
    Rassias, Michael Th
    Wang, Fenghui
    JOURNAL OF GLOBAL OPTIMIZATION, 2022, 84 (04) : 941 - 966
  • [33] A Learned Proximal Alternating Minimization Algorithm and Its Induced Network for a Class of Two-Block Nonconvex and Nonsmooth Optimization
    Yunmei Chen
    Lezhi Liu
    Lei Zhang
    Journal of Scientific Computing, 2025, 103 (2)
  • [34] A linearly convergent doubly stochastic Gauss-Seidel algorithm for solving linear equations and a certain class of over-parameterized optimization problems
    Razaviyayn, Meisam
    Hong, Mingyi
    Reyhanian, Navid
    Luo, Zhi-Quan
    MATHEMATICAL PROGRAMMING, 2019, 176 (1-2) : 465 - 496
  • [35] A Proximal-Type Method for Nonsmooth and Nonconvex Constrained Minimization Problems
    Sempere, Gregorio M.
    de Oliveira, Welington
    Royset, Johannes O.
    Journal of Optimization Theory and Applications, 2025, 204 (03)
  • [36] Bregman Proximal Gradient Algorithm With Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems
    Zhang, Xiaoya
    Barrio, Roberto
    Angeles Martinez, M.
    Jiang, Hao
    Cheng, Lizhi
    IEEE ACCESS, 2019, 7 : 126515 - 126529
  • [37] A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems
    Wang, Ting
    Liu, Hongwei
    NUMERICAL ALGORITHMS, 2024, 95 (01) : 207 - 241
  • [38] Bregman proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth minimization problems
    Department of Mathematics, National University of Defense Technology, Changsha, Hunan
    410073, China
    不详
    不详
    410073, China
    arXiv,
  • [39] Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems
    Yang, Xin
    Xu, Lingling
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 87 (2-4) : 939 - 964
  • [40] Application of Proximal Alternating Linearized Minimization (PALM) and inertial PALM to dynamic 3D CT
    Djurabekova, Nargiza
    Goldberg, Andrew
    Hauptmann, Andreas
    Hawkes, David
    Long, Guy
    Lucka, Felix
    Betcke, Marta
    15TH INTERNATIONAL MEETING ON FULLY THREE-DIMENSIONAL IMAGE RECONSTRUCTION IN RADIOLOGY AND NUCLEAR MEDICINE, 2019, 11072