Convergence of a block coordinate descent method for nondifferentiable minimization

被引:1418
|
作者
Tseng, P [1 ]
机构
[1] Univ Washington, Dept Math, Seattle, WA 98195 USA
基金
美国国家科学基金会;
关键词
block coordinate descent; nondifferentiable minimization; stationary point; Gauss-Seidel method; convergence; quasiconvex functions; pseudoconvex functions;
D O I
10.1023/A:1017501703105
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We study the convergence properties of a (block) coordinate descent method applied to minimize a nondifferentiable (nonconvex) function f(x(I),..., x(n)) with certain separability and regularity properties. Assuming that f is continuous on a compact level set, the subsequence convergence of the iterates to a stationary point is shown when either f is pseudoconvex in every pair of coordinate blocks from among N - 1 coordinate blocks orf has at most one minimum in each of N - 2 coordinate blocks. If f is quasiconvex and hemivariate in every coordinate block, then the assumptions of continuity off and compactness of the level set may be relaxed further. These results are applied to derive new land old) convergence results for the proximal minimization algorithm, an algorithm of Arimoto and Blahut, and an algorithm of Han. They are applied also to a problem of blind source separation.
引用
收藏
页码:475 / 494
页数:20
相关论文
共 50 条
  • [41] Accelerated Mini-batch Randomized Block Coordinate Descent Method
    Zhao, Tuo
    Yu, Mo
    Wang, Yiming
    Arora, Raman
    Liu, Han
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [42] A Block Coordinate Descent Proximal Method for Simultaneous Filtering and Parameter Estimation
    Raziperchikolaei, Ramin
    Bhat, Harish S.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [43] A monotone block coordinate descent method for solving absolute value equations☆
    Luo, Tingting
    Liu, Jiayu
    Chen, Cairong
    Wang, Qun
    APPLIED MATHEMATICS LETTERS, 2025, 164
  • [44] Portfolio Optimization with Nonparametric Value at Risk: A Block Coordinate Descent Method
    Cui, Xueting
    Sun, Xiaoling
    Zhu, Shushang
    Jiang, Rujun
    Li, Duan
    INFORMS JOURNAL ON COMPUTING, 2018, 30 (03) : 454 - 471
  • [45] A CONSTRAINT LINEARIZATION METHOD FOR NONDIFFERENTIABLE CONVEX MINIMIZATION
    KIWIEL, KC
    NUMERISCHE MATHEMATIK, 1987, 51 (04) : 395 - 414
  • [46] Faster convergence of a randomized coordinate descent method for linearly constrained optimization problems
    Fang, Qin
    Xu, Min
    Ying, Yiming
    ANALYSIS AND APPLICATIONS, 2018, 16 (05) : 741 - 755
  • [47] ON THE NONASYMPTOTIC CONVERGENCE OF CYCLIC COORDINATE DESCENT METHODS
    Saha, Ankan
    Tewari, Ambuj
    SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) : 576 - 601
  • [48] Randomized block coordinate descent method for linear ill-posed problems
    Jin, Qinian
    Liu, Duo
    INVERSE PROBLEMS, 2025, 41 (03)
  • [49] On complexity and convergence of high-order coordinate descent algorithms for smooth nonconvex box-constrained minimization
    V. S. Amaral
    R. Andreani
    E. G. Birgin
    D. S. Marcondes
    J. M. Martínez
    Journal of Global Optimization, 2022, 84 : 527 - 561
  • [50] BAYESIAN FUSION OF MULTISPECTRAL AND HYPERSPECTRAL IMAGES USING A BLOCK COORDINATE DESCENT METHOD
    Wei, Qi
    Dobigeon, Nicolas
    Tourneret, Jean-Yves
    2015 7TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2015,