Convergence of a block coordinate descent method for nondifferentiable minimization

被引:1418
|
作者
Tseng, P [1 ]
机构
[1] Univ Washington, Dept Math, Seattle, WA 98195 USA
基金
美国国家科学基金会;
关键词
block coordinate descent; nondifferentiable minimization; stationary point; Gauss-Seidel method; convergence; quasiconvex functions; pseudoconvex functions;
D O I
10.1023/A:1017501703105
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We study the convergence properties of a (block) coordinate descent method applied to minimize a nondifferentiable (nonconvex) function f(x(I),..., x(n)) with certain separability and regularity properties. Assuming that f is continuous on a compact level set, the subsequence convergence of the iterates to a stationary point is shown when either f is pseudoconvex in every pair of coordinate blocks from among N - 1 coordinate blocks orf has at most one minimum in each of N - 2 coordinate blocks. If f is quasiconvex and hemivariate in every coordinate block, then the assumptions of continuity off and compactness of the level set may be relaxed further. These results are applied to derive new land old) convergence results for the proximal minimization algorithm, an algorithm of Arimoto and Blahut, and an algorithm of Han. They are applied also to a problem of blind source separation.
引用
收藏
页码:475 / 494
页数:20
相关论文
共 50 条
  • [1] Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization
    P. Tseng
    Journal of Optimization Theory and Applications, 2001, 109 : 475 - 494
  • [2] ON THE CONVERGENCE OF THE COORDINATE DESCENT METHOD FOR CONVEX DIFFERENTIABLE MINIMIZATION
    LUO, ZQ
    TSENG, P
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1992, 72 (01) : 7 - 35
  • [3] A BLOCK COORDINATE DESCENT METHOD OF MULTIPLIERS: CONVERGENCE ANALYSIS AND APPLICATIONS
    Hong, Mingyi
    Chang, Tsung-Hui
    Wang, Xiangfeng
    Razaviyayn, Meisam
    Ma, Shiqian
    Luo, Zhi-Quan
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [4] A BLOCK-COORDINATE DESCENT METHOD FOR LINEARLY CONSTRAINED MINIMIZATION PROBLEM
    Xuefang Liu
    Zheng Peng
    AnnalsofAppliedMathematics, 2018, 34 (02) : 138 - 152
  • [5] ON THE CONVERGENCE OF BLOCK COORDINATE DESCENT TYPE METHODS
    Beck, Amir
    Tetruashvili, Luba
    SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (04) : 2037 - 2060
  • [6] Synchronous Parallel Block Coordinate Descent Method for Nonsmooth Convex Function Minimization
    DAI Yutong
    WENG Yang
    Journal of Systems Science & Complexity, 2020, 33 (02) : 345 - 365
  • [7] Synchronous Parallel Block Coordinate Descent Method for Nonsmooth Convex Function Minimization
    Dai, Yutong
    Weng, Yang
    JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2020, 33 (02) : 345 - 365
  • [8] Synchronous Parallel Block Coordinate Descent Method for Nonsmooth Convex Function Minimization
    Yutong Dai
    Yang Weng
    Journal of Systems Science and Complexity, 2020, 33 : 345 - 365
  • [9] On Faster Convergence of Cyclic Block Coordinate Descent-type Methods for Strongly Convex Minimization
    Li, Xingguo
    Zhao, Tuo
    Arora, Raman
    Liu, Han
    Hong, Mingyi
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 18
  • [10] Block coordinate descent for smooth nonconvex constrained minimization
    Birgin, E. G.
    Martinez, J. M.
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 83 (01) : 1 - 27