Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

被引:30
|
作者
Sun, Tao [1 ]
Jiang, Hao [2 ]
Cheng, Lizhi [1 ,3 ]
Zhu, Wei [4 ]
机构
[1] Natl Univ Def Technol, Dept Math, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
[3] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[4] Xiangtan Univ, Sch Math & Computat Sci, Hunan Key Lab Computat & Simulat Sci & Engn, Xiangtan 411105, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method of multipliers; Iteratively reweighted algorithm; Nonconvex and nonsmooth minimization; Kurdyka-Lojasiewicz property; Semi-algebraic functions; GLOBAL CONVERGENCE; IMAGE-RESTORATION; MINIMIZATION; ALGORITHM; APPROXIMATION;
D O I
10.1109/TSP.2018.2868269
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing andmachine learning research. The traditional alternating directionmethod of multipliers encounters troubles in both mathematics and computations in solving the nonconvex and nonsmooth subproblem. In view of this, we propose a reweighted alternating direction method of multipliers. In this algorithm, all subproblems are convex and easy to solve. We also provide several guarantees for the convergence and prove that the algorithm globally converges to a critical point of an auxiliary function with the help of the Kurdyka-Lojasiewicz property. Several numerical results are presented to demonstrate the efficiency of the proposed algorithm.
引用
下载
收藏
页码:5380 / 5391
页数:12
相关论文
共 50 条
  • [1] A regularized alternating direction method of multipliers for a class of nonconvex problems
    Jin Bao Jian
    Ye Zhang
    Mian Tao Chao
    Journal of Inequalities and Applications, 2019
  • [2] A regularized alternating direction method of multipliers for a class of nonconvex problems
    Jian, Jin Bao
    Zhang, Ye
    Chao, Mian Tao
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2019, 2019 (1)
  • [3] Analysis of the Alternating Direction Method of Multipliers for Nonconvex Problems
    Harwood S.M.
    Operations Research Forum, 2 (1)
  • [4] A Symmetric Linearized Alternating Direction Method of Multipliers for a Class of Stochastic Optimization Problems
    Jia HU
    Qimin HU
    Journal of Systems Science and Information, 2023, 11 (01) : 58 - 77
  • [5] Alternating direction method of multipliers for nonconvex fused regression problems
    Xiu, Xianchao
    Liu, Wanquan
    Li, Ling
    Kong, Lingchen
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 136 : 59 - 71
  • [6] Alternating Direction Method of Multipliers for a Class of Nonconvex and Nonsmooth Problems with Applications to Background/Foreground Extraction
    Yang, Lei
    Pong, Ting Kei
    Chen, Xiaojun
    SIAM JOURNAL ON IMAGING SCIENCES, 2017, 10 (01): : 74 - 110
  • [7] CONVERGENCE ANALYSIS OF ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR A FAMILY OF NONCONVEX PROBLEMS
    Hong, Mingyi
    Luo, Zhi-Quan
    Razaviyayn, Meisam
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 3836 - 3840
  • [8] A Symmetric Alternating Direction Method of Multipliers for Separable Nonconvex Minimization Problems
    Wu, Zhongming
    Li, Min
    Wang, David Z. W.
    Han, Deren
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2017, 34 (06)
  • [9] CONVERGENCE ANALYSIS OF ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR A FAMILY OF NONCONVEX PROBLEMS
    Hong, Mingyi
    Luo, Zhi-Quan
    Razaviyayn, Meisam
    SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (01) : 337 - 364
  • [10] An Accelerated Linearized Alternating Direction Method of Multipliers
    Ouyang, Yuyuan
    Chen, Yunmei
    Lan, Guanghui
    Pasiliao, Eduardo, Jr.
    SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (01): : 644 - 681