Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

被引:30
|
作者
Sun, Tao [1 ]
Jiang, Hao [2 ]
Cheng, Lizhi [1 ,3 ]
Zhu, Wei [4 ]
机构
[1] Natl Univ Def Technol, Dept Math, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
[3] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[4] Xiangtan Univ, Sch Math & Computat Sci, Hunan Key Lab Computat & Simulat Sci & Engn, Xiangtan 411105, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method of multipliers; Iteratively reweighted algorithm; Nonconvex and nonsmooth minimization; Kurdyka-Lojasiewicz property; Semi-algebraic functions; GLOBAL CONVERGENCE; IMAGE-RESTORATION; MINIMIZATION; ALGORITHM; APPROXIMATION;
D O I
10.1109/TSP.2018.2868269
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing andmachine learning research. The traditional alternating directionmethod of multipliers encounters troubles in both mathematics and computations in solving the nonconvex and nonsmooth subproblem. In view of this, we propose a reweighted alternating direction method of multipliers. In this algorithm, all subproblems are convex and easy to solve. We also provide several guarantees for the convergence and prove that the algorithm globally converges to a critical point of an auxiliary function with the help of the Kurdyka-Lojasiewicz property. Several numerical results are presented to demonstrate the efficiency of the proposed algorithm.
引用
下载
收藏
页码:5380 / 5391
页数:12
相关论文
共 50 条
  • [21] Alternating direction method of multipliers for a class of nonconvex bilinear optimization: convergence analysis and applications
    Davood Hajinezhad
    Qingjiang Shi
    Journal of Global Optimization, 2018, 70 : 261 - 288
  • [22] Alternating direction method of multipliers for a class of nonconvex bilinear optimization: convergence analysis and applications
    Hajinezhad, Davood
    Shi, Qingjiang
    JOURNAL OF GLOBAL OPTIMIZATION, 2018, 70 (01) : 261 - 288
  • [23] Local Linear Convergence of the Alternating Direction Method of Multipliers for Nonconvex Separable Optimization Problems
    Jia, Zehui
    Gao, Xue
    Cai, Xingju
    Han, Deren
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 188 (01) : 1 - 25
  • [24] Local Linear Convergence of the Alternating Direction Method of Multipliers for Nonconvex Separable Optimization Problems
    Zehui Jia
    Xue Gao
    Xingju Cai
    Deren Han
    Journal of Optimization Theory and Applications, 2021, 188 : 1 - 25
  • [25] Linearized Alternating Direction Method with Penalization for Nonconvex and Nonsmooth Optimization
    Wang, Yiyang
    Liu, Risheng
    Song, Xiaoliang
    Su, Zhixun
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 798 - 804
  • [26] Faster Stochastic Alternating Direction Method of Multipliers for Nonconvex Optimization
    Huang, Feihu
    Chen, Songcan
    Huang, Heng
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [27] An inertial proximal alternating direction method of multipliers for nonconvex optimization
    Chao, M. T.
    Zhang, Y.
    Jian, J. B.
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2021, 98 (06) : 1199 - 1217
  • [28] LINEAR CONVERGENCE OF THE ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR A CLASS OF CONVEX OPTIMIZATION PROBLEMS
    Yang, Wei Hong
    Han, Deren
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2016, 54 (02) : 625 - 640
  • [29] A reweighted alternating direction method of multipliers for joint phase adjustment and ISAR imaging
    Wei, Xu
    Yang, Jun
    Lv, Mingjiu
    Chen, Wenfeng
    Ma, Xiaoyan
    REMOTE SENSING LETTERS, 2022, 13 (10) : 1020 - 1028
  • [30] A proximal alternating direction method of multipliers for a minimization problem with nonconvex constraints
    Peng, Zheng
    Chen, Jianli
    Zhu, Wenxing
    JOURNAL OF GLOBAL OPTIMIZATION, 2015, 62 (04) : 711 - 728